• Title/Summary/Keyword: Multi Viewpoint

Search Result 227, Processing Time 0.022 seconds

A Video Streaming Scheme for Minimizing Viewpoint Switching Delay in DASH-based Multi-view Video Services (DASH 기반의 다시점 비디오 서비스에서 시점전환 지연 최소화를 위한 비디오 전송 기법)

  • Kim, Sangwook;Yun, Dooyeol;Chung, Kwangsue
    • Journal of KIISE
    • /
    • v.43 no.5
    • /
    • pp.606-612
    • /
    • 2016
  • The multi-view video service based on the DASH(Dynamic Adaptive Streaming over HTTP) switches the viewpoint or object which is selected by the user among the multiple video streams captured by multiple cameras. However, the problem is that the conventional DASH-based multi-view video service takes a long time to switch the viewpoint. The reason is that the conventional scheme switches to the new video stream after consuming all buffered segments of the previous video stream. In this paper, we propose a video streaming scheme for minimizing the viewpoint switching delay in the DASH-based multi-view video service. In order to minimize the viewpoint switching delay, the proposed scheme configures the video streams by controlling the GoP (Group of Pictures) size and controls the client buffer based on bandwidth estimation and playback buffer occupancy. Through the experimental results, we prove that the proposed scheme reduces the viewpoint switching delay.

Design of a Feature-based Multi-viewpoint Design Automation System

  • Lee, Kwang-Hoon;McMahon, Chris A.;Lee, Kwan-H.
    • International Journal of CAD/CAM
    • /
    • v.3 no.1_2
    • /
    • pp.67-75
    • /
    • 2003
  • Viewpoint-dependent feature-based modelling in computer-aided design is developed for the purposes of supporting engineering design representation and automation. The approach of this paper uses a combination of a multi-level modelling approach. This has two stages of mapping between models, and the multi-level model approach is implemented in three-level architecture. Top of this level is a feature-based description for each viewpoint, comprising a combination of form features and other features such as loads and constraints for analysis. The middle level is an executable representation of the feature model. The bottom of this multi-level modelling is a evaluation of a feature-based CAD model obtained by executable feature representations defined in the middle level. The mappings involved in the system comprise firstly, mapping between the top level feature representations associated with different viewpoints, for example for the geometric simplification and addition of boundary conditions associated with moving from a design model to an analysis model, and secondly mapping between the top level and the middle level representations in which the feature model is transformed into the executable representation. Because an executable representation is used as the intermediate layer, the low level evaluation can be active. The example will be implemented with an analysis model which is evaluated and for which results are output. This multi-level modelling approach will be investigated within the framework aimed for the design automation with a feature-based model.

Layered Depth Image Representation And H.264 Encoding of Multi-view video For Free viewpoint TV (자유시점 TV를 위한 다시점 비디오의 계층적 깊이 영상 표현과 H.264 부호화)

  • Shin, Jong Hong
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.7 no.2
    • /
    • pp.91-100
    • /
    • 2011
  • Free viewpoint TV can provide multi-angle view point images for viewer needs. In the real world, But all angle view point images can not be captured by camera. Only a few any angle view point images are captured by each camera. Group of the captured images is called multi-view image. Therefore free viewpoint TV wants to production of virtual sub angle view point images form captured any angle view point images. Interpolation methods are known of this problem general solution. To product interpolated view point image of correct angle need to depth image of multi-view image. Unfortunately, multi-view video including depth image is necessary to develop a new compression encoding technique for storage and transmission because of a huge amount of data. Layered depth image is an efficient representation method of multi-view video data. This method makes a data structure that is synthesis of multi-view color and depth image. This paper proposed enhanced compression method using layered depth image representation and H.264/AVC video coding technology. In experimental results, confirmed high compression performance and good quality reconstructed image.

Viewpoint Invariant Person Re-Identification for Global Multi-Object Tracking with Non-Overlapping Cameras

  • Gwak, Jeonghwan;Park, Geunpyo;Jeon, Moongu
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.4
    • /
    • pp.2075-2092
    • /
    • 2017
  • Person re-identification is to match pedestrians observed from non-overlapping camera views. It has important applications in video surveillance such as person retrieval, person tracking, and activity analysis. However, it is a very challenging problem due to illumination, pose and viewpoint variations between non-overlapping camera views. In this work, we propose a viewpoint invariant method for matching pedestrian images using orientation of pedestrian. First, the proposed method divides a pedestrian image into patches and assigns angle to a patch using the orientation of the pedestrian under the assumption that a person body has the cylindrical shape. The difference between angles are then used to compute the similarity between patches. We applied the proposed method to real-time global multi-object tracking across multiple disjoint cameras with non-overlapping field of views. Re-identification algorithm makes global trajectories by connecting local trajectories obtained by different local trackers. The effectiveness of the viewpoint invariant method for person re-identification was validated on the VIPeR dataset. In addition, we demonstrated the effectiveness of the proposed approach for the inter-camera multiple object tracking on the MCT dataset with ground truth data for local tracking.

Multi-Viewpoint Stereo Image Synthesis Using Multi-Resolution EPI Method (다해상도 EPI 방식에 의한 다시점 입체 영상 합성)

  • 장흥엽;이제호;권용무;김상국;박상희
    • Journal of Broadcast Engineering
    • /
    • v.2 no.1
    • /
    • pp.16-23
    • /
    • 1997
  • Among the main technologies to implement 3D TV succeeding HDTV, multi-viewpoint image display technique is rising as an important issue, which can display the viewpoint-dependent images corresponding to viewer's position. This paper presents a novel method that solves too much computational overload that is main drawback of previous methods. Using down sampling technique, multiresolution EPIs are made from multi-viewpoint image set and trace lines are detected in the lowest resolution EPI. The parameters of detected trace lines are transferred to higher resolution EPIs and revised by utilizing the information of the previous resolution EPI. This procedure is iterated until orignal resolution EPI. Using the proposed method, we have achieved the reduction of computational time and the robustness to noise in comparison to previous method.

  • PDF

Creating Simultaneous Story Arcs Using Constraint Based Narrative Structure (제약 조건 기반 서술구조를 이용한 동시 진행 이야기의 생성)

  • Moon, Sung-Hyun;Kim, Seok-Kyoo;Hong, Euy-Seok;Han, Sang-Yong
    • The Journal of the Korea Contents Association
    • /
    • v.10 no.5
    • /
    • pp.107-114
    • /
    • 2010
  • A nonlinear story is generated through the interactivity with users using the interactive storytelling system. In a play or movie, audiences can watch one scene at a time, and in order to watch next scene, they should wait for the end of current scene. In the real world, however, various events can simultaneously happen at different places, and even those events performed by characters may dramatically affect the flow of the story. This paper suggests Constraint Based narrative structure to create such story, known as "Simultaneous Story Arcs", and "Multi Viewpoint" to simultaneously lead the direction of the stories in each place.

Implementation Method for DASH-based Free-viewpoint Video Streaming System (DASH 기반 자유시점 비디오 스트리밍 시스템 구현)

  • Seo, Minjae;Paik, Jong-ho
    • Journal of Internet Computing and Services
    • /
    • v.20 no.1
    • /
    • pp.47-55
    • /
    • 2019
  • Free-viewpoint video (FVV) service provides multi viewpoints of contents and synthesizes intermediate video files which are not captured on some view angles so that enables users to watch as they choose wherever they want. Synthesizing video is necessary technique to provide FVV video service, because every video of the FVV contents for different view angles cannot be stored to the content server physically. For the reason, fast view synthesis can improve the quality of video service and increase user's satisfaction. One of the studies for FVV service, a method was proposed to transmit FVV service based on DASH (Dynamic Adaptive Streaming over HTTP). There is big advantage on using DASH that it is commonly used to transport video service. However, the method was only a conceptual proposal, so it is difficult to implement the system using the proposal. In this paper, we propose an implementation method to provide real-time FVV service smoothly. We suggest a system structure and operation method on the server and client side in detail, which is to be applicable to synthesize video quickly. Also, we suggest generating FVV service map additionally which controls a FVV service overall. We manage real-time information of the whole service through the service map. The service can be controlled by reducing the possible delay from network situation.

WALK-THROUGH VIEW FOR FTV WITH CIRCULAR CAMERA SETUP

  • Uemori, Takeshi;Yendo, Tomohiro;Tanimoto, Masayuki;Fujii, Toshiaki
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2009.01a
    • /
    • pp.727-731
    • /
    • 2009
  • In this paper, we propose a method to generate a free viewpoint image using multi-viewpoint images which are taken by cameras arranged circularly. In past times, we have proposed the method to generate a free viewpoint image based on Ray-Space method. However, with that method, we can not generate a walk-through view seen from a virtual viewpoint among objects. The method we propose in this paper realizes the generation of such view. Our method gets information of the positions of objects using shape from silhouette method at first, and selects appropriate cameras which acquired rays needed for generating a virtual image. A free viewpoint image can be generated by collecting rays which pass over the focal point of a virtual camera. However, when the requested ray is not available, it is necessary to interpolate it from neighboring rays. Therefore, we estimate the depth of the objects from a virtual camera and interpolate ray information to generate the image. In the experiments with the virtual sequences which were captured at every 6 degrees, we set the virtual camera at user's choice and generated the image from that viewpoint successfully.

  • PDF

A Viewpoint Switching Service for Multi-View Videos based on MPEG-4 System (MPEG-4 시스템 기반의 다시점 동영상 시점 전환 서비스)

  • Park, Kyung-Seok;Kim, Min-Jun;Kang, Sung-Hwan;Kim, Sung-Ho
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.16 no.1
    • /
    • pp.65-69
    • /
    • 2010
  • Moving Picture Expert Group(MPEG) is the organization foundedin 1998 to establish the standards for compressing and expressing the multimedia contents. The organization has established the technological standards such as MPEG-1, MPEG-2, MPEG-4 and MPEG-7. As the 3D video related standards, there is Multiview Profile which is included in the MPEG-2 video of 1996. However, as the MPEG-2 multiview profile is the standard for compressing the videos from two viewpoints on the object, it is not enough to meet the requirement of multiviewvideo technology. In addition, it does not have the technology on the viewpoint switching that it does not provide the services such as the user interaction. This paper proposes the structure in which the specific viewpoint can be described for video switching in addition to the current MPEG-4 system.

FREE VIEWPOINT IMAGE RECONSTRUCTION FROM 3-D MULTI-FOCUS IMAGING SEQUENCES AND ITS IMPLEMENTATION BY CELL-BASED COMPUTING

  • Yonezawayz, Hiroki;Kodamay, Kazuya;Hamamotoz, Takayuki
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2009.01a
    • /
    • pp.751-754
    • /
    • 2009
  • This paper deals with the Cell-based distributed processing for generating free viewpoint images by merging multiple differently focused images. We previously proposed the method of generating free viewpoint images without any depth estimation. However, it is not so easy to realize real-time image reconstruction based on our previous method. In this paper, we discuss the method to reduce the processing time by dimension reduction for image filtering and Cell-based distributed processing. Especially, the method of high-speed image reconstruction by the Cell processor on SONY PLAYSTATION3(PS3) is described in detail. We show some experimental results by using real images and we discuss the possibility of real-time free viewpoint image reconstruction.

  • PDF