• Smart Media Journal
• /
• v.1 no.3
• /
• pp.36-42
• /
• 2012

Recently, the smart applications, such as smart phone and smart TV, become a hot issue in IT consumer markets. In particular, the smart TV provides 3D video services, hence efficient coding methods for 3D video data are required. Three-dimensional (3D) video involves stereoscopic or multi-view images to provide depth experience through 3D display systems. Binocular cues are perceived by rendering proper viewpoint images obtained at slightly different view angles. Since the number of viewpoints of the multi-view video is limited, 3D display devices should generate arbitrary viewpoint images using available adjacent view images. In this paper, after we explain a view synthesis method briefly, we propose a new algorithm to compensate view synthesis errors around object boundaries. We describe a 3D warping technique exploiting the depth map for viewpoint shifting and a hole filling method using multi-view images. Then, we propose an algorithm to remove boundary noises that are generated due to mismatches of object edges in the color and depth images. The proposed method reduces annoying boundary noises near object edges by replacing erroneous textures with alternative textures from the other reference image. Using the proposed method, we can generate perceptually inproved images for 3D video systems.

• Journal of Broadcast Engineering
• /
• v.15 no.4
• /
• pp.540-546
• /
• 2010

Since the stereoscopic 3-dimensional (3D) video that provides users with a realistic multimedia service requires twice as much data as 2-dimensional (2D) video, it is difficult to construct the fast system. In this paper, we propose a fast stereoscopic 3D broadcasting system based on the depth information. Before the transmission, we encode the input 2D+depth video using x264, an open source H.264/AVC fast encoder to reduce the size of the data. At the receiver, we decode the transmitted bitstream in real time using a compute unified device architecture (CUDA) video decoder API on NVIDIA graphics processing unit (GPU). Then, we apply a fast view synthesis method that generates the virtual view using GPU. The proposed system can display the output video in both 2DTV and 3DTV. From the experiment, we verified that the proposed system can service the stereoscopic 3D contents in 24 frames per second at most.

• Journal of Broadcast Engineering
• /
• v.16 no.2
• /
• pp.258-273
• /
• 2011

This paper designs and implements a multi-view 3D video player system which is operated faster than existing video player systems. The structure for obtaining the near optimum speed in a multi-processor environment by parallelizing the component modules is proposed to process large volumes of multi-view image data at high speed. In order to use the concurrency of bottleneck, we designed image decoding, synthesis and rendering modules in a pipeline structure. For load balancing, the decoder module is divided into the unit of viewpoint, and the image synthesis module is geometrically divided based on synthesized images. As a result of this experiment, multi-view images were correctly synthesized and the 3D sense could be felt when watching the images on the multi-view autostereoscopic display. The proposed application processing structure could be used to process large volumes of multi-view image data at high speed, using the multi-processors to their maximum capacity.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.20 no.3
• /
• pp.331-341
• /
• 2002

In order to extract 3-dimensional information from 2-D image, stereo images are prerequisite. Moreover, for the measurement of moving objects, the synchronized sequential stereo images have to be captured and image matching should be implemented for determining the location of moving objects. In this research, a simple method computing 3-dimensional coordinates from sequential images of moving objects was implemented. The sequential stereo images were captured by a video camera with a beam splitter. Once video images were digitalized by frame grabber, the interest points were extracted and matched in each stereo image, and the coordinates of center of them are calculated using weighted average method. Then, 3-dimensional coordinates of moving objects were computed by DLT algorithms.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2016.06a
• /
• pp.302-305
• /
• 2016

This paper proposes a boundary artifacts reduction method for synthesized views in 3D video system using Projection onto Convex Sets (POCS). In 3D video system, boundary artifacts are occurred in synthesized views by distorted depth map. In this paper, we analyze boundary artifacts, and show the experimental results by the proposed algorithm on various situations.

• Journal of KIISE:Computing Practices and Letters
• /
• v.9 no.1
• /
• pp.1-12
• /
• 2003

Recently, many researches into distributed processing on Internet, and multimedia data processing have been performed. Rapid and convenient multimedia services supplied with high quality and high speed are to be needed. In this paper, we design and implement clip-based video retrieval system on the Web enviroment in real-time. Our system consists of the content-based indexing system supporting convenient services for video content providers, and the Web-based retrieval system in order to make it easy and various information retrieval for users in the Web. Three important methods are used in the content-based indexing system, key frame extracting method by dividing video data, clip file creation method by clustering related information, and video database construction method by using clip unit. In Web-based retrieval system, retrieval method ny using a key word, two dimension browsing method of key frame, and real-time display method of the clip are used. In this paper, we design and implement the system that supports real-time display method of the clip are used. In this paper, we design and implement the system that supports real-time retrieval for video clips on Web environment and provides the multimedia service in stability. The proposed methods show a usefulness of video content providing, and provide an easy method for serching intented video content.

• Proceedings of the Korean Information Science Society Conference
• /
• 2006.06b
• /
• pp.328-330
• /
• 2006

3차원 비디오는 차세대 정보통신 서비스 분야의 핵심 기술로써 사용자에게 양질의 서비스를 제공하기 위한 미래 기술이며, 여러 개의 시점으로 구성되는 다시점 비디오는 고화질의 개념을 뛰어 넘어 더욱 사실감 넘치는 영상을 제공하며 사용자에게 미디어에 대한 실제감과 몰입감을 느끼게 한다. 본 논문에서는 입력 영상인 MP4파일 구조를 분석하고, MPEG을 기반으로 하는 다시점 비디오를 구현하는 방법을 제안한다.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.44 no.1
• /
• pp.80-93
• /
• 2007

This paper suggests structures of the Object Descriptor and the Elementary Stream Descriptor that provide multi-view video services in 3-Dimensional Audio Video technical standards of current MPEG-4. First, it defines that the structures of the Object Descriptor and the Elementary Stream Descriptor on established MPEG-4 system, then distributes individually, and analyzes that. But extension of established system is inappropriate for providing multi-view audio video services connected transmissions and receptions. And, this paper suggests a structure of new Object Descriptor able to switch viewpoints that considers the correlation between each viewpoints, when multi-view video is transmitted. By means of that, it is able to switch viewpoints according to a requirement of a user in a multi-view video services, and reduce overheads for transmitting information about necessary viewpoint.

• Journal of KIISE:Computing Practices and Letters
• /
• v.16 no.1
• /
• pp.65-69
• /
• 2010

Moving Picture Expert Group(MPEG) is the organization foundedin 1998 to establish the standards for compressing and expressing the multimedia contents. The organization has established the technological standards such as MPEG-1, MPEG-2, MPEG-4 and MPEG-7. As the 3D video related standards, there is Multiview Profile which is included in the MPEG-2 video of 1996. However, as the MPEG-2 multiview profile is the standard for compressing the videos from two viewpoints on the object, it is not enough to meet the requirement of multiviewvideo technology. In addition, it does not have the technology on the viewpoint switching that it does not provide the services such as the user interaction. This paper proposes the structure in which the specific viewpoint can be described for video switching in addition to the current MPEG-4 system.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.28 no.6
• /
• pp.637-643
• /
• 2010

In this study, we developed a Portable Multi-sensor System, which consists of a video camera, a GPS/MEMS IMU and a UMPC to acquire video images and position/attitude data. We performed image georeferencing based on the bundle adjustment without ground control points using the acquired data and then evaluated the effectiveness of our system through the accuracy verification. The experimental results showed that the RMSE of relative coordinates on the ground point coordinates obtained from our system was several centimeters. Our system can be efficiently utilized to obtain the 3D model of object and their relative coordinates. In future, we plan to improve the accuracy of absolute coordinates through the rigorous calibration of the system and camera.