• IEIE Transactions on Smart Processing and Computing
• /
• v.2 no.1
• /
• pp.27-35
• /
• 2013

This paper proposes a face tracking algorithm for a viewpoint adaptive multi-view synthesis system. The original scene captured by a depth camera contains a texture image and 8 bit gray-scale depth map. From this original image, multi-view images that correspond to the viewer's position can be synthesized using geometrical transformations, such as rotation and translation. The proposed face tracking technique gives a motion parallax cue by different viewpoints and view angles. In the proposed algorithm, the viewer's dominant face, which is established initially from a camera, can be tracked using the statistical characteristics of face colors and deformable templates. As a result, a motion parallax cue can be provided by detecting the viewer's dominant face area and tracking it, even under a heterogeneous background, and synthesized sequences can be displayed successfully.

• Journal of Broadcast Engineering
• /
• v.22 no.3
• /
• pp.405-408
• /
• 2017

Based on the fact that high similarities exist between viewpoints of multi-view images, MV-HEVC achieves high encoding efficiency by performing conventional temporal direction prediction in a single viewpoint as well as inter-view prediction between viewpoints. In this paper, we propose to integrate SHVC and MVC (Multi-view Video Coding) to implement scalable multi-view video encoder using HEVC as a base layer. According to experimental results, it is verified that the BD-PSNR improvement reaches up to 1.5dB while reducing the BD-Bitrate by around 50~60%.

• Journal of the Optical Society of Korea
• /
• v.19 no.5
• /
• pp.477-486
• /
• 2015

We propose a novel calibration method which can be applied to all kinds of panel-type multi-view displays. We analyze how the angular, the axial, and the lateral misalignment affects the 3D image quality in a panel-type multi-view display. We demonstrate the ray optics simulation with a 3-view slanted parallax barrier system using pentile display for the quantitative calculation. Based on the analysis, we propose a new alignment pattern for all kinds of panel-type multi-view displays. The proposed pattern is sensitive to all of the angular, the axial, and the lateral misalignments. The high spatial frequency images and on and off alignment in the proposed pattern help observers to calibrate the system easily. We theoretically show the generality of the proposed alignment pattern and verify the pattern with image simulations and experiments.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.01a
• /
• pp.446-449
• /
• 2009

In this paper, we present a novel method for reconstructing a super-resolution image using multi-view low-resolution images captured for depth varying scene without requiring complex analysis such as depth estimation and feature matching. The proposed method is based on the iterative back projection technique that is extended to the 3D volume domain (i.e., space + depth), unlike the conventional superresolution methods that handle only 2D translation among captured images.

• IEIE Transactions on Smart Processing and Computing
• /
• v.6 no.3
• /
• pp.175-182
• /
• 2017

In this paper, we present a multi-depth generation method using a time-of-flight (ToF) fusion camera system. Multi-view color cameras in the parallel type and ToF depth sensors are used for 3D scene capturing. Although each ToF depth sensor can measure the depth information of the scene in real-time, it has several problems to overcome. Therefore, after we capture low-resolution depth images by ToF depth sensors, we perform a post-processing to solve the problems. Then, the depth information of the depth sensor is warped to color image positions and used as initial disparity values. In addition, the warped depth data is used to generate a depth-discontinuity map for efficient stereo matching. By applying the stereo matching using belief propagation with the depth-discontinuity map and the initial disparity information, we have obtained more accurate and stable multi-view disparity maps in reduced time.

• Journal of Broadcast Engineering
• /
• v.18 no.6
• /
• pp.859-871
• /
• 2013

In this paper, we propose an algorithm that generates multi-view images by grid-mesh based image domain warping using occlusion mask and various image features obtained from the stereoscopic images. In the proposed algorithm, we first extract image saliency map, line segments and disparity saliency map from stereo images and then get them through a process that improves the quality of extracted features. This process is accomplished in two steps. In the first step, reliability of disparity saliency map on object boundary regions is enhanced by using occlusion information. And in the second step, we enhance the quality of image features in terms of temporal consistency by using temporal consistency information for stereo images. With these enhanced features, multi-view images are generated by grid-mesh based image domain warping technique. Experimental results show that the proposed algorithm performs better than existing algorithms in terms of visual quality.

• KIPS Transactions on Computer and Communication Systems
• /
• v.5 no.9
• /
• pp.237-246
• /
• 2016

DIBR (Depth Image Based Rendering) is a multimedia technology that generates the virtual multi-view images using a color image and a depth image, and it is used for creating glasses-less 3-dimensional display contents. This research describes the effect of depth accuracy about the objective quality of DIBR-based multi-view images. It first evaluated the minimum depth quantization bit that enables the minimum distortion so that people cannot recognize the quality degradation. It then presented the comparative analysis of non-uniform domain-division quantization versus regular linear quantization to find out how effectively express the accuracy of the depth information in same quantization levels according to scene properties.

• Proceedings of the IEEK Conference
• /
• 2007.07a
• /
• pp.203-204
• /
• 2007

In this work, we propose a compression algorithm for depth images, which are obtained from multi-view sequences. The proposed algorithm represents a depth image using a 3-D regular triangular mesh and predictively encodes the mesh vertices using a linear prediction scheme. The prediction errors are encoded with a arithmetic coder. Simulation results demonstrate that the proposed algorithm provides better performances than the JPEG2000 lossless coder.

• Journal of Digital Contents Society
• /
• v.18 no.2
• /
• pp.383-392
• /
• 2017

This paper introduces a real-time 3D model generation system that can process in real time from multi-view image acquisition to image-based 3D model generation. This system describes how to collect, transmit, and manage the HD images input from 18 cameras and explain the background separation and smooth 3D volume model generation process. This paper proposes a new distributed data transmission and reception method for real-time processing of HD images input from 18 cameras. In addition, we describe a codebook-based background separating algorithm and a modified marching cube algorithm using perspective difference interpolation to generate smooth 3D models from multi-view images. The system is currently being built with a throughput rate of 30 frames per second.

• Journal of Industrial Convergence
• /
• v.19 no.6
• /
• pp.49-57
• /
• 2021

Digital Signage and multi-view image system are used as the 4th media to deliver stories and information due to their strong immersion. A content image displayed on large Digital Signage is produced with the use of computer graphics, rather than reality image. That is because the images shot for content making have an extremely limited range of production and their limitation to high resolution, and thereby have difficulty being displayed in a large and wide Digital Signage screen. In case of Screen X and Escape that employ the left and right walls of in the center a movie theater as a screen, images are shot with three cameras for Digital Cinema, and are screened in a cinema with multi-view image system after stitching work is applied. Such realistic images help viewers experience real-life content. This research will be able to display high-resolution images on Digital Signage without quality degradation by using the multi-view image making technique of Screen X and Chroma key technique are showed the high-resolution Digital Signage content making method.