• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.16 no.3
• /
• pp.407-415
• /
• 2012

In this paper, we propose a new stereo matching algorithm by using color information especially for stereo images containing human beings in the applications such as tele-presence system. In the proposed algorithm, we first remove the background regions by using a threshold value for stereo images obtained by stereo camera and then find an initial disparity map and segment a given image into R, G, B and white color components. We also obtain edges in the segmented image and estimate the disparity from the extract boundary regions. Finally, we generate the final disparity map by properly combining the disparity map of each color component. Experiment results show better performance compared with the window based method and the dynamic programing method especially for stereo images with human being.

• Journal of Broadcast Engineering
• /
• v.20 no.4
• /
• pp.545-556
• /
• 2015

A HEVC-compatible 3D video coding method (3D-HEVC) has been recently developed as an extension of the high efficiency video coding (HEVC) standard. In order to efficiently deal with the multi-view video plus depth (MVD) format, 3D-HEVC exploits an inter-component prediction which allows the prediction between texture and depth map images in addition to a temporal prediction used in the conventional single layer video coding such as H.264/AVC and HEVC. The performance of the inter-component prediction is normally affected by the accuracy of the disparity vector, and thus it is important to have an accurate disparity vector used for the inter-component prediction. This paper, therefore, introduces a disparity derivation method and inter-component algorithms using the disparity vector for the efficient 3D video coding. Simulation results show that the 3D-HEVC provides higher coding performance compared with the simulcast approach using HEVC and the simple multi-view extension (MH-HEVC).

• Journal of the Institute of Electronics and Information Engineers
• /
• v.53 no.3
• /
• pp.107-113
• /
• 2016

Visual discomfort is a common problem in three-dimensional videos. Among the methods to overcome visual discomfort presented in current research, disparity adjustment methods provide little guidance in determining the condition for disparity control. We propose a diaprity adjustment based on the characteristics of disparity distribution on visual comfort, where the visual comfort level is used as the adjustment paramter, in parallax barrier type auto-stereoscopic 3D display. In this paper, we use the horizontal image shift method for disparity adjustment to enhance visual comfort. The speeded-up robust feature is used to estimate the disparity distribution of 3D sequences, and the required amount for disparity control is chosen based on the pre-defined characteristics of disparity distribution on visual comfort. To evaluate the performance of the proposed method, we used a 3D equipment. Subjective tests were conducted at the fixed optimal viewing distance. The results show that comfortable videos were generated based on the proposed disparity adjustment method.

• Journal of Broadcast Engineering
• /
• v.18 no.3
• /
• pp.463-473
• /
• 2013

In this paper, we propose a super-resolution (SR) image reconstruction algorithm using multi-view images. We acquire 25 images from multi-view cameras, which consist of a $5{\times}5$ array of cameras, and then reconstruct an SR image of the center image using a low resolution (LR) input image and the other 24 LR reference images. First, we estimate disparity maps from the input image to the 24 reference images, respectively. Then, we interpolate a SR image by employing the LR image and matching points in the reference images. Finally, we refine the SR image using an iterative regularization scheme. Experimental results demonstrate that the proposed algorithm provides higher quality SR images than conventional algorithms.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.49 no.12
• /
• pp.659-666
• /
• 2000

A stereo matching has been an important tool for reconstructing three dimensional terrain. By using stereo matching technique, DEM(Digital Elevaton Map) can be generated by the disparity from a reference image to a target image. Generally disparity map can be evaluated by matching the reference image to the target image and if the role of the reference and the target are interchanged, a different DEM can be obtained. In this paper, we propose a new fusion technique to estimate the optimal DEM by eliminating the false DEM due to occlusion. To detect the false DEM, we utilize two measure of accuracy: self-consistency and cross-correlation score. We test the effectiveness of the proposed methods with a quantitative analysis using simulated images. Experimental result indicate that the proposed methods show 24.4% and 33.1% improvement over either DEM.

• 한국정보디스플레이학회:학술대회논문집
• /
• 2009.10a
• /
• pp.1022-1024
• /
• 2009

Stereoscopic Images provide depth information with the relative distances between the objects in the images. There are many different ways to extract disparity maps from the visible spectral images. For the infrared spectral range, the same approach cannot be utilized for the innate low resolution and colorless features because typical methods require corresponding features between the images. The authors suggest a new approach that makes use of image segmentation to obtain depth information for stereoscopic millimeter-wave images. For image segmentation a selective visual attention model based on the theory of a feature-integration of attention is used. Experimental results show the proposed method provides reasonable depth information for object shape recognition and display.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• fall
• /
• pp.41-44
• /
• 2021

In this paper, we propose an efficient reference-based compression artifact reduction network for 360-degree images in an equi-rectangular projection (ERP) domain. In our insight, conventional image restoration methods cannot be applied straightforwardly to 360-degree images due to the spherical distortion. To address this problem, we propose an adaptive disparity estimator using a deformable convolution to exploit correlation among 360-degree images. With the help of the proposed convolution, the disparity estimator establishes the spatial correspondence successfully between the ERPs and extract matched textures to be used for image restoration. The experimental results demonstrate that the proposed algorithm provides reliable high-quality textures from the reference and improves the quality of the restored image as compared to the state-of-the-art single image restoration methods.

• 한국정보디스플레이학회:학술대회논문집
• /
• 2005.07b
• /
• pp.1615-1618
• /
• 2005

In this paper, implementation of object-based multiview 3D display using object segmentation and adaptive disparity estimation is proposed and its performance is analyzed by comparison to that of the conventional disparity estimation algorithms. In the proposed algorithm, firstly we can get segmented objects by region growing from input stereoscopic image pair and then, in order to effectively synthesize the intermediate view the matching window size is selected according to the extracted feature value of the input stereo image pair. Also, the matching window size for the intermediate view reconstruction (IVR) is adaptively selected in accordance with the magnitude of the extracted feature value from the input stereo image pair. In addition, some experimental results on the IVR using the proposed algorithm is also discussed and compared with that of the conventional algorithms.

• Journal of Ocean Engineering and Technology
• /
• v.35 no.3
• /
• pp.183-190
• /
• 2021

Tomographic particle image velocimetry (PIV) is a widely used method that measures a three-dimensional (3D) flow field by reconstructing camera images into voxel images. In 3D measurements, the setting and calibration of the camera's mapping function significantly impact the obtained results. In this study, a camera self-calibration technique is applied to tomographic PIV to reduce the occurrence of errors arising from such functions. The measured 3D particles are superimposed on the image to create a disparity map. Camera self-calibration is performed by reflecting the error of the disparity map to the center value of the particles. Vortex ring synthetic images are generated and the developed algorithm is applied. The optimal result is obtained by applying self-calibration once when the center error is less than 1 pixel and by applying self-calibration 2-3 times when it was more than 1 pixel; the maximum recovery ratio is 96%. Further self-correlation did not improve the results. The algorithm is evaluated by performing an actual rotational flow experiment, and the optimal result was obtained when self-calibration was applied once, as shown in the virtual image result. Therefore, the developed algorithm is expected to be utilized for the performance improvement of 3D flow measurements.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.49 no.3
• /
• pp.51-59
• /
• 2012

This paper suggests an efficient method which tracks articulated human body modeled with markov network using disparity map derived from stereo images. The conventional methods which only use color information to calculate likelihood for energy function tend to fail when background has same colors with objects or appearances of object are changed during the movement. In this paper, we present a method evaluating likelihood with both disparity information and color information to find human body parts. Since the human body part are cylinder projected to rectangles in 2D image plane, we use the properties of distribution of disparity of those rectangles that do not have discontinuous distribution. In addition to that we suggest a conditional-messages-update that is able to reduce unnecessary message update of belief propagation. Since the message update has comprised over 80% of the whole computation in belief propagation, the conditional-message-update yields 9~45% of improvements of computational time. Furthermore, we also propose an another speed up method called three dimensional dynamic models assumed the body motion is continuous. The experiment results show that the proposed method reduces the computational time as well as it increases tracking accuracy.