• The Journal of the Korea Contents Association
• /
• v.16 no.7
• /
• pp.431-438
• /
• 2016

In this paper, we present an upsampling technique for depth map image using color and depth weights. First, we construct a high-resolution image using the bilinear interpolation technique. Next, we detect a common edge region using RGB color space, HSV color space, and depth image. If an interpolated pixel belongs to the common edge region, we calculate weighting values of color and depth in $3{\times}3$ neighboring pixels and compute the cost value to determine the boundary pixel value. Finally, the pixel value having minimum cost is determined as the pixel value of the high-resolution depth image. Simulation results show that the proposed algorithm achieves good performance in terns of PSNR comparison and subjective visual quality.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.15 no.6
• /
• pp.201-208
• /
• 2015

3D image must have depth image for depth information in order for 3D realistic media broadcasting. We used generally belief propagation algorithm to solve probability model. Belief propagation algorithm is operated by message passing between nodes corresponding to each pixel. The high resolution image will be able to precisely represent but that required much computational complexity for 3D representation. We proposed fast stereo matching algorithm using belief propagation with multi-resolution based wavelet or lifting. This method can be shown efficiently computational time at much iterations for accurate disparity map.

• Journal of Broadcast Engineering
• /
• v.19 no.3
• /
• pp.362-371
• /
• 2014

Blur variation caused by camera de-focusing provides a proper cue for depth estimation. Depth from Defocus (DFD) technique calculates the blur amount present in an image considering that blur amount is directly related to scene depth. Conventional DFD methods use two defocused images that might yield the low quality of an estimated depth map as well as a reconstructed infocused image. To solve this, a new DFD methodology based on infocused and defocused images is proposed in this paper. In the proposed method, the outcome of Subbaro's DFD is combined with a novel edge blur estimation method so that improved blur estimation can be achieved. In addition, a saliency map mitigates the ill-posed problem of blur estimation in the region with low intensity variation. For validating the feasibility of the proposed method, twenty image sets of infocused and defocused images with 2K FHD resolution were acquired from a camera with a focus control in the experiments. 3D stereoscopic image generated by an estimated depth map and an input infocused image could deliver the satisfactory 3D perception in terms of spatial depth perception of scene objects.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.16 no.6
• /
• pp.1311-1316
• /
• 2021

In this paper, we present a bifocal stereo camera system combining two cameras with different focal length cameras to generate stereoscopic image and their corresponding depth map. In order to obtain the depth data using the bifocal stereo camera system, we perform camera calibration to extract internal and external camera parameters for each camera. We calculate a common image plane and perform a image rectification for generating the depth map using camera parameters of bifocal stereo camera. Finally we use a SGM(Semi-global matching) algorithm to generate the depth map in this paper. The proposed bifocal stereo camera system can performs not only their own functions but also generates distance information about vehicles, pedestrians, and obstacles in the current driving environment. This made it possible to design safer autonomous vehicles.

• Journal of the Semiconductor & Display Technology
• /
• v.10 no.3
• /
• pp.99-103
• /
• 2011

The stereoscopic vision system is the algorithm to obtain the depth of target object of stereo vision image. This paper presents an efficient disparity matching method using blue edge filter and graph cut algorithm. We do recommend the use of the simple sobel edge operator. The application of B band sobel edge operator over image demonstrates result with somewhat noisy (distinct border). The basic technique is to construct a specialized graph for the energy function to be minimized such that the minimum cut on the graph also minimizes the energy (either globally or locally). This method has the advantage of saving a lot of data. We propose a preprocessing effective stereo matching method based on sobel algorithm which uses blue edge information and the graph cut, we could obtain effective depth map.

• Journal of Broadcast Engineering
• /
• v.9 no.3
• /
• pp.185-195
• /
• 2004

This paper presents a multi-depth map fusion method for the 3D scene reconstruction. It fuses depth maps obtained from the stereo matching technique and the depth camera. Traditional stereo matching techniques that estimate disparities between two images often produce inaccurate depth map because of occlusion and homogeneous area. Depth map obtained from the depth camera is globally accurate but noisy and provide a limited depth range. In order to get better depth estimates than these two conventional techniques, we propose a depth map fusion method that fuses the multi-depth maps from stereo matching and the depth camera. We first obtain two depth maps generated from the stereo matching of 3-view images. Moreover, a depth map is obtained from the depth camera for the center-view image. After preprocessing each depth map, we select a depth value for each pixel among them. Simulation results showed a few improvements in some background legions by proposed fusion technique.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.20 no.2
• /
• pp.375-384
• /
• 2016

In this paper, when stereo image, satellite view and corresponding depth maps were used as the input data, we propose a new method that convert these data to data format suitable for compressing, and then by using these format, intermediate view is synthesized. In the transmitter depth maps are merged to a global depth map and satellite view are converted to residual image corresponding hole region as out of frame area and occlusion region. And these images subsampled to reduce a mount of data and stereo image of main view are encoded by HEVC codec and transmitted. In the receiver intermediate views between stereo image and between stereo image and bit-rate are synthesized using decoded global depth map, residual images and stereo image. Through experiments, we confirm good quality of intermediate views synthesized by proposed format subjectively and objectively in comparison to intermediate views synthesized by MVD format versus total bit-rate.

• Proceedings of the IEEK Conference
• /
• 2006.06a
• /
• pp.317-318
• /
• 2006

There are lot of noises and errors in depth map image which is gotten by using a stereo camera. These errors are caused by mismatching of the corresponding points which occur in texture-less region of input images of stereo camera or occlusions. In this paper, we use a method which is able to get rid of the noises through post processing and reduce the errors of disparity values which are caused by the mismatching in the texture-less region of input images through the correlation between the depth map images and the input images. Then we propose a novel method which segments the object by using the improved disparity map images and projections.

• Smart Media Journal
• /
• v.2 no.4
• /
• pp.60-65
• /
• 2013

In this paper, we propose a high-resolution disparity map generation method using a low-resolution time-of-flight (TOF) depth camera and color camera. The TOF depth camera is efficient since it measures the range information of objects using the infra-red (IR) signal in real-time. It also quantizes the range information and provides the depth image. However, there are some problems of the TOF depth camera, such as noise and lens distortion. Moreover, the output resolution of the TOF depth camera is too small for 3D applications. Therefore, it is essential to not only reduce the noise and distortion but also enlarge the output resolution of the TOF depth image. Our proposed method generates a depth map for a color image using the TOF camera and the color camera simultaneously. We warp the depth value at each pixel to the color image position. The color image is segmented using the mean-shift segmentation method. We define a cost function that consists of color values and segmented color values. We apply a weighted average filter whose weighting factor is defined by the random walk probability using the defined cost function of the block. Experimental results show that the proposed method generates the depth map efficiently and we can reconstruct good virtual view images.

• Current Optics and Photonics
• /
• v.4 no.6
• /
• pp.545-550
• /
• 2020

We propose a hole-filling method to solve discontinuous depth representation and to reduce the visible seams and cracks that cause the limitation of the viewing angle of the three-dimensional (3D) image in the multilayer type 3D display system. The occlusion and the disocclusion regions between layers, such as the visible seams and cracks, are a major bottleneck of the multilayer type 3D display system to represent a volumetric 3D image by stacking multiple images. As a result, in the reconstructed 3D image, the visible seams and cracks appear as brighter overlapping and undesirable cut-off. In order to resolve the problems above, we applied the depth-fused effect to the sub-depth map generating algorithm and improve the viewing characteristics of the multilayer type 3D display. The experimental demonstrations are also provided to verify the proposed scheme.