• Journal of Broadcast Engineering
• /
• v.19 no.5
• /
• pp.616-626
• /
• 2014

In this paper, we introduce a real-time stereo-to-multiview conversion system using FPGA and GPU. The system is based on two different devices so that it consists of two major blocks. The first block is a disparity estimation block that is implemented on FPGA. In this block, each disparity map of stereoscopic video is estimated by DP(dynamic programming)-based stereo matching. And then the estimated disparity maps are refined by post-processing. The refined disparity map is transferred to the GPU device through USB 3.0 and PCI-express interfaces. Stereoscopic video is also transferred to the GPU device. These data are used to render arbitrary number of virtual views in next block. In the second block, disparity-based view interpolation is performed to generate virtual multi-view video. As a final step, all generated views have to be re-arranged into a single image at full resolution for presenting on the target autostereoscopic 3D display. All these steps of the second block are performed in parallel on the GPU device.

• Journal of Broadcast Engineering
• /
• v.16 no.4
• /
• pp.596-601
• /
• 2011

In this paper, we propose a fast depth-image-based rendering method to generate a virtual view image in real-time using a graphic processor unit (GPU) for a 3D broadcasting system. Before the transmission, we encode the input 2D+depth video using the H.264 coding standard. At the receiver, we decode the received bitstream and generate a stereo video using a GPU which can compute in parallel. In this paper, we apply a simple and efficient hole filling method to reduce the decoder complexity and reduce hole filling errors. Besides, we design a vertical parallel structure for a forward mapping process to take advantage of the single instruction multiple thread structure of GPU. We also utilize high speed GPU memories to boost the computation speed. As a result, we can generate virtual view images 15 times faster than the case of CPU-based processing.

• Journal of Sensor Science and Technology
• /
• v.19 no.2
• /
• pp.99-111
• /
• 2010

This paper proposes an efficient hardware architecture to estimate disparities between 2D images for generating 3D depth images in a stereo vision system. Stereo matching methods are classified into global and local methods. The local matching method uses the cost functions based on pixel windows such as SAD(sum of absolute difference), SSD(sum of squared difference) and NCC(normalized cross correlation). The NCC-based cost function is less susceptible to differences in noise and lighting condition between left and right images than the subtraction-based functions such as SAD and SSD, and for this reason, the NCC is preferred to the other functions. However, software-based implementations are not adequate for the NCC-based real-time stereo matching, due to its numerous complex operations. Therefore, we propose a fast pipelined hardware architecture suitable for real-time operations of the NCC function. By adopting a block-based box-filtering scheme to perform NCC operations in parallel, the proposed architecture improves processing speed compared with the previous researches. In this architecture, it takes almost the same number of cycles to process all the pixels, irrespective of the window size. Also, the simulation results show that its disparity estimation has low error rate.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.38 no.2
• /
• pp.27-32
• /
• 2001

In this paper, the three dimension scanner system employing the parallel camera model is discussed. The camera calibration process and the three dimension scanning algorithm are developed. The laser strip line is utilized for assisting stereo matching. An object being scanned rotates on the plate which is activated by a stepping motor, The world coordinate which is. the measured distance from the camera to the object is converted into the model coordinate. The facets created from the point. cloud of the model coordinate is used for rendering the scanned model by using the graphic library such as OpenGL. The unmatched points having no validate matching points are interpolated from the validate matching points of the vicinity epipolar lines.

• Journal of the Korean Institute of Telematics and Electronics
• /
• v.22 no.1
• /
• pp.61-67
• /
• 1985

The new computer vision system which can reconstruct contours of parallel fault planes with horizon of 3-D curved objects has been developed. With the system, the shape of 3-D objects was measured by Simple Back-Projection algorithm which is a fundamental one in C.T.(Computed Tomography). And, the curvature in differential geometry characterizes any curve. Devising it, the method to represent each contour of 3-D curved objects with the system is described in this paper.

• Proceedings of the KSRS Conference
• /
• 2004.10a
• /
• pp.652-655
• /
• 2004

The geometry of satellite image captured by linear pushbroom scanner is different from that of frame camera image. Since the exterior orientation parameters for satellite image will vary scan line by scan line, the epipolar geometry of satellite image differs from that of frame camera image. As we know, 2D affine orientation for the epipolar image of linear pushbroom scanners system are well-established by using the collinearity equation (Testsu Ono, 1999). Also, another epipolar geometry of linear pushbroom scanner system is recently established by Habib(2002). He reported that the epipolar geometry of linear push broom satellite image is realized by parallel projection based on 2D affine models. Here, in this paper, we compared the Ono's method with Habib's method. In addition, we proposed a method that generates epipolar resampled images. For the experiment, IKONOS stereo images were used in generating epipolar images.

• Proceedings of the KIEE Conference
• /
• 2009.07a
• /
• pp.1915_1916
• /
• 2009

스테레오 X-선 영상시스템 개발을 위하여 수치적 프로젝션을 획득하는 방법론 및 수치적 팬텀 영상을 고안하고 시험하였다. 오픈소스인 TAKE21을 사용하여 수치적 팬텀을 설계하고 그로부터 프로젝션 이미지를 획득하였다. 스테레오 영상을 위한 평행 원근 투영(Parallel-Perspective) 기하구조에 대한 스테레오 프로젝션 영상을 얻기 위해서 계측기의 계와 선원의 위치에 대해 동차 좌표계(Homogeneous coordinate)에서의 선형변환(Linear Transform)을 적용되는 방식을 이용하였다. 이러한 시뮬레이션은 스테레오 X-선 검색 장치의 설계 및 알고리즘 개발에 유용하게 사용될 수 있을 것이다.

• Journal of the Korean Society of Visualization
• /
• v.2 no.1
• /
• pp.32-38
• /
• 2004

A new PIV technique was developed for decreasing optical error which was created during simultaneous measurements of velocity fields at a wall-normal plane and wall-parallel plane by a plane PIV and a Stereo-PIV systems. For experimental study, two different Reynolds number based on momentum thickness, Re$_{ =514 and 934 were generated in a blowing type wind tunnel under the condition of zero pressure gradient. The two Nd:Yag laser systems and three CCD cameras were synchronized. to obtain instantaneous velocity fields at the same time. To avoid optical noise at the crossing line by the two laser light sheets, a new optical arrangement using polarization was applied. The obtained velocity fields show the existence of hairpin packet structure vividly and the idealized hairpin vortex signature is confirmed by experiment.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.33B no.7
• /
• pp.127-137
• /
• 1996

The 3-dimensional measurement using stereo vision system must achieve a camera calibration. So far, the 3-dimensional calibration technique that uses two-dimensional grid papar and a non-linear least square method has been developed and tested. But, this method is inefficient because it has many calculation procedure and a non-linear analysis. Therefore, this paper proposed the projective geometric method which produced the calibration parameter by vanishing point. The vanishing point is producted by a cross ratio and a parallel line pairs. The results of the computer simulation show utility of the proposed method.

• Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
• /
• 2005.07a
• /
• pp.605-606
• /
• 2005

Depth error correction effect for maladjusted stereo cameras with calibrated pixel distance parameter is presented. Intra and extra parameters should be obtain to determine the relation between image and world coordination through experiment. One difficulty is in camera alignment for parallel installation: placing two CCD arrays in a plane. If the pixel distance parameter which is one of intra parameter is calibrated with known points, such error can be compensated in some amount. Such error compensation effect with the calibrated pixel distance parameter is demonstrated with various experimental results.