• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제11권6호
• /
• pp.3208-3229
• /
• 2017

Rectification is an essential procedure for simplifying the disparity extraction of stereo matching algorithms by removing vertical mismatches between left and right images. To support real-time stereo matching, studies have introduced several look-up table (LUT)- and computational logic (CL)-based rectification approaches. However, to support high-resolution images, the LUT-based approach requires considerable memory resources, and the CL-based approach requires numerous hardware resources for its circuit implementation. Thus, this paper proposes a multi-level accumulation-based rectification method as a simple CL-based method and its circuit implementation. The proposed method, which includes distortion correction, reduces addition operations by 29%, and removes multiplication operations by replacing the complex matrix computations and high-degree polynomial calculations of the conventional rectification with simple multi-level accumulations. The proposed rectification circuit can rectify $1,280{\times}720$ stereo images at a frame rate of 135 fps at a clock frequency of 125 MHz. Because the circuit is fully pipelined, it continuously generates a pair of left and right rectified pixels every cycle after 13-cycle latency plus initial image buffering time. Experimental results show that the proposed method requires significantly fewer hardware resources than the conventional method while the differences between the results of the proposed and conventional full rectifications are negligible.

• 한국정보통신학회:학술대회논문집
• /
• 한국해양정보통신학회 2008년도 지능정보 및 응용 학술대회
• /
• pp.73-76
• /
• 2008

본 논문에서는 스테레오 영상의 대응점을 찾기 위한 영역 기반 스테레오 정차 기법을 제안한다. 영역 기반 스테레오 정합의 주된 문제점은 윈도우 크기에 따라 다른 결과를 초래한다는 것이다. 지금까지 대부분의 영역기반 정합 기법은 윈도우의 크기를 반복적으로 갱신하는 방법을 사용하였으나, 이는 초기 시차(disparity)에 매우 민감하며 계산 비용도 많이 든다. 이러한 문제를 해결하기 위해, 본 논문에서는 스테레오 영상의 특징 정보를 이용하여 가중치를 생성하고, 각 영상의 대응점을 탐색하여 정합한다. 먼저, 평행하게 설치된 두 대의 카메라로부터 획득된 영상에 대한 에지를 검출하여 특징점을 추출한다. 이를 이용하여 두 영상간의 상관관계를 구하여 가중치 함수를 생성하고, 각 영상에 대한 가중치를 적용한 후, 기준영상에 대한 대응점을 찾아 정합한다. 제안된 방법의 성능을 평가하기 위하여 ground truth가 존재하는 다양한 스테레오 영상을 이용하여 실험하였으며, 실험결과 다양한 영상에서도 적응적인 가중치를 생성함으로써 향상된 결과를 보였다.

• Journal of Information Processing Systems
• /
• 제13권2호
• /
• pp.256-267
• /
• 2017

An active research area in computer vision, stereo matching is aimed at obtaining three-dimensional (3D) information from a stereo image pair captured by a stereo camera. To extract accurate 3D information, a number of studies have examined stereo matching algorithms that employ adaptive support weight. Among them, the adaptive census transform (ACT) algorithm has yielded a relatively strong matching capability. The drawbacks of the ACT, however, are that it produces low matching accuracy at the border of an object and is vulnerable to noise. To mitigate these drawbacks, this paper proposes and analyzes the features of an improved stereo matching algorithm that not only enhances matching accuracy but also is also robust to noise. The proposed algorithm, based on the ACT, adopts the truncated absolute difference and the multiple sparse windows method. The experimental results show that compared to the ACT, the proposed algorithm reduces the average error rate of depth maps on Middlebury dataset images by as much as 2% and that is has a strong robustness to noise.

• 제어로봇시스템학회논문지
• /
• 제7권6호
• /
• pp.523-531
• /
• 2001

This paper describes and automatic mirror adjustment system that rotates a pair of side mirrors and the room mirror of a car to the optimal position for a driver by using the locating of the driver\`s pupils. A stereo vision system measures 3D coordinates of a pair pupils by analyzing the input images of stereo B/W CCD cameras mounted on the instrument panel. this system determines the position angle of each mir-ror on the basis of information about the location of the pupils and rotates each mirror to the appropriate po-sition by mirror actuators. The vision system can detect the driver\`s pupils regardless of whether it is day-time or nighttime by virtue of an infrared light source. information about the pair of nostrils in used to im- prove the correctness of pupil detection. This system can adjust side mirrors and the room mirror automati- cally and rapidly by a simple interface regardless of driver replacement of driver\`s posture. Experiment has shown this to be a new mirror adjustment system that can make up for the weak points of previous mirror adjustment systems.

• International Journal of Automotive Technology
• /
• 제5권4호
• /
• pp.277-285
• /
• 2004

This paper describes an intelligent mirror adjustment system that rotates a pair of side mirrors and the room mirror of a car to the optimal position for a driver by using the location of the driver's pupils. A stereo vision system measures the three-dimensional coordinates of a pair of pupils by analyzing the input images of stereo B/W CCD cameras mounted on the instrument panel. This system determines the position angle of each mirror on the basis of information about the location of the pupils and rotates each mirror to the appropriate position by mirror actuators. The vision system can detect the driver's pupils regardless of whether it is daytime or nighttime by virtue of an infrared light source. Information about the pair of nostrils is used to improve the correctness of pupil detection. This system can adjust side mirrors and the room mirror automatically and rapidly by a simple interface regardless of driver replacement or driver's posture. Experiment has shown this to be a new mirror adjustment system that can make up for the weak points of previous mirror adjustment systems.

• 대한의용생체공학회:의공학회지
• /
• 제22권6호
• /
• pp.527-534
• /
• 2001

컴퓨터 보조의 3차원 수술지원시스템(CAS. Computer Assisted Surgery)의 3차원 위치검출을 위한 광학식 추적자(Optical Tracker)에서 수술도구에 장착되는 적외선 LED의 좌우 영상을 CCD 카메라로 획득하는 데 있어서 기존의 2개의 프레임그래버를 이용하는 방법을 개선하여 하나의 그래버로 획득하는 방법을 개발하였다 좌우의 영상은 칼라 프레임그래버의 색차신호로 부가되며 이에 관련된 하드웨어 및 검출 알고리즘을 개발하였다 결과적으로 본 연구에서 개발된 방법은 비용이 절감되며 좌우영상의 추출이 빠른 것이 장점이다

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2003년도 학술회의 논문집 정보 및 제어부문 B
• /
• pp.777-780
• /
• 2003

We have tried to create a vision system like human eye for a long time. We have obtained some distinguished results through many studies. Stereo vision is the most similar to human eye among those. This is the process of recreating 3-D spatial information from a pair of 2-D images. In this paper, we have designed a stereo matching algorithm based on systolic array architecture using edges and pixel data. This is more advanced vision system that improves some problems of previous stereo vision systems. This decreases noise and improves matching rate using edges and pixel data and also improves processing speed using high integration one chip FPGA and compact modules. We can apply this to robot vision and automatic control vehicles and artificial satellites.

• 대한원격탐사학회:학술대회논문집
• /
• 대한원격탐사학회 2005년도 Proceedings of ISRS 2005
• /
• pp.683-686
• /
• 2005

This study addresses a photogrammetric approach to generate Mars topographic products from mapping data of Mars Global Surveyor (MGS). High-resolution stereo images and laser altimetry data collected from the MGS mission are combined and processed to produce Digital Elevation Models (DEM) and orthoimages. First, altimeter data is registered to high resolution images and considerable registration offset (around 325 m) is discovered on high resolution stereo images. Altimetry data, exterior orientation elements of the camera and conjugate points are used for bundle adjustment to solve this mis-registration and detennine the ground coordinates. The mis-registration of altimetry data are effectively eliminated after the bundle adjustment. Using the adjusted exterior orientation the ground coordinates of conjugate points are detennined. A sufficient number of corresponding points collected through image matching and their precise 3-D ground coordinates are used to generate DEM and orthoimages. A posteriori standard deviations of ground points after bundle adjustment indicate the accuracy of OEM generated in this study. This paper addresses the photogrammetric procedure: the registration of altimetry data to stereo pair images, the bundle adjustment and the evaluation, and the generation of OEM and orthoimages.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제5권9호
• /
• pp.1613-1631
• /
• 2011

Several metrics have been reported in the literature to assess stereo image quality, mostly based on visual attention or human visual sensitivity based distortion prediction with the help of disparity information, which do not consider the combined aspects of human visual processing. In this paper, visual attention and depth assisted stereo image quality assessment model (VAD-SIQAM) is devised that consists of three main components, i.e., stereo attention predictor (SAP), depth variation (DV), and stereo distortion predictor (SDP). Visual attention is modeled based on entropy and inverse contrast to detect regions or objects of interest/attention. Depth variation is fused into the attention probability to account for the amount of changed depth in distorted stereo images. Finally, the stereo distortion predictor is designed by integrating distortion probability, which is based on low-level human visual system (HVS), responses into actual attention probabilities. The results show that regions of attention are detected among the visually significant distortions in the stereo image pair. Drawbacks of human visual sensitivity based picture quality metrics are alleviated by integrating visual attention and depth information. We also show that positive correlation with ground-truth attention and depth maps are increased by up to 0.949 and 0.936 in terms of the Pearson and the Spearman correlation coefficients, respectively.

• 대한전기학회논문지:시스템및제어부문D
• /
• 제49권12호
• /
• pp.651-658
• /
• 2000

This paper presents a new method to extract traffic information such as number of passing vehicles and average speed by a pair of stereo road images. The whole process consists of the extraction of vehicles and the tracking of the extracted vehicles. For the extraction of vehicles, the outline of each vehicle is obtained by using binary region growing technique applied to disparity map based on multi-resolution stereo matching. The Kalman filter tracking algorithm is applied to the extracted vehicle outlines to determine the flow of vehicles. Experimental results show that the proposed method significantly improved recognition rate of vehicles over the conventional methods-frame difference and background elimination methods.