• Title/Summary/Keyword: stereo-camera

Search Result 610, Processing Time 0.021 seconds

Depth Estimation Through the Projection of Rotating Mirror Image unto Mono-camera (회전 평면경 영상의 단일 카메라 투영에 의한 거리 측정)

  • Kim, Hyeong-Seok;Song, Jae-Hong;Han, Hu-Seok
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.7 no.9
    • /
    • pp.790-797
    • /
    • 2001
  • A simple computer vision technology to measure the middle-ranged depth with a mono camera and a plain mirror is proposed. The proposed system is structured with the rotating mirror in front of the fixed mono camera. In contrast to the previous stereo vision system in which the disparity of the closer object is larger than that of the distant object, the pixel movement caused by the rotating mirror is bigger for the pixels of the distant object in the proposed system. Being inspired by such distinguished feature in the proposed system, the principle of the depth measurement based on the relation of the pixel movement and the distance of object is investigated. Also, the factors to influence the precision of the measurement are analysed. The benefits of the proposed system are low price and less chance of occlusion. The robustness for practical usage is an additional benefit of the proposed vision system.

  • PDF

Opto-Digital Implementation of Convergence-Controlled Stereo Target Tracking System (주시각이 제어된 스테레오 물체추적 시스템의 광-디지털적 구현)

  • 고정환;이재수;김은수
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.27 no.4B
    • /
    • pp.353-364
    • /
    • 2002
  • In this paper, a new onto-digital stereo object-tracking system using hierarchical digital algorithms and optical BPEJTC is proposed. This proposed system can adaptively track a moving target by controlling the convergence of stereo camera. firstly, the target is detected through the background matching of the sequential input images by using optical BPEJTC and then the target area is segmented by using the target projection mask which is composed by hierarchical digital processing of image subtraction, logical operation and morphological filtering. Secondly, the location's coordinate of the moving target object for each of the sequential input frames can be extracted through carrying out optical BPEJTC between the reference image of the target region mask and the stereo input image. Finally, the convergence and pan/tilt of stereo camera can be sequentially controlled by using these target coordinate values and the target can be kept in tracking. Also, a possibility of real-time implementation of the adaptive stereo object tracking system is suggested through optically implementing the proposed target extraction and convergence control algorithms.

A Speaker Detection System based on Stereo Vision and Audio (스테레오 시청각 기반의 화자 검출 시스템)

  • An, Jun-Ho;Hong, Kwang-Seok
    • Journal of Internet Computing and Services
    • /
    • v.11 no.6
    • /
    • pp.21-29
    • /
    • 2010
  • In this paper, we propose the system which detects the speaker, who is speaking currently, among a number of users. A proposed speaker detection system based on stereo vision and audio is mainly composed of the followings: a position estimation of speaker candidates using stereo camara and microphone, a current speaker detection, and a speaker information acquisition based on a mobile device. We use the haar-like features and the adaboost algorithm to detect the faces of speaker candidates with stereo camera, and the position of speaker candidates is estimated by a triangulation method. Next, the Time Delay Of Arrival (TDOA) is estimated by the Cross Power Spectrum Phase (CPSP) analysis to find the direction of source with two microphone. Finally we acquire the information of the speaker including his position, voice, and face by comparing the information of the stereo camera with that of two microphone. Furthermore, the proposed system includes a TCP client/server connection method for mobile service.

A Study of 3D World Reconstruction and Dynamic Object Detection using Stereo Images (스테레오 영상을 활용한 3차원 지도 복원과 동적 물체 검출에 관한 연구)

  • Seo, Bo-Gil;Yoon, Young Ho;Kim, Kyu Young
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.10
    • /
    • pp.326-331
    • /
    • 2019
  • In the real world, there are both dynamic objects and static objects, but an autonomous vehicle or mobile robot cannot distinguish between them, even though a human can distinguish them easily. It is important to distinguish static objects from dynamic objects clearly to perform autonomous driving successfully and stably for an autonomous vehicle or mobile robot. To do this, various sensor systems can be used, like cameras and LiDAR. Stereo camera images are used often for autonomous driving. The stereo camera images can be used in object recognition areas like object segmentation, classification, and tracking, as well as navigation areas like 3D world reconstruction. This study suggests a method to distinguish static/dynamic objects using stereo vision for an online autonomous vehicle and mobile robot. The method was applied to a 3D world map reconstructed from stereo vision for navigation and had 99.81% accuracy.

3 Dimensional Object Reconstruction Using Zoom Camera (줌 카메라를 이용한 3차원 물체 재구성)

  • 주도완;김주영기수용고광식
    • Proceedings of the IEEK Conference
    • /
    • 1998.10a
    • /
    • pp.927-930
    • /
    • 1998
  • This paper presents a new method for reconstructing 3 dimensional object model using a zoom camera. The proposed method uses zoom images to find the distance(D) between camera and object. Also the method uses images obtained around the object to find an $angle(\theta)$ between two connected planes of the object. With the D and $\theta,$ we can reconstruct the real sized 3-D model of object with less errors without stereo camera or rangefinder.

  • PDF

Object Detection and 3D Position Estimation based on Stereo Vision (스테레오 영상 기반의 객체 탐지 및 객체의 3차원 위치 추정)

  • Son, Haengseon;Lee, Seonyoung;Min, Kyoungwon;Seo, Seongjin
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.10 no.4
    • /
    • pp.318-324
    • /
    • 2017
  • We introduced a stereo camera on the aircraft to detect flight objects and to estimate the 3D position of them. The Saliency map algorithm based on PCT was proposed to detect a small object between clouds, and then we processed a stereo matching algorithm to find out the disparity between the left and right camera. In order to extract accurate disparity, cost aggregation region was used as a variable region to adapt to detection object. In this paper, we use the detection result as the cost aggregation region. In order to extract more precise disparity, sub-pixel interpolation is used to extract float type-disparity at sub-pixel level. We also proposed a method to estimate the spatial position of an object by using camera parameters. It is expected that it can be applied to image - based object detection and collision avoidance system of autonomous aircraft in the future.

Implementation of an intelligent vision system for an adaptive path-planning of industrial AGV system (산업용 AGV 시스템의 적응적 경로설정을 위한 지능형 시각 시스템의 구현)

  • Ko, Jung-Hwan
    • 전자공학회논문지 IE
    • /
    • v.46 no.1
    • /
    • pp.23-30
    • /
    • 2009
  • In this paper, the intelligent vision system for an effective and intelligent path-planning of an industrial AGV system based on stereo camera system is proposed. The depth information and disparity map are detected in the inputting images of a parallel stereo camera. The distance between the industrial AGV system and the obstacle detected and the 2D Path coordinates obtained from the location coordinates, and then the relative distance between the obstacle and the other objects obtained from them. The industrial AGV system move automatically by effective and intelligent path-planning using the obtained 2D path coordinates. From some experiments on AGV system driving with the stereo images, it is analyzed that error ratio between the calculated and measured values of the distance between the objects is found to be very low value of 2.5% on average, respectably.

Occluded Object Motion Tracking Method based on Combination of 3D Reconstruction and Optical Flow Estimation (3차원 재구성과 추정된 옵티컬 플로우 기반 가려진 객체 움직임 추적방법)

  • Park, Jun-Heong;Park, Seung-Min;Sim, Kwee-Bo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.21 no.5
    • /
    • pp.537-542
    • /
    • 2011
  • A mirror neuron is a neuron fires both when an animal acts and when the animal observes the same action performed by another. We propose a method of 3D reconstruction for occluded object motion tracking like Mirror Neuron System to fire in hidden condition. For modeling system that intention recognition through fire effect like Mirror Neuron System, we calculate depth information using stereo image from a stereo camera and reconstruct three dimension data. Movement direction of object is estimated by optical flow with three-dimensional image data created by three dimension reconstruction. For three dimension reconstruction that enables tracing occluded part, first, picture data was get by stereo camera. Result of optical flow is made be robust to noise by the kalman filter estimation algorithm. Image data is saved as history from reconstructed three dimension image through motion tracking of object. When whole or some part of object is disappeared form stereo camera by other objects, it is restored to bring image date form history of saved past image and track motion of object.

An Accurate Moving Distance Measurement Using the Rear-View Images in Parking Assistant Systems (후방영상 기반 주차 보조 시스템에서 정밀 이동거리 추출 기법)

  • Kim, Ho-Young;Lee, Seong-Won
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37C no.12
    • /
    • pp.1271-1280
    • /
    • 2012
  • In the recent parking assistant systems, finding out the distance to the object behind a car is often performed by the range sensors such as ultrasonic sensors, radars. However, the installation of additional sensors on the used vehicle could be difficult and require extra cost. On the other hand, the motion stereo technique that extracts distance information using only an image sensor was also proposed. However, In the stereo rectification step, the motion stereo requires good features and exacts matching result. In this paper, we propose a fast algorithm that extracts the accurate distance information for the parallel parking situation using the consecutive images that is acquired by a rear-view camera. The proposed algorithm uses the quadrangle transform of the image, the horizontal line integral projection, and the blocking-based correlation measurement. In the experiment with the magna parallel test sequence, the result shows that the line-accurate distance measurement with the image sequence from the rear-view camera is possible.

Robust Stereo Matching under Radiometric Change based on Weighted Local Descriptor (광량 변화에 강건한 가중치 국부 기술자 기반의 스테레오 정합)

  • Koo, Jamin;Kim, Yong-Ho;Lee, Sangkeun
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.52 no.4
    • /
    • pp.164-174
    • /
    • 2015
  • In a real scenario, radiometric change has frequently occurred in the stereo image acquisition process using multiple cameras with geometric characteristics or moving a single camera because it has different camera parameters and illumination change. Conventional stereo matching algorithms have a difficulty in finding correct corresponding points because it is assumed that corresponding pixels have similar color values. In this paper, we present a new method based on the local descriptor reflecting intensity, gradient and texture information. Furthermore, an adaptive weight for local descriptor based on the entropy is applied to estimate correct corresponding points under radiometric variation. The proposed method is tested on Middlebury datasets with radiometric changes, and compared with state-of-the-art algorithms. Experimental result shows that the proposed scheme outperforms other comparison algorithms around 5% less matching error on average.