• Title/Summary/Keyword: Stereo cameras

검색결과 209건 처리시간 0.034초

직교식 스테레오 비젼에서의 3차원 좌표 보정 (Calibration of 3D Coordinates in Orthogonal Stereo Vision)

  • 윤희주;서영욱;배정수;차의영
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국해양정보통신학회 2005년도 춘계종합학술대회
    • /
    • pp.504-507
    • /
    • 2005
  • 본 논문에서는 직교식 스테레오 비젼을 이용하여 단일개체에 대한 움직임 추적결과를 3차원 좌표로 생성, 보정하는 기법을 제안한다. 먼저, 직교로 구성된 두 대의 카메라로부터 실시간으로 영상을 획득한 후, 각 영상에 대하여 차영상 기법과 ART2(Adaptive Resonance Theory 2)를 이용하여 움직이는 개체를 추출한다. 다음으로 추출된 정면, 상면 영상의 좌표를 통해 3차원 좌표로 생성할 수 있으나, 원근감 문제 등으로 좌표가 정밀하지 못하다. 그래서 추출된 두 영상의 좌표를 직교식 스테레오 비젼을 이용하여 좌표보정을 한 후 3차원 좌표를 생성한다. 제안된 방법을 통해 단일개체의 움직임에 대한 추적 결과가 3차원 좌표로 정밀하게 추출 되는지 실험을 통하여 검증하였다.

  • PDF

SPAD과 CNN의 특성을 반영한 ToF 센서와 스테레오 카메라 융합 시스템 (Fusion System of Time-of-Flight Sensor and Stereo Cameras Considering Single Photon Avalanche Diode and Convolutional Neural Network)

  • 김동엽;이재민;전세웅
    • 로봇학회논문지
    • /
    • 제13권4호
    • /
    • pp.230-236
    • /
    • 2018
  • 3D depth perception has played an important role in robotics, and many sensory methods have also proposed for it. As a photodetector for 3D sensing, single photon avalanche diode (SPAD) is suggested due to sensitivity and accuracy. We have researched for applying a SPAD chip in our fusion system of time-of-fight (ToF) sensor and stereo camera. Our goal is to upsample of SPAD resolution using RGB stereo camera. Currently, we have 64 x 32 resolution SPAD ToF Sensor, even though there are higher resolution depth sensors such as Kinect V2 and Cube-Eye. This may be a weak point of our system, however we exploit this gap using a transition of idea. A convolution neural network (CNN) is designed to upsample our low resolution depth map using the data of the higher resolution depth as label data. Then, the upsampled depth data using CNN and stereo camera depth data are fused using semi-global matching (SGM) algorithm. We proposed simplified fusion method created for the embedded system.

Post-earthquake building safety evaluation using consumer-grade surveillance cameras

  • Hsu, Ting Y.;Pham, Quang V.;Chao, Wei C.;Yang, Yuan S.
    • Smart Structures and Systems
    • /
    • 제25권5호
    • /
    • pp.531-541
    • /
    • 2020
  • This paper demonstrates the possibility of evaluating the safety of a building right after an earthquake using consumer-grade surveillance cameras installed in the building. Two cameras are used in each story to extract the time history of interstory drift during the earthquake based on camera calibration, stereo triangulation, and image template matching techniques. The interstory drift of several markers on the rigid floor are used to estimate the motion of the geometric center using the least square approach, then the horizontal interstory drift of any location on the floor can be estimated. A shaking table collapse test of a steel building was conducted to verify the proposed approach. The results indicate that the accuracy of the interstory drift measured by the cameras is high enough to estimate the damage state of the building based on the fragility curve of the interstory drift ratio. On the other hand, the interstory drift measured by an accelerometer tends to underestimate the damage state when residual interstory drift occurs because the low frequency content of the displacement signal is eliminated when high-pass filtering is employed for baseline correction.

자율주행 모바일 역진자의 비주얼서보잉에 대한 연구 (A Study on the Visual Servoing of Autonomous Mobile Inverted Pendulum)

  • 이준민;이장명
    • 제어로봇시스템학회논문지
    • /
    • 제19권3호
    • /
    • pp.240-247
    • /
    • 2013
  • This paper proposes an optimal three-dimensional coordinate implementation of the vision sensor using two CCD cameras. The PBVS (Position based visual servoing) is implemented using the positional information obtained from images. Stereo vision by PBVS method that has enhanced every frame using calibration parameters is effective in the distance calculation. The IBVS (Image based visual servoing) is also implemented using the difference between reference and obtained images. Stereo vision by IBVS method calculates the distance using rotation angle of motors that correspond eyes and neck without enhanced images. The PBVS method is compared with the IBVS method in terms of advantages, disadvantages, computing time, and performances. Finally, the IBVS method is applied for the dual arm manipulator on the mobile inverted pendulum. The autonomous mobile inverted pendulum is successfully demonstrated using the center of the manipulator's mass.

스테레오 비젼을 이용한 움직임 검출 (Motion detection using stereo vision)

  • 권창일;원성혁;김민기;이기식;김광택;정일준
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2000년도 하계종합학술대회 논문집(4)
    • /
    • pp.206-209
    • /
    • 2000
  • Almost vision application systems use 2-D information by taking only one camera. Recently it arises to utilize 3-D information, which is distance from camera to object, because 2-D information is not sufficient. Therefore, we take stereo camera system. In motion detection algorithm using stereo vision, it operates like one camera system, which takes advantage of correlation, edge, and difference algorithm, when it detects any motion. At that time, to detect motion, it compares two images, which is from two cameras, to calculate disparity that contains distance information. By disparity, it can compute real distance and size of object information. We describe a motion detection algorithm which computes 3-D distance and object size in real time.

  • PDF

Development of Stereoscopic Display System for Stereo Microscope

  • Kwon, Ki-Chul;Kim, Jung-Hoi;Kim, Nam;Choi, Jae-Kwang
    • 한국정보디스플레이학회:학술대회논문집
    • /
    • 한국정보디스플레이학회 2004년도 Asia Display / IMID 04
    • /
    • pp.425-427
    • /
    • 2004
  • Many of the problems by using the microscope are related to the fact that the eyes of the surgeon must be continually fixed to the microscope eyepieces. In this paper, we describe a development of the stereoscopic monitoring system of the stereo microscope for reduced eyestrain or operator fatigue about the long time observations of the microscope. The system consists of the stereoscopic camera part, the stereoscopic image processor device and the polarized light stereoscopic monitor. The left and right images obtained form the two CCD cameras are the same as the eyepiece images. By use of the image processor, the polarized light stereoscopic monitor displayed a real-time stereo microscope images.

  • PDF

Stereo-PIV/PLIF의 속도장과 농도장 동시측정 기법을 이용한 러쉬톤 교반기내 난류특성에 관한 연구 (A Study on the Turbulent Characteristics of Rushton Turbine Mixer by Simultaneous Measurement of Velocity and Concentration Field with Stereo-PIV/PLIF Technique)

  • 민영욱;김윤기;김경천
    • 대한기계학회:학술대회논문집
    • /
    • 대한기계학회 2003년도 추계학술대회
    • /
    • pp.694-699
    • /
    • 2003
  • Simultaneous measurement with PLIF(Planar Laser-Induced Fluorescence) and Stereo-PIV(Stereoscopic Particle Image Velocimetry) was performed to investigate the structural characteristics of flow field in Rushton Turbine Mixer. Instantaneous 3D velocity fields are measured by two 2K ${\times}$ 2K CCD cameras focused on an object plane with the angular displacement methods while the concentration fields are obtained through the measurement of the fluorescence intensity of Rhodamine B tracer excited by the second pulse of Nd:Yag laser light. Image distortion due to the camera view-angle is compensated by a mapping function. Finally, the spatial structures of turbulent mixing around Rushton turbine were identified by the calculation of cross-correlation fields between the velocity and concentration field.

  • PDF

영역 기반의 SAD 알고리즘과 광 BPEJTC를 이용한 실시간 스테레오 물체 추적 시스템 (Real-Time Stereo Object Tracking System using Area-based SAD Algorithm and Optical BPEJTC)

  • 이재수
    • 한국통신학회논문지
    • /
    • 제25권10B호
    • /
    • pp.1821-1831
    • /
    • 2000
  • 본 논문에서는 스테레오 물체추적 시스템의 새로운 접근 방법으로 영역기반의 정합인 SAD를 사용하여 복잡한 배경 및 전경에서 추적 물체를 인식하여 추출하고, 광 BPEJTC를 사용하여 주시각 및 카메라의 팬/틸트를 제어하는 실시간 스테레오 물체추적 시스템을 제안하였다. 본 논문에서 제안한 스테레오 물체 추적 시스템은 복잡한 배경 및 주위환경 변화에서도 추적 물체를 정확히 추출하여 적응적으로 스테레오 물체 추적이 가능함을 실험을 통해 확인하였으며, 광학적으로 구성함으로써 스테레오 자동 물체 추적기의 실시간적 구현 가능성을 제시하였다.

  • PDF

차선변이 함수 기반의 선행차량 인식 알고리즘 (Stereo Image Processing Algorithm to Preceding Vehicle Detection Based on DLI)

  • 황희정;백광렬;이운근
    • 대한전기학회논문지:시스템및제어부문D
    • /
    • 제53권7호
    • /
    • pp.509-516
    • /
    • 2004
  • This paper proposes an image processing algorithm for detecting obstacles on road using DLI(disparity of lane-related information) that is generated by stereo images acquired from dual cameras mounted on a moving vehicle. The DLI is a disparity that is acquired using a single lane information from road lane detection. For the purpose to reduce processing time, we use small block of edge-histogram based blocking logic. This algorithm detects moving objects such as preceding vehicles and obstacles. The proposed algorithm has been implemented in a personal computer with the road image data of a typical highway. We successfully performed experiments under a wide variety of road conditions without changing parameter values or adding human intervention. Experimental results also showed that the proposed DLI is quite successful.

Target Object Image Extraction from 3D Space using Stereo Cameras

  • Yoo, Chae-Gon;Jung, Chang-Sung;Hwang, Chi-Jung
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2002년도 ITC-CSCC -3
    • /
    • pp.1678-1680
    • /
    • 2002
  • Stereo matching technique is used in many practical fields like satellite image analysis and computer vision. In this paper, we suggest a method to extract a target object image from a complicated background. For example, human face image can be extracted from random background. This method can be applied to computer vision such as security system, dressing simulation by use of extracted human face, 3D modeling, and security system. Many researches about stereo matching have been performed. Conventional approaches can be categorized into area-based and feature-based method. In this paper, we start from area-based method and apply area tracking using scanning window. Coarse depth information is used for area merging process using area searching data. Finally, we produce a target object image.

  • PDF