• Title/Summary/Keyword: area-based stereo

Search Result 146, Processing Time 0.027 seconds

Stereo Object Tracking and Multiview image Reconstruction System Using Disparity Motion Vector (시차 움직임 벡터에 기반한 스데레오 물체추적 및 다시점 영상복원 시스템)

  • Ko Jung-Hwan;Kim Eun-Soo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.31 no.2C
    • /
    • pp.166-174
    • /
    • 2006
  • In this paper, a new stereo object tracking system using the disparity motion vector is proposed. In the proposed method, the time-sequential disparity motion vector can be estimated from the disparity vectors which are extracted from the sequence of the stereo input image pair and then using these disparity motion vectors, the area where the target object is located and its location coordinate are detected from the input stereo image. Being based on this location data of the target object, the pan/tilt embedded in the stereo camera system can be controlled and as a result, stereo tracking of the target object can be possible. From some experiments with the 2 frames of the stereo image pairs having 256$\times$256 pixels, it is shown that the proposed stereo tracking system can adaptively track the target object with a low error ratio of about 3.05$\%$ on average between the detected and actual location coordinates of the target object.

Post-processing Method of Point Cloud Extracted Based on Image Matching for Unmanned Aerial Vehicle Image (무인항공기 영상을 위한 영상 매칭 기반 생성 포인트 클라우드의 후처리 방안 연구)

  • Rhee, Sooahm;Kim, Han-gyeol;Kim, Taejung
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_1
    • /
    • pp.1025-1034
    • /
    • 2022
  • In this paper, we propose a post-processing method through interpolation of hole regions that occur when extracting point clouds. When image matching is performed on stereo image data, holes occur due to occlusion and building façade area. This area may become an obstacle to the creation of additional products based on the point cloud in the future, so an effective processing technique is required. First, an initial point cloud is extracted based on the disparity map generated by applying stereo image matching. We transform the point cloud into a grid. Then a hole area is extracted due to occlusion and building façade area. By repeating the process of creating Triangulated Irregular Network (TIN) triangle in the hall area and processing the inner value of the triangle as the minimum height value of the area, it is possible to perform interpolation without awkwardness between the building and the ground surface around the building. A new point cloud is created by adding the location information corresponding to the interpolated area from the grid data as a point. To minimize the addition of unnecessary points during the interpolation process, the interpolated data to an area outside the initial point cloud area was not processed. The RGB brightness value applied to the interpolated point cloud was processed by setting the image with the closest pixel distance to the shooting center among the stereo images used for matching. It was confirmed that the shielded area generated after generating the point cloud of the target area was effectively processed through the proposed technique.

Stereo Camera-based Target Surveillance-Tracking System through an adaptive Pan/tilt Control (적응적인 스테레오 카메라 기반의 팬/틸트 제어를 통한 표적 감시-추적 시스템)

  • Cho, Do-Hyeoun;Ko, Jung-Hwan;Won, Young-Jin
    • Proceedings of the IEEK Conference
    • /
    • 2005.11a
    • /
    • pp.1269-1272
    • /
    • 2005
  • In this paper, a new intelligent moving target tracking and surveillance system basing on the pan/tilt-embedded stereo camera system is suggested and implemented. In the proposed system, once the face area of a target is detected from the input stereo image by using a YCbCr color model and then, using this data as well as the geometric information of the tracking system, the distance and 3D information of the target are effectively extracted in real-time.

  • PDF

Visibility Sensor with Stereo Infrared Light Sources for Mobile Robot Motion Estimation (주행 로봇 움직임 추정용 스테레오 적외선 조명 기반 Visibility 센서)

  • Lee, Min-Young;Lee, Soo-Yong
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.17 no.2
    • /
    • pp.108-115
    • /
    • 2011
  • This paper describes a new sensor system for mobile robot motion estimation using stereo infrared light sources and a camera. Visibility is being applied to robotic obstacle avoidance path planning and localization. Using simple visibility computation, the environment is partitioned into many visibility sectors. Based on the recognized edges, the sector a robot belongs to is identified and this greatly reduces the search area for localization. Geometric modeling of the vision system enables the estimation of the characteristic pixel position with respect to the robot movement. Finite difference analysis is used for incremental movement and the error sources are investigated. With two characteristic points in the image such as vertices, the robot position and orientation are successfully estimated.

A Study on Fast Stereo Matching Algorithm using Belief Propagation in Multi-resolution Domain (다해상도 영역에서 신뢰확산 알고리즘을 사용한 고속의 스테레오 정합 알고리즘에 관한 연구)

  • Jang, SunBong;Jee, Innho
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.8 no.4
    • /
    • pp.67-73
    • /
    • 2008
  • In the Markov network which models disparity map with the Markov Random Field(MRF), the belief propagation algorithm is operated by message passing between nodes corresponding to each pixels. Belief propagation algorithm required much iteration for accurate result. In this paper, we propose the stereo matching algorithm using belief propagation in multi-resolution domain. Multi-resolution method based on wavelet or lifting can reduce the search area, therefore this algorithm can generate disparity map with fast speed.

  • PDF

Digital Elevation Model Extraction Using KOMPSAT Images

  • Im, Hyung-Deuk;Ye, Chul-Soo;Lee, Kwae-Hi
    • Korean Journal of Remote Sensing
    • /
    • v.16 no.4
    • /
    • pp.347-353
    • /
    • 2000
  • The purpose of this paper is to extract DEM (Digital Elevation Model) using KOMPSAT images. DEM extraction consists of three parts. First part is the modeling of satellite position and attitude, second part is the matching of two images to find corresponding points of them and third part is to calculate the elevation of each point by using the result of the first and second part. The position and attitude modeling of satellite is processed by using GCPs. Area based matching method is used to find the corresponding points between the stereo satellite images. The elevation of each point is calculated using the exterior orientation information obtained from sensor modeling and the disparity from the stereo matching. In experiment, the KOMPSAT images, 2592$\times$2796 panchromatic images are used to extract DEM. The experiment result show the DEM using KOMPSAT images.

DTM GENERATION OF RADARSAT AND SPOT SATELLITE IMAGERY USING GROUND CONTROL POINTS EXTRACTED FROM SAR IMAGE

  • PARK DOO-YOUL;KIM JIN-KWANG;LEE HO-NAM;WON JOONG-SUN
    • Proceedings of the KSRS Conference
    • /
    • 2005.10a
    • /
    • pp.667-670
    • /
    • 2005
  • Ground control points(GCPs) can be extracted from SAR data given precise orbit for DTM generation using optic images and other SAR data. In this study, we extract GCPs from ERS SAR data and SRTM DEM. Although it is very difficult to identify GCPs in ERS SAR image, the geometry of optic image and other SAR data are able to be corrected and more precise DTM can be constructed from stereo optic images. Twenty GCPs were obtained from the ERS SAR data with precise Delft orbit information. After the correction was applied, the mean values of planimetric distance errors of the GCPs were 3.7m, 12.1 and -0.8m with standard deviations of 19.9m, 18.1, and 7.8m in geocentric X, Y, and Z coordinates, respectively. The geometries of SPOT stereo pair were corrected by 13 GCPs, and r.m.s. errors were 405m, 705m and 8.6m in northing, easting and height direction, respectively. And the geometries of RADARS AT stereo pair were corrected by 12 GCPs, and r.m.s. errors were 804m, 7.9m and 6.9m in northing, easting and height direction, respectively. DTMs, through a method of area based matching with pyramid images, were generated by SPOT stereo images and RADARS AT stereo images. Comparison between points of the obtained DTMs and points estimated from a national 1 :5,000 digital map was performed. For DTM by SPOT stereo images, the mean values of distance errors in northing, easting and height direction were respectively -7.6m, 9.6m and -3.1m with standard deviations of 9.1m, 12.0m and 9.1m. For DTM by RADARSAT stereo images, the mean values of distance errors in northing, easting and height direction were respectively -7.6m, 9.6m and -3.1m with standard deviations of 9.1m, 12.0m and 9.1m. These results met the accuracy of DTED level 2

  • PDF

A Study on the 3-Dimensional Implementation of Computer-Aid Management of Stereo Images (입체 화상의 3차원 전산모사기 구현에 관한 연구)

  • Lee, Joong;Yoon, Do-Young
    • Korean Chemical Engineering Research
    • /
    • v.47 no.2
    • /
    • pp.179-184
    • /
    • 2009
  • Recent evolution of computer technology enhances the effectiveness of CFD(Computational Fluid Dynamics) analysis for the 3-dimensional complex transport phenomena including turbulent flows. Cheaper and easier than laser and ultra-sonic methods, the windows simulator name by CAMSI(Computer-Aided Management of Stereo Images) has been developed in order to implement the 3-dimensional image using a disparity histogram extracted from left and right stereo images. In our program using the area-based method, the matching pixel finding methods consist of SSD(Sum of Squared Distance), SAD(Sum of Absolute Distance), NCC(Normalized Correlation Coefficient) and MPC(Matching Pixel Count). On performing the program, stereo images on different window sizes for various matching pixel finding methods are compared reasonably. When the image has a small noise, SSD on small window size is more effective. Whereas there is much noise, NCC or MPC is more effective than SSD. CAMSI from the present study will be much helpful to implement the complex objects and to analyze 3-dimensional CFD around them.

A GPU based Rendering Method for Multiple-view Autostereoscopic Display (무안경식 다시점 입체 디스플레이를 위한 GPU기반 렌더링 기법)

  • Ahn, Jong-Gil;Kim, Jin-Wook
    • Journal of the HCI Society of Korea
    • /
    • v.4 no.2
    • /
    • pp.9-16
    • /
    • 2009
  • 3D stereo display systems gain more interests recently. Multiple-view autostereoscopic display system enables observers to watch stereo image from multiple viewpoints not wearing specific devices such as shutter glasses or HMD. Therefore, the Multiple-view autostereoscopic display is being spotlighted in the field of virtual reality, mobile, 3D TV and so on. However, one of the critical disadvantages of the system is that observer can enjoy the system only in a small designated area where the system is designed to work properly. This research provides an effective way of GPU based rendering technique to present seamless 3D stereo experiences from an arbitrary observer's view position.

  • PDF

SGM Performance Improvement of Stereo Satellite Image with Classified Image and Edge Image (분류영상과 에지영상을 이용한 입체 위성영상의 SGM 성능개선)

  • Lee, Hyoseong;Park, Byungwook
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.38 no.6
    • /
    • pp.655-661
    • /
    • 2020
  • SGM (Semi Global Matching) can be used to find all the conjugate points between stereo images. Therefore, it enables high-density DSM (Digital Surface Model) production from high-resolution satellite images. However, water, shadows, and occlusion areas cause mismatching of the surrounding points in this method. Particularly, in buildings with large-parallax and elongated-shapes such as a Korean style apartment, it is difficult to reconstruct the 3D building even if the SGM method is applied to a high-resolution 50cm satellite image. This study proposed and performed the SGM technique with a classified image and an edge image from the IKONOS-2 satellite stereo-image with a 1m resolution to produce DSM. It was compared with the DSMs from the general SGM and the high-density ABM (Area Based Matching) matching of ERDAS software. The results of the apartment DSM by the proposed method were the best in the test area. As a result, despite the image having a resolution of 1m, the outline of the building DSM could be expressed more clearly than the existing method.