• Title/Summary/Keyword: stereo analysis

Search Result 305, Processing Time 0.024 seconds

A Speaker Detection System based on Stereo Vision and Audio (스테레오 시청각 기반의 화자 검출 시스템)

  • An, Jun-Ho;Hong, Kwang-Seok
    • Journal of Internet Computing and Services
    • /
    • v.11 no.6
    • /
    • pp.21-29
    • /
    • 2010
  • In this paper, we propose the system which detects the speaker, who is speaking currently, among a number of users. A proposed speaker detection system based on stereo vision and audio is mainly composed of the followings: a position estimation of speaker candidates using stereo camara and microphone, a current speaker detection, and a speaker information acquisition based on a mobile device. We use the haar-like features and the adaboost algorithm to detect the faces of speaker candidates with stereo camera, and the position of speaker candidates is estimated by a triangulation method. Next, the Time Delay Of Arrival (TDOA) is estimated by the Cross Power Spectrum Phase (CPSP) analysis to find the direction of source with two microphone. Finally we acquire the information of the speaker including his position, voice, and face by comparing the information of the stereo camera with that of two microphone. Furthermore, the proposed system includes a TCP client/server connection method for mobile service.

Epipolar Resampling Module for CAS500 Satellites 3D Stereo Data Processing (국토위성 3차원 데이터 생성을 위한 입체 기하 영상 생성 모듈 제작 및 테스트)

  • Oh, Jaehong;Lee, Changno
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.5_2
    • /
    • pp.939-948
    • /
    • 2020
  • CAS500-1 and CAS500-2 are high-resolution Earth-observing satellites being developed and scheduled to launch for land monitoring of Korea. The satellite information will be used for land usage analysis, change detection, 3D topological monitoring, and so on. Satellite image data of region of interests must be acquired in the stereo mode from different positions for 3D information generation. Accurate 3D processing and 3D display of stereo satellite data requires the epipolar image resampling process considering the pushbroom sensor and the satellite trajectory. This study developed an epipolar image resampling module for CAS-500 stereo data processing and verified its accuracy performance by testing along-track, across-track, and heterogeneous stereo data.

A Study on the Practical Application of Image Control Point Using Stereo Image Chip (입체 영상칩을 이용한 영상기준점 활용방안에 관한 연구)

  • Kim, Hoon-Jung;Kim, Kam-Lae;Cheong, Hae-Jin;Cho, Won-Woo
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.26 no.4
    • /
    • pp.423-431
    • /
    • 2008
  • The control surveying which aims at identifying the coordinate system of satellite images with that of ground is a repeatedly performed essential process to produce digital ortho - photos and it acts as the main factor to increase the production cost of the photos by duplicated budgets and redundant works when executing the projects for acquiring basic geographical information from high density satellite images. During the experimentation, an application system was established for producing a stereo image chip by the analysis of DPPDB file structure, the stereo image chip was produced with SPOT and IKONOS images, the analysis of 3D modeling accuracy was performed to secure the required accuracy and to present the optimal number and deployment of the control points, and a 3D modeling was performed for new SPOT images and lastly, 3D ground coordinates were extracted by the observation of the same points through the overlapping with the new images. As the results of the research, it is proved that the stereo image chip can be used as the ground controls through the accuracy analysis between the coordinates of the images and the ground, close results were obtained between the coordinates by the ground survey and those by the 3D modeling using new images and the observation of the same points, positional changes were not found during observing the same points, and the research presented the methodology for improving the process of the control survey by showing the availability of the image controls on the stereo image chip instead of the ground controls.

Comparison of recognition rate with distance on stereo face images base PCA (PCA기반의 스테레오 얼굴영상에서 거리에 따른 인식률 비교)

  • Park Chang-Han;Namkung Jae-Chan
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.42 no.1
    • /
    • pp.9-16
    • /
    • 2005
  • In this paper, we compare face recognition rate by distance change using Principal Component Analysis algorithm being input left and right image in stereo image. Change to YCbCr color space from RGB color space in proposed method and face region does detection. Also, after acquire distance using stereo image extracted face image's extension and reduce do extract robust face region, experimented recognition rate by using PCA algorithm. Could get face recognition rate of 98.61%(30cm), 98.91%(50cm), 99.05%(100cm), 99.90%(120cm), 97.31%(150cm) and 96.71%(200cm) by average recognition result of acquired face image. Therefore, method that is proposed through an experiment showed that can get high recognition rate if apply scale up or reduction according to distance.

A Study on the Application Technology of Three-dimensional Urban Geo-spatial Simulation using Digital Satellite Image (디지털 위성영상의 3차원 도시공간 시뮬레이션 적용기술연구)

  • 연상호
    • The Journal of the Korea Contents Association
    • /
    • v.4 no.2
    • /
    • pp.7-12
    • /
    • 2004
  • The technique of birdeye image generation of terrain through the use of satellite digital images and digital maps are very important elements and have applications in fanning establishment as well as the actual design of several construction works in complex fields. This paper studies stereo perspective image generation as a possibility through 3-dimensional analysis combined with digital elevation data and remotely sensed images. For this, first of all, ortho-images generated by very accurate GCP and DEM from contour file makes 3-dimensional terrain analysis possible and allows stereo­viewing at the highway construction planning sites. So, we developed the technical methods for the 3-dimensional approach on the planning sites of highways by use of perspective orthoimages. From this research, diverse terrain analysis is possible through stereo perspective image generation, and can leads to various application in road construction through gain study results from access to realtime virtual spatial on the objects area in korea.

  • PDF

Head Pose Estimation by using Morphological Property of Disparity Map

  • Jun, Se-Woong;Park, Sung-Kee;Lee, Moon-Key
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.735-739
    • /
    • 2005
  • This paper presents a new system to estimate the head pose of human in interactive indoor environment that has dynamic illumination change and large working space. The main idea of this system is to suggest a new morphological feature for estimating head angle from stereo disparity map. When a disparity map is obtained from stereo camera, the matching confidence value can be derived by measurements of correlation of the stereo images. Applying a threshold to the confidence value, we also obtain the specific morphology of the disparity map. Therefore, we can obtain the morphological shape of disparity map. Through the analysis of this morphological property, the head pose can be estimated. It is simple and fast algorithm in comparison with other algorithm which apply facial template, 2D, 3D models and optical flow method. Our system can automatically segment and estimate head pose in a wide range of head motion without manual initialization like other optical flow system. As the result of experiments, we obtained the reliable head orientation data under the real-time performance.

  • PDF

A New Stereo Matching Algorithm based on Variable Windows using Frequency Information in DWT Domain (DWT 영역에서의 주파수 정보를 활용한 가변 윈도우 기반의 스테레오 정합 알고리즘)

  • Seo, Young-Ho;Koo, Ja-Myung;Kim, Dong-Wook
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.16 no.7
    • /
    • pp.1437-1446
    • /
    • 2012
  • In this paper we propose a new stereo matching algorithm which is suitable for application to obtain depth information with high-speed in stereoscopic camera environment. For satisfying these condition we propose a new adaptive stereo matching technique using frequency information in discrete wavelet (DWT) domain and variable matching window. The size of the matching window is selected by analysis of the local property of the image in spatial domain and the feature and scaling factor of the matching window is selected by the frequency property in the frequency domain. For using frequency information we use local DWT and global DWT. We identified that the proposed technique has better peak noise to signal ratio (PSNR) than the fixed matching techniques with similar complexity.

Study of a coronal jet observed by Hinode, SDO, and STEREO

  • Lee, Gyeong-Seon;Innes, Davina;Mun, Yong-Jae
    • The Bulletin of The Korean Astronomical Society
    • /
    • v.36 no.1
    • /
    • pp.35.2-35.2
    • /
    • 2011
  • We have investigated a coronal jet near the limb on 2010 June 27 by Hinode/X-Ray Telescope (XRT), EUV Imaging Spectrograph (EIS), SDO/Atmospheric Imaging Assembly (AIA), and STEREO. From EUV (AIA and EIS) and soft X-ray (XRT) images we identify the erupting jet feature in cool and hot temperatures. Using the high temporal and multi wavelength AIA images, we found that the hot jet preceded its associated cool jet and their structures are well consistent with the numerical simulation of the emerging flux-reconnection model. From the spectroscopic analysis, we found that the jet structure changes from blue shift to red one with time, which may indicate the helical structure of the jet. The STEREO observation, which enables us to observe this jet on the disk, shows that there was a dim loop associated with the jet. On the other hand, we found that the structure of its associated active region seen in STEREO is similar to that in AIA observed 5 days before. Based on this fact, we compared the jet morphology on the limb with the magnectic fields extrapolated from a HMI vector magnetogram of this active region observed on the disk. Interestingly, the comparison shows that the open and closed magnetic field configuration correspond to the jet and the dim loop, respectively, as the Shibata's jet model predicted.

  • PDF

Development of 3-D Stereo PIV (3차원 스테레오 PIV 개발)

  • Kim Mi-Young;Choi Jang-Woon;Nam Koo-Man;Lee Young-Ho
    • 한국가시화정보학회:학술대회논문집
    • /
    • 2002.11a
    • /
    • pp.19-22
    • /
    • 2002
  • A process of 3-D particle image velocimetry, called here, as '3-D stereo PIV' was developed for the measurement of a section field of 3-D complex flows. The present method includes modeling of camera by a calibrator based on the homogeneous coordinate system, transfromation of oblique-angled image to transformed image, identification of 2-D velocity vectors by 2-D cross-correlation equation, stereo matching of 2-D velocity vectors of two cameras, accurate calculation of 3-D velocity vectors by homogeneous coordinate system and finally 3-D animation as the post processing. In principle, as two frame images only are necessary for the single instantaneous analysis of a section field of 3-D flow, more effective vectors are obtainable contrary to the previous multi-frame vector algorithm. An experimental system was also used for the application of the proposed method. Three analog CCD cameras and an Argon-Ion Laser(300mW) for illumination were adopted to capture the wake flow behind a bluff obstacle.

  • PDF

3D Grasp Planning using Stereo Matching and Neural Network (스테레오정합과 신경망을 이용한 3차원 잡기계획)

  • Lee, Hyun-Ki;Bae, Joon-Young;Lee, Sang-Ryong
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.27 no.7
    • /
    • pp.1110-1119
    • /
    • 2003
  • This paper deals with the synthesis of the 3-dimensional grasp planning for unknown objects. Previous studies have many problems, which the estimation time for finding the grasping points is much long and the analysis used the not-perfect 3-dimensional modeling. To overcome these limitations in this paper new algorithm is proposed, which algorithm is achieved by two steps. First step is to find the whole 3-dimensional geometrical modeling for unknown objects by using stereo matching. Second step is to find the optimal grasping points for unknown objects by using the neural network trained by the result of optimization using genetic algorithm. The algorithm is verified by computer simulation, comparing the result between neural network and optimization.