• Title/Summary/Keyword: stereo vision sensor

Search Result 72, Processing Time 0.026 seconds

Recognition of Physical Rehabilitation on the Upper Limb Function using 3D Trajectory Information from the Stereo Vision Sensor (스테레오비전 센서의 3D 궤적 정보를 이용한 상지 재활 동작 인식)

  • Kwon, Ki-Hyeon;Lee, Hyung-Bong
    • Journal of the Korea Society of Computer and Information
    • /
    • v.18 no.8
    • /
    • pp.113-119
    • /
    • 2013
  • The requirement of rehabilitation is increasing from the stroke, spinal cord injury. One of the most difficult part is the upper limb rehabilitation because of its nervous complexity. A rehabilitation has effectiveness when a professional therapist treats in work at facility, but it has problems of an accessibility, a constant availability, a self-participation and taking lots of cost and time. In this paper, we test and experiment the accuracy and execution time of the pattern recognition algorithms like PCA, ICA, LDA, SVM to show the recognition possibility of it on the upper limb function from the 3D trajectory information which is gathered from stereo vision sensor(Kinect). From the result, PCA, ICA have low accuracy, but LDA, SVM have good accuracy to use for physical rehabilitation on the upper limb function.

Development of A Vision-based Lane Detection System with Considering Sensor Configuration Aspect (센서 구성을 고려한 비전 기반 차선 감지 시스템 개발)

  • Park Jaehak;Hong Daegun;Huh Kunsoo;Park Jahnghyon;Cho Dongil
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.13 no.4
    • /
    • pp.97-104
    • /
    • 2005
  • Vision-based lane sensing systems require accurate and robust sensing performance in lane detection. Besides, there exists trade-off between the computational burden and processor cost, which should be considered for implementing the systems in passenger cars. In this paper, a stereo vision-based lane detection system is developed with considering sensor configuration aspects. An inverse perspective mapping method is formulated based on the relative correspondence between the left and right cameras so that the 3-dimensional road geometry can be reconstructed in a robust manner. A new monitoring model for estimating the road geometry parameters is constructed to reduce the number of the measured signals. The selection of the sensor configuration and specifications is investigated by utilizing the characteristics of standard highways. Based on the sensor configurations, it is shown that appropriate sensing region on the camera image coordinate can be determined. The proposed system is implemented on a passenger car and verified experimentally.

Segmentation of Pointed Objects for Service Robots (서비스 로봇을 위한 지시 물체 분할 방법)

  • Kim, Hyung-O;Kim, Soo-Hwan;Kim, Dong-Hwan;Park, Sung-Kee
    • The Journal of Korea Robotics Society
    • /
    • v.4 no.2
    • /
    • pp.139-146
    • /
    • 2009
  • This paper describes how a person extracts a unknown object with pointing gesture while interacting with a robot. Using a stereo vision sensor, our proposed method consists of two stages: the detection of the operators' face, the estimation of the pointing direction, and the extraction of the pointed object. The operator's face is recognized by using the Haar-like features. And then we estimate the 3D pointing direction from the shoulder-to-hand line. Finally, we segment an unknown object from 3D point clouds in estimated region of interest. On the basis of this proposed method, we implemented an object registration system with our mobile robot and obtained reliable experimental results.

  • PDF

The Use of Advanced Optical Measurement Methods for the Mechanical Analysis of Shear Deficient Prestressed Concrete Members

  • Wilder, K. De;Roeck, G. De;Vandewalle, L.
    • International Journal of Concrete Structures and Materials
    • /
    • v.10 no.2
    • /
    • pp.189-203
    • /
    • 2016
  • This paper investigates on the use of advanced optical measurement methods, i.e. 3D coordinate measurement machines (3D CMM) and stereo-vision digital image correlation (3D DIC), for the mechanical analysis of shear deficient prestressed concrete members. Firstly, the experimental program is elaborated. Secondly, the working principle, experimental setup and corresponding accuracy and precision of the considered optical measurement techniques are reported. A novel way to apply synthesised strain sensor patterns for DIC is introduced. Thirdly, the experimental results are reported and an analysis is made of the structural behaviour based on the gathered experimental data. Both techniques yielded useful and complete data in comparison to traditional mechanical measurement techniques and allowed for the assessment of the mechanical behaviour of the reported test specimens. The identified structural behaviour presented in this paper can be used to optimize design procedure for shear-critical structural concrete members.

A Study on Implementation for Real-time Lane Departure Warning System & Smart Night Vision Based on HDR Camera Platform (실시간 차선 이탈 경고 및 Smart Night Vision을 위한 HDR Camera Platform 구현에 관한 연구)

  • Park, Hwa-Beom;Park, Ge-O;Kim, Young-kil
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2017.05a
    • /
    • pp.123-126
    • /
    • 2017
  • The information and communication technology that is being developed recently has been greatly influencing the automobile market. In recent years, devices equipped with IT technology have been installed for the safety and convenience of the driver. However, it has the advantage of increased convenience as well as the disadvantage of increasing traffic accidents due to driver 's distraction. In order to prevent such accidents, it is necessary to develop safety systems of various types and ways. In this paper, we propose a method to implement a multi-function camera driving safety system that notifies a pedestrian and lane departure warning without using a radar sensor or a stereo video image, and a study on the analysis of a lane departure alarm software result.

  • PDF

A Study of 3D World Reconstruction and Dynamic Object Detection using Stereo Images (스테레오 영상을 활용한 3차원 지도 복원과 동적 물체 검출에 관한 연구)

  • Seo, Bo-Gil;Yoon, Young Ho;Kim, Kyu Young
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.10
    • /
    • pp.326-331
    • /
    • 2019
  • In the real world, there are both dynamic objects and static objects, but an autonomous vehicle or mobile robot cannot distinguish between them, even though a human can distinguish them easily. It is important to distinguish static objects from dynamic objects clearly to perform autonomous driving successfully and stably for an autonomous vehicle or mobile robot. To do this, various sensor systems can be used, like cameras and LiDAR. Stereo camera images are used often for autonomous driving. The stereo camera images can be used in object recognition areas like object segmentation, classification, and tracking, as well as navigation areas like 3D world reconstruction. This study suggests a method to distinguish static/dynamic objects using stereo vision for an online autonomous vehicle and mobile robot. The method was applied to a 3D world map reconstructed from stereo vision for navigation and had 99.81% accuracy.

A 3-D Vision Sensor Implementation on Multiple DSPs TMS320C31 (다중 TMS320C31 DSP를 사용한 3-D 비젼센서 Implementation)

  • Oksenhendler, V.;Bensrhair, Abdelaziz;Miche, Pierre;Lee, Sang-Goog
    • Journal of Sensor Science and Technology
    • /
    • v.7 no.2
    • /
    • pp.124-130
    • /
    • 1998
  • High-speed 3D vision systems are essential for autonomous robot or vehicle control applications. In our study, a stereo vision process has been developed. It consists of three steps : extraction of edges in right and left images, matching corresponding edges and calculation of the 3D map. This process is implemented in a VME 150/40 Imaging Technology vision system. It is a modular system composed by a display, an acquisition, a four Mbytes image frame memory, and three computational cards. Programmable accelerator computational modules are running at 40 MHz and are based on TMS320C31 DSP with a $64{\times}32$ bit instruction cache and two $1024{\times}32$ bit internal RAMs. Each is equipped with 512 Kbytes static RAM, 4 Mbytes image memory, 1 Mbytes flash EEPROM and a serial port. Data transfers and communications between modules are provided by three 8 bit global video bus, and three local configurable pipeline 8 bit video bus. The VME bus is dedicated to system management. Tasks between DSPs are distributed as follows: two DSPs are used to edges detection, one for the right image and the other for the left one. The last processor computes the matching process and the 3D calculation. With $512{\times}512$ pixels images, this sensor generates dense 3D maps at a rate of about 1 Hz depending of the scene complexity. Results can surely be improved by using a special suited multiprocessors cards.

  • PDF

Simulation of Radiation Imaging based on the Scanning of Pin-hole Stereo Vision Sensors (핀홀 스테레오 비전 센서의 공간 스캔을 통한 방사선의 영상화 시뮬레이션)

  • Park, Soon-Yong;Baek, Seung-Hae;Choi, Chang-Won
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.18 no.7
    • /
    • pp.1671-1680
    • /
    • 2014
  • There are always much concern about the leakage of radiation materials in the event of dismantle or unexpected accident of nuclear power plant. In order to remove the leakage of radiation materials, appropriate dispersion detection techniques for radiation materials are necessary. However, because direct handling of radiation materials is highly restricted and risky, developing radiation-related techniques needs computer simulation in advance to evaluate the feasibility. In this paper, we propose a radiation imaging technique which can acquire 3D dispersion information of radiation materials and tested by simulation. Using two virtual 1D radiation sensors, we obtain stereo radiation images and acquire the 3D depth to virtual radiation materials using stereo disparity. For point and plane type virtual radiation materials, the possibility of the acquisition of stereo radiation image and 3D information are simulated.

Study on Vision based Object Detection Algorithm for Passenger' s Safety in Railway Station (철도 승강장 승객안전을 위한 비전기반 물체 검지 알고리즘 연구)

  • Oh, Seh-Chan;Park, Sung-Hyuk;Jeong, Woo-Tae
    • Proceedings of the KSR Conference
    • /
    • 2008.06a
    • /
    • pp.553-558
    • /
    • 2008
  • Advancement in information technology have enabled applying vision sensor to railway, such as CCTV. CCTV has been widely used in railway application, however the CCTV is a passive system that provide limited capability to maintain safety from boarding platform. The station employee should monitor continuously CCTV monitors. Therefore immediate recognition and response to the situation is difficultin emergency situation. Recently, urban transit operators are pursuing applying an unattended station operation system for their cost reduction. Therefore, an intelligent monitoring system is need for passenger's safety in railway. The paper proposes a vision based monitoring system and object detection algorithm for passenger's safety in railway platform. The proposed system automatically detects accident in platform and analyzes level of danger using image processing technology. The system uses stereo vision technology with multi-sensors for minimizing detection error in various railway platform conditions.

  • PDF

3D Environment Perception using Stereo Infrared Light Sources and a Camera (스테레오 적외선 조명 및 단일카메라를 이용한 3차원 환경인지)

  • Lee, Soo-Yong;Song, Jae-Bok
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.15 no.5
    • /
    • pp.519-524
    • /
    • 2009
  • This paper describes a new sensor system for 3D environment perception using stereo structured infrared light sources and a camera. Environment and obstacle sensing is the key issue for mobile robot localization and navigation. Laser scanners and infrared scanners cover $180^{\circ}$ and are accurate but too expensive. Those sensors use rotating light beams so that the range measurements are constrained on a plane. 3D measurements are much more useful in many ways for obstacle detection, map building and localization. Stereo vision is very common way of getting the depth information of 3D environment. However, it requires that the correspondence should be clearly identified and it also heavily depends on the light condition of the environment. Instead of using stereo camera, monocular camera and two projected infrared light sources are used in order to reduce the effects of the ambient light while getting 3D depth map. Modeling of the projected light pattern enabled precise estimation of the range. Two successive captures of the image with left and right infrared light projection provide several benefits, which include wider area of depth measurement, higher spatial resolution and the visibility perception.