• Title/Summary/Keyword: stereo sensor

Search Result 199, Processing Time 0.033 seconds

A Remote Rehabilitation System using Kinect Stereo Camera (키넥트 스테레오 영상을 이용한 원격 재활 시스템)

  • Kim, Kyungah;Chung, Wan-Young;Kim, Jong-Jin
    • Journal of Sensor Science and Technology
    • /
    • v.25 no.3
    • /
    • pp.196-201
    • /
    • 2016
  • Rehabilitation exercises are the treatments designed to help patients who are in the process of recovery from injury or illness to restore their body functions back to the original status. However, many patients suffering from chronic diseases have found difficulties visiting hospitals for the rehabilitation program due to lack of transportation, cost of the program, their own busy schedules, etc. Also, the program usually contains a few medical check-ups which can cause patients to feel uncomfortable. In this paper, we develop a remote rehabilitation system with bio-signals by a stereo camera. A Kinect stereo camera manufactured by Microsoft corporation was used to recognize the body movement of a patient by using its infrared(IR) camera. Also, we detect the chest area of a user from the skeleton data and process to gain respiratory status. ROI coordinates are created on a user's face to detect photoplethysmography(PPG) signals to calculate heart rate values from its color sensor. Finally, rehabilitation exercises and bio-signal detecting features are combined into a Windows application for the cost effective and high performance remote rehabilitation system.

Incorporation of Scene Geometry in Least Squares Correlation Matching for DEM Generation from Linear Pushbroom Images

  • Kim, Tae-Jung;Yoon, Tae-Hun;Lee, Heung-Kyu
    • Proceedings of the KSRS Conference
    • /
    • 1999.11a
    • /
    • pp.182-187
    • /
    • 1999
  • Stereo matching is one of the most crucial parts in DEM generation. Naive stereo matching algorithms often create many holes and blunders in a DEM and therefore a carefully designed strategy must be employed to guide stereo matching algorithms to produce “good” 3D information. In this paper, we describe one such a strategy designed by the use of scene geometry, in particular, the epipolarity for generation of a DEM from linear pushbroom images. The epipolarity for perspective images is a well-known property, i.e., in a stereo image pair, a point in the reference image will map to a line in the search image uniquely defined by sensor models of the image pair. This concept has been utilized in stereo matching by applying epipolar resampling prior to matching. However, the epipolar matching for linear pushbroom images is rather complicated. It was found that the epipolarity can only be described by a Hyperbola- shaped curve and that epipolar resampling cannot be applied to linear pushbroom images. Instead, we have developed an algorithm of incorporating such epipolarity directly in least squares correlation matching. Experiments showed that this approach could improve the quality of a DEM.

  • PDF

3D Environment Perception using Stereo Infrared Light Sources and a Camera (스테레오 적외선 조명 및 단일카메라를 이용한 3차원 환경인지)

  • Lee, Soo-Yong;Song, Jae-Bok
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.15 no.5
    • /
    • pp.519-524
    • /
    • 2009
  • This paper describes a new sensor system for 3D environment perception using stereo structured infrared light sources and a camera. Environment and obstacle sensing is the key issue for mobile robot localization and navigation. Laser scanners and infrared scanners cover $180^{\circ}$ and are accurate but too expensive. Those sensors use rotating light beams so that the range measurements are constrained on a plane. 3D measurements are much more useful in many ways for obstacle detection, map building and localization. Stereo vision is very common way of getting the depth information of 3D environment. However, it requires that the correspondence should be clearly identified and it also heavily depends on the light condition of the environment. Instead of using stereo camera, monocular camera and two projected infrared light sources are used in order to reduce the effects of the ambient light while getting 3D depth map. Modeling of the projected light pattern enabled precise estimation of the range. Two successive captures of the image with left and right infrared light projection provide several benefits, which include wider area of depth measurement, higher spatial resolution and the visibility perception.

Optimal 3D Grasp Planning for unknown objects (임의 물체에 대한 최적 3차원 Grasp Planning)

  • 이현기;최상균;이상릉
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2002.05a
    • /
    • pp.462-465
    • /
    • 2002
  • This paper deals with the problem of synthesis of stable and optimal grasps with unknown objects by 3-finger hand. Previous robot grasp research has analyzed mainly with either unknown objects 2D by vision sensor or unknown objects, cylindrical or hexahedral objects, 3D. Extending the previous work, in this paper we propose an algorithm to analyze grasp of unknown objects 3D by vision sensor. This is archived by two steps. The first step is to make a 3D geometrical model of unknown objects by stereo matching which is a kind of 3D computer vision technique. The second step is to find the optimal grasping points. In this step, we choose the 3-finger hand because it has the characteristic of multi-finger hand and is easy to modeling. To find the optimal grasping points, genetic algorithm is used and objective function minimizing admissible farce of finger tip applied to the object is formulated. The algorithm is verified by computer simulation by which an optimal grasping points of known objects with different angles are checked.

  • PDF

The Optimal Grasp Planning by Using a 3-D Computer Vision Technique (3차원 영상처리 기술을 이용한 Grasp planning의 최적화)

  • 이현기;김성환;최상균;이상룡
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.19 no.11
    • /
    • pp.54-64
    • /
    • 2002
  • This paper deals with the problem of synthesis of stable and optimal grasps with unknown objects by 3-finger hand. Previous robot grasp research has mainly analyzed with either unknown objects 2-dimensionally by vision sensor or known objects, such as cylindrical objects, 3-dimensionally. As extending the previous work, in this study we propose an algorithm to analyze grasp of unknown objects 3-dimensionally by using vision sensor. This is archived by two steps. The first step is to make a 3-dimensional geometrical model for unknown objects by using stereo matching. The second step is to find the optimal grasping points. In this step, we choose the 3-finger hand which has the characteristic of multi-finger hand and is easy to model. To find the optimal grasping points, genetic algorithm is employed and objective function minimizes the admissible force of finger tip applied to the objects. The algorithm is verified by computer simulation by which optimal grasping points of known objects with different angle are checked.

2D Map generation Using Omnidirectional Image sensor and Stereo Vision for MobileRobot MAIRO (자율이동로봇MAIRO의 전방향 이미지센서와 스테레오 비전 시스템을 이용한 2차원 지도 생성)

  • Kim, Kyung-Ho;Lee, Hyung-Kyu;Son, Young-Jun;Song, Jae-Keun
    • Proceedings of the KIEE Conference
    • /
    • 2002.11c
    • /
    • pp.495-500
    • /
    • 2002
  • Recently, a service robot industry outstands as an up and coming industry of the next generation. Specially, there are so many research in self-steering movement(SSM). In order to implement SSM, robot must effectively recognize all around, detect objects and make a surrounding map with sensors. So, many robots have a sonar and a infrared sensor, etc. But, in these sensors, We only know informations about between the robot and the object as well as resolution faculty is of inferior quality. In this paper, we will introduce new algorithm that recognizes objects around robot and makes a two dimension surrounding map with a omni-direction vision camera and two stereo vision cameras.

  • PDF

Performance Evaluation of KOMPSAT-3 Satellite DSM in Overseas Testbed Area (해외 테스트베드 지역 아리랑 위성 3호 DSM 성능평가)

  • Oh, Kwan-Young;Hwang, Jeong-In;Yoo, Woo-Sun;Lee, Kwang-Jae
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.6_2
    • /
    • pp.1615-1627
    • /
    • 2020
  • The purpose of this study is to compare and analyze the performance of KOMPSAT-3 Digital Surface Model (DSM) made in overseas testbed area. To that end, we collected the KOMPSAT-3 in-track stereo image taken in San Francisco, the U.S. The stereo geometry elements (B/H, converse angle, etc.) of the stereo image taken were all found to be in the stable range. By applying precise sensor modeling using Ground Control Point (GCP) and DSM automatic generation technique, DSM with 1 m resolution was produced. Reference materials for evaluation and calibration are ground points with accuracy within 0.01 m from Compass Data Inc., 1 m resolution Elevation 1-DSM produced by Airbus. The precision sensor modeling accuracy of KOMPSAT-3 was within 0.5 m (RMSE) in horizontal and vertical directions. When the difference map was written between the generated DSM and the reference DSM, the mean and standard deviation were 0.61 m and 5.25 m respectively, but in some areas, they showed a large difference of more than 100 m. These areas appeared mainly in closed areas where high-rise buildings were concentrated. If KOMPSAT-3 tri-stereo images are used and various post-processing techniques are developed, it will be possible to produce DSM with more improved quality.

The Study for the Fast Detection of the Stereo Radiation Detector using the Image Processing (영상처리기반 스테레오 감마선 탐지장치의 고속탐지에 관한 연구)

  • Hwang, Young-gwan;Lee, Nam-ho
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2015.10a
    • /
    • pp.1103-1105
    • /
    • 2015
  • Leaked Radioactive source in nuclear power station, radiation related facilities and the aging nuclear power plant for the dismantling must need to detect and remove early to prevent major accidents. In this paper, we implemented a single sensor-based gamma-ray detectors stereo which can provide the distance to the radiation source, a direction and doserate information for fast and efficient decontamination work the radiation source. And we have carried out an algorithm development for high-speed detection of the detection equipment. Two detectors are required for stereo structure for obtaining the distance information of the radioactive source, but we designed the only sensor-based detection device for the weight reduction. We have extracted the region of interest and obtained the distance calculation result and distribution of radiation source in order to minimize a stereo image acquisition time. Detection time of the algorithm showed a shorter time of about 41%.

  • PDF

Study of the Radioactive Source Detection and the Visualization with the Stereo Radiation Detector (스테레오 기반 감마선원 탐지 및 가시화에 관한 연구)

  • Park, Gang-teak;Lee, Nam-ho;Cha, Han-ju
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2015.10a
    • /
    • pp.1100-1102
    • /
    • 2015
  • In the study, stereo-based of gamma-ray sources detector for the space including the gamma-ray source to scan in a raster scan method, and obtains a visible light image and the gamma-ray image. We went to retrieve and visualize the distance to source and the direction of the 3-dimension information from Stereo gamma-ray detectors. Configuration of the detector consisted of gamma-ray detecting sensor for gamma-ray Sources, pan-tilt for the scanning of the raster for detecting sources, and CCD camera for visible-light image. Implement a stereo structure of the device to measure the spatial distribution of source, the gamma-ray Detector and CCD camera for the stereo image acquisition was as each configuration 2. The gamma-ray detector and a visible light camera to revision the distribution of detection source, After performing each of the cameras of the stereo correction and shows the distribution of the gamma-ray Sources through 중첩 visible light image and the gamma-ray image. After Rectification process of Left and right image, we were derived visualization results of the stereo image.

  • PDF