• Title/Summary/Keyword: Camera sensor

Search Result 1,274, Processing Time 0.027 seconds

Implementation of a sensor fusion system for autonomous guided robot navigation in outdoor environments (실외 자율 로봇 주행을 위한 센서 퓨전 시스템 구현)

  • Lee, Seung-H.;Lee, Heon-C.;Lee, Beom-H.
    • Journal of Sensor Science and Technology
    • /
    • v.19 no.3
    • /
    • pp.246-257
    • /
    • 2010
  • Autonomous guided robot navigation which consists of following unknown paths and avoiding unknown obstacles has been a fundamental technique for unmanned robots in outdoor environments. The unknown path following requires techniques such as path recognition, path planning, and robot pose estimation. In this paper, we propose a novel sensor fusion system for autonomous guided robot navigation in outdoor environments. The proposed system consists of three monocular cameras and an array of nine infrared range sensors. The two cameras equipped on the robot's right and left sides are used to recognize unknown paths and estimate relative robot pose on these paths through bayesian sensor fusion method, and the other camera equipped at the front of the robot is used to recognize abrupt curves and unknown obstacles. The infrared range sensor array is used to improve the robustness of obstacle avoidance. The forward camera and the infrared range sensor array are fused through rule-based method for obstacle avoidance. Experiments in outdoor environments show the mobile robot with the proposed sensor fusion system performed successfully real-time autonomous guided navigation.

A Multi-Sensor Module of Snake Robot for Searching Survivors in Narrow Space (협소 공간 생존자 탐색을 위한 뱀형 로봇의 다중 센서 모듈)

  • Kim, Sungjae;Shin, Dong-Gwan;Pyo, Juhyun;Shin, Juseong;Jin, Maolin;Suh, Jinho
    • The Journal of Korea Robotics Society
    • /
    • v.16 no.4
    • /
    • pp.291-298
    • /
    • 2021
  • In this study, we present a multi-sensor module for snake robot searching survivors in a narrow space. To this end, we integrated five sensor systems by considering the opinions of the first responders: a gas sensor to detect CO2 gases from the exhalation of survivors, a CMOS camera to provide the image of survivors, an IR camera to see in the dark & smoky environment, two microphones to detect the voice of survivors, and an IMU to recognize the approximate location and direction of the robot and survivors. Furthermore, we integrated a speaker into the sensor module system to provide a communication channel between the first responders and survivors. To integrated all these mechatronics systems in a small, compact snake head, we optimized the positions of the sensors and designed a stacked structure for the whole system. We also developed a user-friendly GUI to show the information from the proposed sensor systems visually. Experimental results verified the searching function of the proposed sensor module system.

Establishment of Test Field for Aerial Camera Calibration (항공 카메라 검정을 위한 테스트 필드 구축방안)

  • Lee, Jae-One;Yoon, Jong-Seong;Sin, Jin-Soo;Yun, Bu-Yeol
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.16 no.2
    • /
    • pp.67-76
    • /
    • 2008
  • Recently, one of the most outstanding technological characteristics of aerial survey is an application of Direct Georeferencing, which is based on the integration of main sensing sensors such as aerial camera or Lidar with positioning sensors GPS and IMU. In addition, a variety of digital aerial mapping cameras is developed and supplied with the verification of their technical superiority and applicability. In accordance with this requirement, the development of a multi-looking aerial photographing system is just making 3-D information acquisition and texture mapping possible for the dead areas arising from building side and high terrain variation where the use of traditional phptogrammetry is not valid. However, the development of a multi-looking camera integrating different sensors and multi-camera array causes some problems to conduct time synchronization among sensors and their geometric and radiometric calibration. The establishment of a test field for aerial sensor calibration is absolutely necessary to solve this problem. Therefore, this paper describes investigations for photogrammetric Test Field of foreign countries and suggest an establishment scheme for domestic test field.

  • PDF

Dynamic Modeling and Georegistration of Airborne Video Sequences

  • Lee, Changno
    • Korean Journal of Geomatics
    • /
    • v.3 no.1
    • /
    • pp.23-32
    • /
    • 2003
  • Rigorous sensor and dynamic modeling techniques are required if spatial information is to be accurately extracted from video imagery. First, a mathematical model for an uncalibrated video camera and a description of a bundle adjustment with added parameters, for purposes of general block triangulation, is presented. This is followed by the application of invariance-based techniques, with constraints, to derive initial approximations for the camera parameters. Finally, dynamic modeling using the Kalman Filter is discussed. The results of various experiments with real video imagery, which apply the developed techniques, are given.

  • PDF

The realization of 3D Display by using 2D sensor

  • Lee, Kyu-Tae;Um, Kee-Tae;Kim, Sang-Jo;Chae, Kyung-Pil
    • 한국정보디스플레이학회:학술대회논문집
    • /
    • 2008.10a
    • /
    • pp.765-768
    • /
    • 2008
  • To make 3D camera system, we check the possibility of advanced range camera module based on measuring the time delay of modulated infrared light, using a single detector chip fabricated on standard CMOS process. To depth information, electronic shutter and interlaced scanning method of 2D sensor is needed. Especially, we design "lens system, illumination unit" and review simulation result.

  • PDF

Development of living body information and behavior monitoring system for nursing person

  • Ichiki, Ai;Sakamoto, Hidetoshi;Ohbuchi, Yoshifumi
    • Journal of Engineering Education Research
    • /
    • v.17 no.4
    • /
    • pp.15-20
    • /
    • 2014
  • The non-contact easy detecting system of nursing person's body vital information and their behaviors monitoring system are developed, which consist of "Kinect" sensor and thermography camera. The "Kinect" sensor can catch the body contour and the body moving behavior, and output their imaging data realtime. The thermography camera can detect respiration state and body temperature, etc. In this study, the practicability of this system was verified.

Method of Sensitivity Configuration of Gyro Sensor for Virtual Camera inside 3D Mobile Game (3D 모바일 게임 내의 가상카메라를 위한 자이로 센서의 민감도 설정 방법)

  • Baek, Insik;Kim, Jong-Kook
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2014.04a
    • /
    • pp.1020-1022
    • /
    • 2014
  • In this paper, we present a method for smartphone users to have a better user experience when playing 3D mobile games using the gyro sensor. We designed the rotation of the virtual camera in the game world to be proportional to the real-world's rotation. We have also made the sensitivity configuration possible for users to manipulate.

Realtime 3D Human Full-Body Convergence Motion Capture using a Kinect Sensor (Kinect Sensor를 이용한 실시간 3D 인체 전신 융합 모션 캡처)

  • Kim, Sung-Ho
    • Journal of Digital Convergence
    • /
    • v.14 no.1
    • /
    • pp.189-194
    • /
    • 2016
  • Recently, there is increasing demand for image processing technology while activated the use of equipments such as camera, camcorder and CCTV. In particular, research and development related to 3D image technology using the depth camera such as Kinect sensor has been more activated. Kinect sensor is a high-performance camera that can acquire a 3D human skeleton structure via a RGB, skeleton and depth image in real-time frame-by-frame. In this paper, we develop a system. This system captures the motion of a 3D human skeleton structure using the Kinect sensor. And this system can be stored by selecting the motion file format as trc and bvh that is used for general purposes. The system also has a function that converts TRC motion captured format file into BVH format. Finally, this paper confirms visually through the motion capture data viewer that motion data captured using the Kinect sensor is captured correctly.

AGV Navigation Using a Space and Time Sensor Fusion of an Active Camera

  • Jin, Tae-Seok;Lee, Bong-Ki;Lee, Jang-Myung
    • Journal of Navigation and Port Research
    • /
    • v.27 no.3
    • /
    • pp.273-282
    • /
    • 2003
  • This paper proposes a sensor-fusion technique where rho data sets for the previous moments are properly transformed and fused into the current data sets to enable accurate measurement, such as, distance to an obstacle and location of the service robot itself. In the conventional fusion schemes, the measurement is dependent only on the current data sets. As the results, more of sensors are required to measure a certain physical promoter or to improve the accuracy of the measurement. However, in this approach, intend of adding more sensors to the system, the temporal sequence of the data sets are stored and utilized for the measurement improvement. Theoretical basis is illustrated by examples md the effectiveness is proved through the simulation. Finally, the new space and time sensor fusion (STSF) scheme is applied to the control of a mobile robot in the indoor environment and the performance was demonstrated by the real experiments.

Auto-parking Controller of Omnidirectional Mobile Robot Using Image Localization Sensor and Ultrasonic Sensors (영상위치센서와 초음파센서를 사용한 전 방향 이동로봇의 자동주차 제어기)

  • Yun, Him Chan;Park, Tae Hyoung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.21 no.6
    • /
    • pp.571-576
    • /
    • 2015
  • This paper proposes an auto-parking controller for omnidirectional mobile robots. The controller uses the multi-sensor system including ultrasonic sensor and camera. The several ultrasonic sensors of robot detect the distance between robot and each wall of the parking lot. The camera detects the global position of robot by capturing the image of artificial landmarks. To improve the accuracy of position estimation, we applied the extended Kalman filter with adaptive fuzzy controller. Also we developed the fuzzy control system to reduce the settling time of parking. The experimental results are presented to verify the usefulness of the proposed controller.