Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Indoor Navigation System for Visually Impaired Persons Using Camera and Range Sensors

카메라와 거리센서를 이용한 시각장애인 실내 보행안내 시스템

  • 이진희 (인하대학교 컴퓨터.정보공학과) ;
  • 신병석 (인하대학교 컴퓨터.정보공학과)
  • Received : 2010.09.08
  • Accepted : 2011.03.04
  • Published : 2011.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose an indoor navigation system that can do walk safely to the destination for visually impaired persons. The proposed system analyzes images taken with the camera finds the ID of the marker to identify the absolute position of the pedestrian. Using the distance and angle obtained from IMU(Inertial Measurement Unit) accelerometer sensor and a gyro sensor, the system decides the relative position of a pedestrian for the previous position to determine the next direction. At the same time, we simplify a complex spatial structure in front of user by means of ultrasonic sensors and determine an avoidance direction by estimating the patterns. Then, it uses a few IR(Infrared Rays) sensors to detect stair. Our system offers position of visually impaired persons incorporating multiple sensors and helps users to arrive to destination safely.

본 논문에서는 시각장애인이 실내에서 특정 목적지까지 안전하게 보행할 수 있도록 하는 시스템을 제안한다. 이 시스템은 카메라로 찍은 영상을 분석하여 마커의 ID를 구한 후 이로부터 보행자의 절대위치를 파악하고, IMU(Inertial Measurement Unit)의 가속도 센서와 자이로 센서를 통해 들어온 이동거리와 각도를 이용하여 보행자의 이전위치에 대한 상대위치를 파악하여 다음 진행 방향을 결정한다. 동시에 다수의 초음파 센서들을 이용하여 보행자 전방의 장애물 위치를 파악하여 사용자에게 최적의 진행방향을 알려준다. 이때 경로상의 계단이 있을 경우 IR(Infrared Rays)센서로 감지하여 보행자에게 알려준다. 본 시스템은 다중 복합 센서들을 융합하여 시각장애인에게 위치정보를 제공하고 원하는 목적지까지 안전하게 보행할 수 있도록 한다.

Keywords

References

  1. N. Molton, S. Se, D. Lee, M. Brady, and P. Probert, "Robotic Sensing for the Guidance of the Visually Impaired," Proceedings of International Conference on Field and Service Robotics (FSR '97), pp. 236-243, 1997.
  2. S. Shoval, I. Ulrich, and J. Borenstein, "The NavBelt - A Computerized Travel Aid for the Blind Based on Mobile Robotics Technology," IEEE Transcations on Biomedical Engineering, Vol.45, No.11, pp. 1376-1386, 1998. https://doi.org/10.1109/10.725334
  3. S. Shoval, I. Ulrich, and J. Borenstein, "Robotics-Based Obstacle-Avoidance Systems for the Blind and Visually Impaired. NavBelt and the GuideCane," IEEE Robotics & Automation Magazine, pp. 9-20, 2003.
  4. J.M. Benjamin, N.A. Ali, and A.F. Schepis, "A Laser Cane for the Blind," Proceedings of the San Diego Biomedical Symposium, Vol.12, pp. 53-57, 1973.
  5. K. Ito, M. Okamoto, J. Akita, and T. Ono, "CyARM: an Alternative Aid Device for Blind Persons," Conference on Human Factors in Computing Systems, 2005.
  6. H.M. Shim, J.S. Lee, E.H. Lee, and S.H. Hong, "A Study on the Sound-Imaging Algorithm of Obstacle Information for the Visually Impaired," ITC-CSCC, pp. 389-392, 2002.
  7. K. Magatani, and K. Sawa, "Development of the Navigation System for the Visually Impaired by Using Optical Beacons," the 23th Annual International Conference for the IEEE Engineering in Medicine and Biology Society, 2001.
  8. H. Hashimoto and K. Magatani, "The Development If the Navigation System for the Visually Impaired Persons," the 23th Annual International Conference for the IEEE Engineering in Medicine and Biology Society, 2001.
  9. S. Cardin, D. Thalmann, and F. Vexo, "Wearable System for Mobility Improvement of Visually Impaired People," Visual Computer journal, Vol.23, No.2, pp. 109-118, 2007. https://doi.org/10.1007/s00371-006-0032-4
  10. S. Cardin, D. Thalmann, and F. Vexo, "Wearable Obstacle Detection System for Visually Impaired People," VR Workshop on Haptic and Tactile Perception of Deformable Objects, 2005.
  11. O. Hameed, B. Naseem, J. Iqbal, M. Ahmad, and O. Anwar, "Assistive Technology-Based Navigation Aid for the Visually Impaired," Proceedings of the 7th WSEAS International Conference on Robotics, Control & Manufacturing Technology, 2007.
  12. A.W. Divelbiss and J.T. Wen, "A Path Space Approach to Nonholonomic Motion Planning in the Presence of Obstacles," IEEE Transactions on Robotics and Automation, Vol.13, No.3, pp. 443-451, 1997. https://doi.org/10.1109/70.585905
  13. H. Hu, D. Gu, and M. Brady, "Navigation and Guidance of An Intelligent Mobile Robot," Second Euromicro Workshop on Advanced Mobile Robots (EUROBOT '97), pp. 104-111, 1997.
  14. K. Jiang, L.D. Seveviratine, S.W.E. Earles, "A Shortest Path Based Path Planning Algorithm for Nonholonomic Mobile Robots," Journal of Intelligent and Robotic Systems, pp. 347-366, 1999.
  15. H. Mori, and S. Kotani, "Robotic travel aid for the blind: HARUNOBU-6," Proceedings of the 2nd European Conference on Disability, Virtual Reality & Assistive Technology, pp. 193-202, 1998.
  16. J. Borenstein, and I. Ulrich, "The GuideCane : A Computerized Travel Aid for the Active Guidance of Blind Pedestrians," Proceedings of the IEEE International Conference on Robotics and Automation, pp 1283-1288, 1997.
  17. S. Tachi, K. Komiyama, and M. Abe, "Electrocutaneous Communication in Seeingeye Robot(MELDOG)," Proceedings 4th Annual Conference IEEE Engineering in Medicine and Biology Society, pp. 356-361, 1982.
  18. J.H. Kang, B.S. Song, K.H. Yu, and M.J. Yoon, "Walking Guide Robot with Tactile Display and 3D Ultrasonic Sensing System for the Blind," The 21st International Technical Conference on Circuits/Systems, Computers and Communications, 2006.
  19. M.J. Yoon, K.H. Yu, J.H. Kang, and N.G. Kim, "Walking Guide Robot with Tactile Display for the Blind," Proceedings of SPIE, Vol.6040, 2005.
  20. K. Soeda, S. Aoki, K. Yanashima, and K. Magatani, "Development of the Visually Impaired Person Guidance System Using GPS," Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vol.7, pp. 4870-4873, 2004.
  21. P.E. Hart, N.J. Nilsson, and B. Raphael, "A Formal Basis for the Heuristic Determination of Minimum Cost Paths," IEEE Transactions on Systems Science and Cybernetics, Vol.4, No.2, pp. 100-107, 1968. https://doi.org/10.1109/TSSC.1968.300136
  22. 이진희, 신병석, "초음파 센서의 효과적인 배열을 통한 시각장애인 보행 보조 시스템," 한국차세대컴퓨팅학회논문지, 제4권, 제1호, pp. 31-39, 2008.
  23. J.E. Kim, J.H. Han, and C.G. Lee, "Optimal 3-Coverage with Minimum Separation Requirements for Ubiquitous Computing Environments," ACM/Springer Mobile Networks and Applications, Vol.14, No.5, pp. 556-570, 2008.
  24. 이석, 김현희, 임정학, 김성훈, "초전 센서 기반 실내 위치 인식 시스템," 한국멀티미디어학회논문지, 제12권, 제13호, pp. 46-56, 2008.
  25. 임현, 이영삼, "영상 증강현실 구현을 위한 카메라 자세 추정 방법," 한국차세대컴퓨팅학회논문지, 제3권, 제3호, pp. 39-48, 2007.
  26. J.H. Lee, E.K. Choi, S.H. Lim, and B.S. Shin, "Wearable Computer System Reflecting Spatial Context," Proceedings of the 2008 IEEE International Workshop on Semantic Computing and Applications, pp. 153-159, 2008.

Cited by

  1. 야간 보행자인식을 위한 적외선 동영상의 형상특징벡터 생성기법 vol.21, pp.7, 2011, https://doi.org/10.9717/kmms.2018.21.7.755