Vision Sensor-Based Driving Algorithm for Indoor Automatic Guided Vehicles

  • Quan, Nguyen Van ;
  • Eum, Hyuk-Min ;
  • Lee, Jeisung ;
  • Hyun, Chang-Ho
  • Received : 2013.05.14
  • Accepted : 2013.06.23
  • Published : 2013.06.25


In this paper, we describe a vision sensor-based driving algorithm for indoor automatic guided vehicles (AGVs) that facilitates a path tracking task using two mono cameras for navigation. One camera is mounted on vehicle to observe the environment and to detect markers in front of the vehicle. The other camera is attached so the view is perpendicular to the floor, which compensates for the distance between the wheels and markers. The angle and distance from the center of the two wheels to the center of marker are also obtained using these two cameras. We propose five movement patterns for AGVs to guarantee smooth performance during path tracking: starting, moving straight, pre-turning, left/right turning, and stopping. This driving algorithm based on two vision sensors gives greater flexibility to AGVs, including easy layout change, autonomy, and even economy. The algorithm was validated in an experiment using a two-wheeled mobile robot.


Automatic guided vehicle;Marker;Path following control;Vision sensor


  1. Y. J. Lee and Y. J. Ryoo, "Navigation of unmanned vehicle using relative localization and magnetic guidance," Journal of Korean Institute of Intelligent Systems, vol. 21, no. 4, pp. 430-435, Aug. 2011.
  2. G. Alenya, J. Escoda, A. B.Martinez, and C. Torras, "Using laser and vision to locate a robot in an industrial environment: a practical experience," in Proceedings of the 2005 IEEE International Conference on Robotics
  3. M. Lee, J. Han, C. Jang, and M. Sunwoo, "Information fusion of cameras and laser radars for perception systems of autonomous vehicles," Journal of Korean Institute of Intelligent Systems, vol. 23, no. 1, pp. 35-45, Feb. 2013.
  4. G. N. Desouza and A. C. Kak, "Vision for mobile robot navigation: a survey," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 2, pp. 237-267, Feb. 2002.
  5. S. Badal, S. Ravela, B. Draper, and A. Hanson, "A practical obstacle detection and avoidance system," in Proceedings of the 2nd IEEE Workshop on Applications of Computer Vision, Sarasota, FL, 1994, pp. 97-104.
  6. H. I. Christensen, N. O. Kirkeby, S. Kristensen, L. Knudsen, and E. Granum, "Model-driven vision for in-door navigation," Robotics and Autonomous Systems, vol. 12, n. 2-3, pp. 199-207, Apr. 1994.
  7. N. X. Dao, B. J. You, and S. R. Oh, "Visual navigation for indoor mobile robots using a single camera," in Proceedings of 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, pp. 1992-1997, 2005.
  8. J. Park, W. Rasheed, and J. Beak, "Robot navigation using camera by identifying arrow signs," in Proceedings of the 3rd International Conference on Grid and Pervasive Computing Workshops, Kunming, 2008, pp. 382-386.
  9. H. Hu and D. Gu, "Landmark-based navigation of industrial mobile robots," International Journal of Industrial Robot, vol. 27, no. 6, pp. 458-467, 2000.
  10. M. T. Chao, T. Braunl, and A. Zaknich, "Visually-guided obstacle avoidance," in Proceedings of the 6th International Conference on Neural Information Processing, Perth, WA, 1999, pp. 650-655.
  11. J. W. Lee, S. U. Choi, C. H. Lee ,Y. J. Lee, and K. S. Lee, "A study for AGV steering control and identification using vision system," in Proceedings of 2001 IEEE International Symposium on Industrial Electronics, Pusan, 2011, pp. 1575-1578.
  12. J. T. Cho and B. H. Nam, "A study on the fuzzy control navigation and the obstacle avoidance of mobile robot using camera," in Proceedings of 2000 IEEE International Conference on Systems, Man, and Cybernetics, Nashville, TN, 2000, pp. 2993-2997.
  13. T. S. Jin, K. Morioka, and H. Hashimoto, "Appearance based object identification for mobile robot localization in intelligent space with distributed vision sensors," International Journal of Fuzzy Logic and Intelligent Systems, vol. 4, no. 2, pp. 165-171, Sep. 2011.
  14. W. H. Lee, H. W. Lee, S. H. Kim, J. Y. Jung, and T. J. Roh, "Moving path following and high speed precision control of autonomous mobile robot using fuzzy," Journal of Korean Institute of Intelligent Systems, vol. 14, no. 7, pp. 907-913. Dec. 2004.
  15. D. H. Min, K. W. Jung, K. Y. Kwon, and J. Y. Park, "Application of recent approximate dynamic programming methods for navigation problems," Journal of Korean Institute of Intelligent Systems, vol. 21, no. 6, pp. 737-742. Dec. 2011.
  16. D. Chapman, Teach Yourself Visual C++ 6 in 21 Days, Indianapolis: Sams, 1998.
  17. R. C. Gonzalez and R. E. Woods, Digital Image Processing, 3rd ed., Harlow: Prentice Hall, 2007.
  18. R. Szeliski, Computer Vision: Algorithms and Applications, New York: Springer, 2010.
  19. G. A. Baxes, Digital Image Processing: Principles and Applications, 1st ed., New York : Wiley, 1994.

Cited by

  1. Analysis of Indoor Robot Localization Using Ultrasonic Sensors vol.14, pp.1, 2014,
  2. Design of Simple-Structured Fuzzy Logic Systems for Segway-Type Mobile Robot vol.15, pp.4, 2015,
  3. Design of Vectored Sum-Based Fuzzy Logic Control System and Its Application to Segway-Type Mobile Robot vol.14, pp.02, 2017,