Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Development of Hybrid Image Stabilization System for a Mobile Robot

이동 로봇을 위한 하이브리드 이미지 안정화 시스템의 개발

  • Received : 2010.12.21
  • Accepted : 2010.12.30
  • Published : 2011.02.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a hybrid image stabilizing system which uses both optical image stabilizing system based on EKF (Extended Kalman Filter) and digital image stabilization based on SURF (Speeded Up Robust Feature). Though image information is one of the most efficient data for object recognition, it is susceptible to noise which results from internal vibration as well as external factors. The blurred image obtained by the camera mounted on a robot makes it difficult for the robot to recognize its environment. The proposed system estimates shaking angle through EKF based on the information from inclinometer and gyro sensor to stabilize the image. In addition, extracting the feature points around rotation axis using SURF which is robust to change in scale or rotation enhances processing speed by removing unnecessary operations using Hessian matrix. The experimental results using the proposed hybrid system shows its effectiveness in extended frequency range.

Keywords

References

  1. Jesse S. Jin, Member, Z. Zhu, and G. Xu, “A stable vision system for moving vehicles,” IEEE Transactions on Intelligent Transportation Systems, vol. 1, no. 1, pp. 32-39, Mar. 2000. https://doi.org/10.1109/6979.869019
  2. K. Kawano, I. Hirokazu, Y. Shunya, and K. Kazuhide, “Development of new camera stabilizer ACE-3000,” Technology Report, Japan Aviation Electronics Industry, Ltd, vol. 23, pp. 85-89, 2000.
  3. K. Sato, S. Ishizuka, A. Nikami, and M. Sato, “Control techniques for optical image stabilizing system,” IEEE Trans. on Consumer Electronics, vol. 39, no. 3, pp. 461-466, 1993. https://doi.org/10.1109/30.234621
  4. R. Kurazume and S. Hirose, “An experimental study of teleoperation system for walking robots using high-speed image stabilization system” Journal of the Robotics Society of Japan, vol. 18, no. 7, pp. 1011-1018, 2000. https://doi.org/10.7210/jrsj.18.1011
  5. J.-Y. Chang, W.-F. Hu, M.-H. Cheng, and B.-S. Chang, “Digital image translational and rotational motion stabilization using optical flow technique,” IEEE Transactions on Consumer Electronics, vol. 48, no. 1, Feb. 2002. https://doi.org/10.1109/TCE.2002.1010098
  6. K. Hayashi, Y. Yokokohji, and T. Yoshikawa, “Tele-existence vision system with image stabilization for rescue robots,” Proc. of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain, pp. 50-55. 2006.
  7. Y.-W. Choi, T.-H. Kang, and S.-G. Lee, “The development of an image stabilization system using an extended Kalman filter used in a mobile robot,” Journal of the Korea Robotics Society, vol. 5, no. 4, pp. 85-92, 2010.
  8. H.-J. Lee, Y.-W. Choi, T.-H. Kang, and S.-G. Lee, “Digital image stabilization based on edge detection and lucas-kanade optical flow,” Journal of the Korea Robotics Society, vol. 5, no. 2, pp. 85-92, 2010. 5.
  9. S.-J. Ko, S.-H. Lee, and K.-H. Lee, “Digital image stabilizing algorithms based on bit-plane matching,” IEEE Transactions on Consumer Electronics, vol. 44, no. 3, Aug. 1998. https://doi.org/10.1109/30.713172
  10. F. A. Ibrahim, “Optimal linear neuron learning and Kalman filter based backpropagation neural network for DGPS/INS integration,” Position, Location and Navigation Symposium, 2008 IEEE/ION, Monterey, CA, pp. 1175-1189, May 2008.
  11. B. Golik, “Development of a test method for image stabilizing systems,” Diploma Thesis at the Department of Imaging Sciences and Media Technology Cologne University of Applied Sciences, 2006.
  12. K. Uomori, A. Morimura, H. Ishii, T. Sakaguchi, and Y. Kitamura, “Automatic image stabilizing system by full-digital signal processing,” IEEE Transactions on Consumer Electronics, vol. 26, pp. 510-519, Aug. 1990. https://doi.org/10.1109/30.103167
  13. Y.-C. Peng, H.-A. Chang, C. J. Kao, and H. Homer, “Digital image stabilization and its integration with video encoder,” Proc. Consumer Communications and Networking Conference, pp. 544-549, Jan. 2004.
  14. J. Telleen, A. Sullivan , J. Yee, O. Wang, P. Gunawardane, I. Collins, and J. Davis, “Synthetic shutter speed imaging,” Journal compilation ${\copyright}$2007 The Eurographics Association and Blackwell Publishing Ltd. vol. 26, no. 3, 2007. https://doi.org/10.1111/j.1467-8659.2007.01082.x
  15. S. Erturk, “Real-time digital image stabilization using Kalman filters,” Real-Time Imaging, vol. 8, no. 4, pp. 317-328, Aug. 2002. https://doi.org/10.1006/rtim.2001.0278
  16. A. Litvin, J. Konrad, and W. C. Karl, “Probabilistic video stabilization using Kalman filtering and mosaicking,” Proc. of SPIE-IS&T Electronic Imaging, vol. 5022, Santa Clara, 2003.
  17. H.-K. Kwak and J. Lyou, “Euler angle-based global motion estimation model for digital image stabilization,” Journal of Institute of Control, Robotics and Systems, vol. 16, no. 11, pp. 1053-1059, Nov. 2010. https://doi.org/10.5302/J.ICROS.2010.16.11.1053
  18. J. K. Park, Y. G. Bae, and S. Jung, “Experimental studies of a time-delayed controller to stabilize image stabilization system,” Journal of Institute of Control, Robotics and Systems, vol. 13, no. 1, pp. 58-64, Jan. 2007.