Appearance-based Robot Visual Servo via a Wavelet Neural Network

  • Zhao, Qingjie (Beijing Laboratory of Intelligent Information Technology, School of Computer Science and Technology, Beijing Institute of Technology) ;
  • Sun, Zengqi (Department of Computer Science and Technology, Tsinghua University) ;
  • Sun, Fuchun (Department of Computer Science and Technology, Tsinghua University) ;
  • Zhu, Jihong (Department of Computer Science and Technology, Tsinghua University)
  • Published : 2008.08.31

Abstract

This paper proposes a robot visual servo approach based on image appearance and a wavelet function neural network. The inputs of the wavelet neural network are changes of image features or the elements of image appearance vector, and the outputs are changes of robot joint angles. Image appearance vector is calculated by using eigen subspace transform algorithm. The proposed approach does not need a priori knowledge of the robot kinematics, hand-eye geometry and camera models. The experiment results on a real robot system show that the proposed method is practical and simple.

Keywords

References

  1. W. T. Miller, "Sensor based control of robotic manipulators using a general learning algorithm," IEEE Journal of Robotics Automation, vol. 3, no. 2, pp. 157-165, 1987 https://doi.org/10.1109/JRA.1987.1087081
  2. R. M. Martinetz, H. J. Ritter, and K. J. Schulten, "Three-dimensional neural net for learning visuo-motor coordination of a robot arm," IEEE Trans. on Neural Networks, vol. 1, pp. 131-136, Mar. 1990 https://doi.org/10.1109/72.80212
  3. J. A. Walter and K. J. Schulten, "Implementation of self-organizing neural networks for visuomotor control of an industrial robot," IEEE Trans. on Neural Networks, vol. 4, pp. 86-95, Jan. 1993 https://doi.org/10.1109/72.182698
  4. K. Hashimoto, T. Kimoto, and T. Ebine, "Manipulator control with image-based visual servo," Proc. of IEEE Conf. Robotics and Automation, pp. 2267-2272, 1991
  5. M. Rosenblum and L. S. Davis, "An improved radial basis function network for visual autonomous road following," IEEE Trans. on Neural Networks, vol. 7, pp. 1111-1120, Sept. 1996 https://doi.org/10.1109/72.536308
  6. G. Wells, C. Venaille, and C. Torras, "Promising research vision-based robot servo using neural networks," Image and Vision Computing, vol. 14, pp. 715-732, 1996 https://doi.org/10.1016/0262-8856(96)89022-6
  7. G. Wells and C. Torras, "Selection of image features for robot servo using mutual information," Proc. of IEEE Conf. Robotics and Automation, pp. 2819-2826, 1998
  8. C. Y. Lee, I. K. Jeong, I.-H. Lee, and J. J. Lee, "Motion control of mobile manipulator based on neural networks and error compensation," Proc. of IEEE Int. Conf. Robotics and Automation, pp. 4627-4632, 2004
  9. H. Hagras, A. P. Cornish, M. Colley, V. Callaghan, and G. Clarke, "Evolving spiking neural network controllers for autonomous robots," Proc. of IEEE Conf. Robotics and Automation, pp. 4620-626, 2004
  10. W. Yu, "Stability analysis of visual servoing with sliding-mode estimation and neural compensation," International Journal of Control, Automation, and Systems, vol. 4, no. 5, pp. 545- 558, 2006
  11. J. Feddema and O. Mitchell, "Vision-guided servo with feature-based trajectory generation," IEEE Trans. on Robotics and Automation, vol. 5, pp. 691-700, 1989 https://doi.org/10.1109/70.88086
  12. B. Espiau, F. Chaumette, and F. Rives, "A new approach to visual servo in robotics," IEEE Trans. on Robotics and Automation, vol. 8, pp. 313-326, 1992 https://doi.org/10.1109/70.143350
  13. E. Malis, F. Chaumette, and S. Boudet, "2-1/2-D visual servo," IEEE Trans. on Robotics and Automation, vol. 15, no. 2, pp. 238-250, 1999 https://doi.org/10.1109/70.760345
  14. S. K. Nayar, S. A. Nene, and H. Murase, "Subspace methods for robot vision," IEEE Trans. on Robotics and Automation, vol. 12, pp. 750-758, 1996 https://doi.org/10.1109/70.538979
  15. Q. Zhao and Z. Sun, "Image-based robot motion simulation," Optics Communications, vol. 205, pp. 257-263, 2002 https://doi.org/10.1016/S0030-4018(02)01357-3
  16. Q. Zhang and A. Benveniste, "Wavelet networks," IEEE Trans. on Neural Networks, vol. 3, pp. 889-898, 1992 https://doi.org/10.1109/72.165591
  17. J. Zhang, G. G. Walter, and Y. Miao, "Wavelet neural networks for function learning," IEEE Trans. on Signal Processing, vol. 43, pp. 1458- 1497, 1995
  18. P. Corke and S. Hutchinson, "Real-time vision, tracking and control," Proc. of IEEE Conf. Robotics and Automation, pp. 2267-2272, 2000