Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Hand Shape Classification using Contour Distribution

윤곽 분포를 이용한 이미지 기반의 손모양 인식 기술

  • Lee, Changmin (School of Electrical and Electronic Engineering, Yonsei University) ;
  • Kim, DaeEun (School of Electrical and Electronic Engineering, Yonsei University)
  • 이창민 (연세대학교 전기전자공학과) ;
  • 김대은 (연세대학교 전기전자공학과)
  • Received : 2014.02.15
  • Accepted : 2014.03.30
  • Published : 2014.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

Hand gesture recognition based on vision is a challenging task in human-robot interaction. The sign language of finger spelling alphabets has been tested as a kind of hand gesture. In this paper, we test hand gesture recognition by detecting the contour shape and orientation of hand with visual image. The method has three stages, the first stage of finding hand component separated from the background image, the second stage of extracting the contour feature over the hand component and the last stage of comparing the feature with the reference features in the database. Here, finger spelling alphabets are used to verify the performance of our system and our method shows good performance to discriminate finger alphabets.

Keywords

References

  1. J. Kofman, X. Wu, T. J. Luu, and S. Verma, "Teleoperation of a robot manipulator using a vision- based human-robot interface," Industrial Electronics, IEEE Transactions on, vol. 52 no. 5, pp. 1206-1219. Oct. 2005. https://doi.org/10.1109/TIE.2005.855696
  2. C. Hu, M. Q. Meng, P. X. Liu, and X. Wang, "Visual gesture recognition for human-machine interface of robot teleoperation," Intelligent Robots and Systems, 2003.(IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, vol. 2, pp. 1560-1565, Oct. 2003.
  3. A. K. Jain, A. Ross, and S. Prabhakar, "An introduction to biometric recognition," IEEE Trans. on Circuits and Systems for Video Technology, vol. 14, no. 1, 4-20.
  4. K. Delac and M. Grgic, "A survey of biometric recognition methods," Electronics in Marine, 2004. Proceedings Elmar 2004. 46th International Symposium, pp. 184-193, Jun. 2004.
  5. E. Yoruk, E. Konukoglu, B. Sankur, and J. Darbon, "Shape-based hand recognition," Image Processing, IEEE Transactions on, vol. 15, no. 7, pp. 1803-1815, Jul. 2006. https://doi.org/10.1109/TIP.2006.873439
  6. Y. Bulatov, S. Jambawalikar, P. Kumar, and S. Sethia, "Hand recognition using geometric classifiers," Springer Berlin Heidelberg In Biometric Authentication, pp. 753-759, 2004.
  7. Q. Munib, M. Habeeb, B. Takruri, and H. A. Al-Malik, "ASL (American Sign Language) recognition based on Hough transform and neural networks," Expert Systems with Applications, vol. 32, no. 1, pp. 24-37, Jan. 2007. https://doi.org/10.1016/j.eswa.2005.11.018
  8. J. Lee, E. Jeong, and D. E. Kim, "Development of Sensor System for Finger Gesture," The Korean Society of Broadcast Engineers, pp. 4-5, Jul. 2011.
  9. D. J. Sturman and D. Zeltzer, "A survey of glove-based input," Computer Graphics and Applications, IEEE, vol. 14, no. 1, pp. 30-39, Jan. 1994 https://doi.org/10.1109/38.250916
  10. N. Pugeault and R. Bowden, "Spelling it out: Real-time asl fingerspelling recognition," In Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on, pp. 1114-1119, Nov. 2011.
  11. M. Van den Bergh and L. Van Gool, "Combining RGB and ToF cameras for real-time 3D hand gesture interaction," In Applications of Computer Vision (WACV), 2011 IEEE Workshop on, pp. 66-72, Jan. 2011.
  12. J. C. Terrillon, M. N. Shirazi, H. Fukamachi, and S. Akamatsu, "Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images," In Automatic Face and Gesture Recognition, 2000. Proceedings. Fourth IEEE International Conference on, pp. 54-61. 2000.
  13. P. Viola and M. J. Jones, "Robust real-time face detection," International journal of computer vision, vol. 57, no. 2, pp. 137-154, May 2004. https://doi.org/10.1023/B:VISI.0000013087.49260.fb
  14. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, vol. 1, pp. 886-893, Jun. 2005.
  15. R. L. Hsu, M. Abdel-Mottaleb, and A. K. Jain, "Face detection in color images," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 24, no. 5, pp. 696-706, May 2002. https://doi.org/10.1109/34.1000242
  16. C. Garcia and G. Tziritas, "Face detection using quantized skin color regions merging and wavelet packet analysis," Multimedia, IEEE Transactions on, vol. 1, no. 3, pp. 264-277, Sep. 1999. https://doi.org/10.1109/6046.784465
  17. M. Abdel-Mottaleb and A. Elgammal, "Face detection in complex environments from color images," Image Processing, 1999. ICIP 99. Proceedings. 1999 International Conference on, vol. 3, pp. 622-626, 1999.
  18. C. Charayaphan and A. E. Marble, "Image processing system for interpreting motion in American Sign Language," Journal of Biomedical Engineering, vol. 14, no. 5, pp. 419-425, Sep. 1992. https://doi.org/10.1016/0141-5425(92)90088-3
  19. T. E. Starner, "Visual recognition of american sign language using hidden markov models," MAssachusetts Inst of Tech Cambridge Dept of Brain and Cognitive Sciences, 1995.
  20. R. H. Liang and M. Ouhyoung, "A real-time continuous gesture recognition system for sign language," Automatic Face and Gesture Recognition, 1998. Proceedings. Third IEEE International Conference on. IEEE, pp. 558-567, Apr. 1998.
  21. W. C. Stokoe, "Sign language structure: An outline of the visual communication systems of the American deaf," Journal of Deaf Studies and Deaf Education, vol. 10, no. 1, pp. 3-37, 2005. https://doi.org/10.1093/deafed/eni001
  22. R. Cutler and M. Turk, "View-based interpretation of real- time optical flow for gesture recognition," 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG). IEEE Computer Society, pp. 416-416, Apr. 1998.
  23. J. L. Hernandez-Rebollar, R. W. Lindeman, and N. Kyriakopoulos, "A multi-class pattern recognition system for practical finger spelling translation," Proc. of the 4th IEEE International Conference on Multimodal Interfaces. IEEE Computer Society, p. 185, Mar. 2002.
  24. I. M. Kim, W. C. Kim, K. S. Yun, and J. M. Lee, "Navigation of a mobile robot using hand gesture recognition," Jounal of Institute of Control, Robotics and Systems (in Korean), vol. 8, no. 7, Jul. 2002. https://doi.org/10.5302/J.ICROS.2002.8.7.599
  25. H. Wu, Q. Chen, and M. Yachida, "Face detection from color images using a fuzzy pattern matching method," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 21, no. 6, pp. 557-563, Jun. 1999. https://doi.org/10.1109/34.771326
  26. J. Canny, "A computational approach to edge detection," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 6, pp. 679-698, Nov. 1986.
  27. D. Kim, D. M. Kim, and J. Suk, "Vision processing for precision autonomous landing approach of an unmanned helicopter," Jounal of Institute of Control, Robotics and Systems (in Korean), vol. 15, no. 1, Jan. 2009. https://doi.org/10.5302/J.ICROS.2009.15.1.054

Cited by

  1. HSV Color Model based Hand Contour Detector Robust to Noise vol.18, pp.10, 2015, https://doi.org/10.9717/kmms.2015.18.10.1149
  2. Modeling Jamming Avoidance Response of Pulse-type Weakly Electric Fish vol.21, pp.10, 2015, https://doi.org/10.5302/J.ICROS.2015.15.0017