The Transactions of the Korean Institute of Electrical Engineers D (대한전기학회논문지:시스템및제어부문D)

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지

A Study on Dynamic Hand Gesture Recognition Using Neural Networks

신경회로망을 이용한 동적 손 제스처 인식에 관한 연구

  • 조인석 (부산대 전기공학과) ;
  • 박진현 (진주산업대 메카트로닉스공학과) ;
  • 최영규 (부산대 전자전기정보컴퓨터공학부)
  • Published : 2004.01.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper deals with the dynamic hand gesture recognition based on computer vision using neural networks. This paper proposes a global search method and a local search method to recognize the hand gesture. The global search recognizes a hand among the hand candidates through the entire image search, and the local search recognizes and tracks only the hand through the block search. Dynamic hand gesture recognition method is based on the skin-color and shape analysis with the invariant moment and direction information. Starting point and ending point of the dynamic hand gesture are obtained from hand shape. Experiments have been conducted for hand extraction, hand recognition and dynamic hand gesture recognition. Experimental results show the validity of the proposed method.

Keywords

References

  1. D. M. Gavrila, 'The visual analysis of human movement: a survey.' IDEAL Computer Vision and Image Understanding, vol. 73, No.1, pp. 82-98, January 1999 https://doi.org/10.1006/cviu.1998.0716
  2. D. J. Sturman, 'A survey of glove-based input,' IEEE Computer Graphics & Applications, pp. 30-39, Jan. 1994 https://doi.org/10.1109/38.250916
  3. E. Y. Cha and M. H. Kang, 'Multiple target tracking in clutter backgrounds using self-organizing map,' IEEE International Joint Conference on Neural Networks, vol. 2, pp. 1162-1165, 1998 https://doi.org/10.1109/IJCNN.1998.685937
  4. R. M. Haralick and L. G. Shapiro, Computer and Robot Vision, 1,2, Addison-Wesley, 1993
  5. P. A. Laplante and A. D. Stoyenko, Realtime Imaging : Theory, Techniques and Application, IEEE Press, 1996
  6. T. M. Chen, Ren C. Luo and T. H. Hsiao, 'Visual tracking using adaptive color histogram model,' Proceedings of IECON, vol. 3, pp. 1336-1341, 1999 https://doi.org/10.1109/IECON.1999.819405
  7. W. Kim and J. J. Lee, 'Visual tracking using snake algorithm based on optical flow information,' Proceedings of the 14th KACC, pp. E13-E16, 1999
  8. A. McAulay, A. Coker and K. Saruhan, 'Effect of noise in moment invariant neural network aircraft classification,' Proceedings of NAECON, pp. 743-749, 1991 https://doi.org/10.1109/NAECON.1991.165835
  9. H. K. Lee and J. H. Kim, 'An HMM-based threshold model approach for gesture recognition,' IEEE Transactions on Pattern Analysis and Manchine Intelligence, vol. 21, No. 10, October 1999 https://doi.org/10.1109/34.799904
  10. 오창석, 뉴로 컴퓨터, 지성 출판사, pp. 1-13, 1996
  11. J. S. R. Jang, C. T. Sun and E. Mizutani, Neuro-Fuzzy and Soft Computing, Prentice Hall, 1997
  12. 임영도, 퍼지.신경망.유전진화, 인솔미디어, pp. 107-144, 1999
  13. R. Kjeldsen and J. Kender, 'Finding skin in color images,' Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, pp. 312-317, 1996
  14. Y. Kanai, 'Images segmentation using intensity and color information' Proceedings of the IEEE Conference color information' Proceedings of the IEEE Conference on Visual Communications and Image Processing, 1997 https://doi.org/10.1117/12.298383
  15. L. Jorde, M. Perrone, J.P. Costeira, 'Active face and feature tracking,', Proceedings of International Conference on Image Analysis and Processing, pp. 572-576, 1999 https://doi.org/10.1109/ICIAP.1999.797657
  16. J. C. Terrillon, M. David and S. Akamatsu, 'Automatic detection of human faces in natural scene images by use of skin color model and of invariant moment,' Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 112-117, 1998 https://doi.org/10.1109/AFGR.1998.670934
  17. R. M. Haralick and L. G. Shapiro, Computer and Robot Vision, vol. 1. Addison-Wesley, 1993
  18. S. Birchfield, 'An elliptical head tracker,' Conference Record of the Thirty-First Asilomar Conference on Signals, Systems & Computers, vol. 2, pp.171O-1714, 1997 https://doi.org/10.1109/ACSSC.1997.679194
  19. R. C. Gonzalez and R. E. Woods, Digital Image Processing, Addison Wesley, pp. 518-522, 1993