Hand Gesture Recognition Algorithm Robust to Complex Image

복잡한 영상에 강인한 손동작 인식 방법

  • 박상윤 (동명대학교 대학원 정보통신공학과) ;
  • 이응주 (동명대학교 정보통신공학과)
  • Received : 2009.11.12
  • Accepted : 2010.04.15
  • Published : 2010.07.31


In this paper, we propose a novel algorithm for hand gesture recognition. The hand detection method is based on human skin color, and we use the boundary energy information to locate the hand region accurately, then the moment method will be employed to locate the hand palm center. Hand gesture recognition can be separated into 2 step: firstly, the hand posture recognition: we employ the parallel NNs to deal with problem of hand posture recognition, pattern of a hand posture can be extracted by utilize the fitting ellipses method, which separates the detected hand region by 12 ellipses and calculates the white pixels rate in ellipse line. the pattern will be input to the NNs with 12 input nodes, the NNs contains 4 output nodes, each output node out a value within 0~1, the posture is then represented by composed of the 4 output codes. Secondly, the hand gesture tracking and recognition: we employed the Kalman filter to predict the position information of gesture to create the position sequence, distance relationship between positions will be used to confirm the gesture. The simulation have been performed on Windows XP to evaluate the efficiency of the algorithm, for recognizing the hand posture, we used 300 training images to train the recognizing machine and used 200 images to test the machine, the correct number is up to 194. And for testing the hand tracking recognition part, we make 1200 times gesture (each gesture 400 times), the total correct number is 1002 times. These results shows that the proposed gesture recognition algorithm can achieve an endurable job for detecting the hand and its' gesture.


Supported by : 중소기업청


  1. K. Fukushima, "Neural Network Model for Selective Attention in Visual Pattern Recognition and Associative Recall," Applied Optics 26, pp. 4985-4992, 1987. https://doi.org/10.1364/AO.26.004985
  2. P. Dayan, S. Kakade, and P. R. Montague, "Learning and selective attention," Nature Neuroscience 3, pp. 1218-1223, 2000. https://doi.org/10.1038/81504
  3. Francis K. H. Quek, "Unencumbered gestural interaction," IEEE MultiMedia, Vol.3, No.4, pp. 36-47, Winter, 1996. https://doi.org/10.1109/93.556459
  4. R. P. N.Rao and A. N. Meltzoff, "Imitation Leaning in Infants and Robots: Towards Probabilistic Computational Models," Proceedings of Artificial Intelligence and Simulation of Behaviors, 2003.
  5. S. Cali non and A. Billard, "Stochastic Gesture Production and Recognition Model for a Humanoid Robot," Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2769-2774, 2004.
  6. Y. Hamada, N. Shamada, and Y. Shirai, "Hand Shape Estimation Using Image Transition Network," Proc. Of Workshop on Human Motion, pp. 161-166, 2000.
  7. E. Ong and R. Bowden, "A Boosted Classifier Tree for Hand Shape Detection," Sixth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 889-894, 2004.
  8. V. Athitsos and S. Sclaroff, "An Appearance-Based Framework for 3D Hand Shape Classification and Camera Viewpoint Estimation," Proc. of Face and Gesture Recognition, 2002.
  9. Ihanb Zaqout, Roziati Zainuddin, and Sapian Baba, "Pixel-based skin color detection technique," Machine Graphics & Vision International Journal Volume 14, Issue 1 pp. 61-70, 2005.
  10. P. Peer, J. Kovac, and F. Solina, "Human skin color clustering for face detection," In submitted to EUROCON 2003-International Conference on Computer as a Tool, 2003.
  11. W. Sharbek and A. Koshan, "Color Image Segmentation - a survey-," Tech. Rep., Institute for Technical Informatics. Technical University of Berlin, October, 1994.
  12. I. T. Young, J. E. Walker, and J. E. Bowie, "An Analysis Technique for Biological Shape. I," Information and Control, 25: pp. 357-370, 1974. https://doi.org/10.1016/S0019-9958(74)91038-9
  13. M. K. Hu, "Pattern Recognition by Moment Invariants," Proc. IEEE, Vol 49, No.9, pp. 1428, Sept. 1961.
  14. M. K. Hu, "Visual Pattern Recognition by Moment Invariants," IRE Transactions on Information Theory, Vol.17-8, No.2, pp. 179-187, Feb. 1962.
  15. A. P. Reeves and A. Rostampour, "Shape Analysis of Segmented Objects Using Moments," Proc. IEEE Conf on Pattern Recognition and Image Processing, pp. 171-174, 1981.
  16. R. Y. Wong and E. L. Hall, "Scene Matching with Invariant Moments," Computer Graphics and Image Processing, Vol.8, No.1, pp. 16-24, Aug. 1978. https://doi.org/10.1016/S0146-664X(78)80028-8
  17. Caglar, M.B. and Lobo, N., "Open Hand Detection in a Cluttered Single Image using Finger Primitives," 2006 Conference on Computer Vision and Pattern Recognition Workshop, pp. 17-22, June 2006.
  18. Cheung-Wen Chang and Yung-Nien Sun, "Hand Detections Based on Invariant Skin-Color Models Constructed Using Linear and Nonlinear Color Spaces," Intelligent Information Hiding and Multimedia Signal Processing, pp. 577-580, pp. 15-17, Aug. 2008.
  19. R. Setiono, "Feedforward neural network construction using cross validation," Neural Computer., Vol.13, pp. 2865-2877, 2001. https://doi.org/10.1162/089976601317098565