Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

The Development of a Real-Time Hand Gestures Recognition System Using Infrared Images

적외선 영상을 이용한 실시간 손동작 인식 장치 개발

  • Ji, Seong Cheol (Dept. of Electronics Engineering, Hoseo University) ;
  • Kang, Sun Woo (Dept. of Electronics Engineering, Hoseo University) ;
  • Kim, Joon Seek (Dept. of Electronics Engineering, Hoseo University) ;
  • Joo, Hyonam (Dept. of Digital Display Engineering, Hoseo University)
  • 지성철 (호서대학교 전자공학과) ;
  • 강선우 (호서대학교 전자공학과) ;
  • 김준식 (호서대학교 전자공학과) ;
  • 주효남 (호서대학교 디지털디스플레이공학과)
  • Received : 2015.08.10
  • Accepted : 2015.11.20
  • Published : 2015.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

A camera-based real-time hand posture and gesture recognition system is proposed for controlling various devices inside automobiles. It uses an imaging system composed of a camera with a proper filter and an infrared lighting device to acquire images of hand-motion sequences. Several steps of pre-processing algorithms are applied, followed by a background normalization process before segmenting the hand from the background. The hand posture is determined by first separating the fingers from the main body of the hand and then by finding the relative position of the fingers from the center of the hand. The beginning and ending of the hand motion from the sequence of the acquired images are detected using pre-defined motion rules to start the hand gesture recognition. A set of carefully designed features is computed and extracted from the raw sequence and is fed into a decision tree-like decision rule for determining the hand gesture. Many experiments are performed to verify the system. In this paper, we show the performance results from tests on the 550 sequences of hand motion images collected from five different individuals to cover the variations among many users of the system in a real-time environment. Among them, 539 sequences are correctly recognized, showing a recognition rate of 98%.

Keywords

References

  1. M. Na, J. Choi, and T. Kim, "Vision-based real-time hand interface method for smart device control," Proc. of HCI Society of Korea 2013, Jeongseon, South Korea, pp. 89-93, Jan. 2013.
  2. T. Ha and W. Woo, "Video see-through HMD based hand interface for augmented reality," Proc. of HCI Society of Korea 2006, Pyoungchang, South Korea, pp. 169-174, Feb. 2006.
  3. L.-K. Lee, S.-Y. An, and S.-Y. Oh, "A robust fingertip exteaction and extended CAMSHIFT based hand gesture recognition for natural human-like human-robot interaction," Journal of Institute of Control, Robotics and Systems (in Korean), vol. 18, no. 4, pp. 328-336, 2012. https://doi.org/10.5302/J.ICROS.2012.18.4.328
  4. Z. Ren, J. Meng, and J. Yuan, "Depth camera based hand gesture recognition and its applications in human-computer-interaction," IEEE Conference on Information, Communications and Signal Processing, pp. 1-5, 2011.
  5. J.-Y. Ha, M.-H. Lee, and H.-I. Choi, "Hand gesture recognition using HMM (Hidden Markov Mode)," Journal of Digital Contents Society (in Korean), vol. 10, no. 2, pp. 291-298, 2009.
  6. P. Molchanov, S. Gupta, K. Kim, and K. Pulli, "Multi-sensor system for driver's hand-gesture recognition," IEEE Conference on Automatic Face and Gesture Recognition, pp. 1-8, 2015.
  7. Y.-K. Ahn and J.-I. Kwon, "Hand gesture recognition interface based on IR camera," Proc. of The Institute of Electronics and Information Engineers 2013, Jeju, South Korea, vol. 36, no. 1, pp. 750-753, Jul. 2013.
  8. A. R. Sarkar, G. Sanyal, and S. Majumder, "Hand gesture recognition systems: A survey," International Journal of Computer Applications, vol. 71, no. 15, pp. 26-37, May 2014.
  9. J. S. Suri and A. A. Farag, Deformable Models: Biomedical and Clinical Applications, Springer Science & Business Media, pp. 33-60, 2007.
  10. E. Yoruk, E. Konukoglu, B. Sankur, and J. Darbon, "Shape-based hand recognition," IEEE Trans. on Image Processing, vol. 15, no. 7, pp. 1803-1815, Jul. 2006. https://doi.org/10.1109/TIP.2006.873439
  11. I. Lee and C. Park, "Real-time gesture recognition using boundary of human hands from sequence images," Proc. of Science of Emotion & Sensibility 1999, South Korea, pp. 438-442, Nov. 1999.