IEIE Transactions on Smart Processing and Computing

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지
DOI QR코드

DOI QR Code

MPEG-U-based Advanced User Interaction Interface Using Hand Posture Recognition

  • Han, Gukhee (Department of Multimedia Engineering, Hanbat National University) ;
  • Choi, Haechul (Department of Multimedia Engineering, Hanbat National University)
  • Received : 2016.08.18
  • Accepted : 2016.08.28
  • Published : 2016.08.30
Download PDF
⟨ Previous Next ⟩

Abstract

Hand posture recognition is an important technique to enable a natural and familiar interface in the human-computer interaction (HCI) field. This paper introduces a hand posture recognition method using a depth camera. Moreover, the hand posture recognition method is incorporated with the Moving Picture Experts Group Rich Media User Interface (MPEG-U) Advanced User Interaction (AUI) Interface (MPEG-U part 2), which can provide a natural interface on a variety of devices. The proposed method initially detects positions and lengths of all fingers opened, and then recognizes the hand posture from the pose of one or two hands, as well as the number of fingers folded when a user presents a gesture representing a pattern in the AUI data format specified in MPEG-U part 2. The AUI interface represents a user's hand posture in the compliant MPEG-U schema structure. Experimental results demonstrate the performance of the hand posture recognition system and verified that the AUI interface is compatible with the MPEG-U standard.

Keywords

References

  1. Seok-Ju Hong and Chil-Woo Lee, "Human-Computer Interaction Survey for Intelligent Robot," The Korea Contents Society, Vol. 4, No. 2, pp. 507-511, Feb. 2006.
  2. Anastasios Roussos, Stavros Theodorakis, Vassilis Pitsikalis and Petros Maragos, "Hand tracking and affine shape-appearance handshape subunits in continuous sign language recognition," ECCV Workshop on Sign, Gesture and Activity, Hersonissos, Crete, Greece, Sep. 2010.
  3. Yuh-Rau Wang, Wei-Hung Lin, and Ling Yang, "A novel real time hand detection based on skin-color," Consumer Electronics (ISCE), IEEE 17th International Symposium on, pp. 141-142, Jun. 2013.
  4. Xintao Li, Can Tang, Chun Gong, Sheng Cheng and Jianwei Zhang, "Hand Segmentation Based on Skin Tone and Motion Detection with Complex Backgrounds," Chinese Intelligent Automation Conference, Springer Berlin Heidelberg, Vol. 256, pp. 105-111, Jan. 2013.
  5. Robert Y. Wang and Jovan Popovi' , "Real-Time Hand-Tracking with a Color Glove," ACM Transactions on Graphics, Vol. 28, Issue. 3, No. 63, Aug. 2009.
  6. R. Lockton and A. Fitzgibbon, "Real-time gesture recognition using deterministic boosting," BMVC, pp. 1-10, Sep. 2002.
  7. V. Argyros and S. Sclaroff, "Database indexing methods for 3D hand pose estimation," Gesture Workshop, pp. 288-299. Apr. 2003.
  8. Candescent NUI Samples & Source code http://candescentnui.codeplex.com/SourceControl/latest#CCT.NUI.Visual/ClusterLayer.cs.
  9. S. Malik, "Real-time hand tracking and finger tracking for interaction," CSC2503F Project Report, Department of Computer Science, University of Toronto, Dec. 2003.
  10. C. Davatzikos and J. L. Prince, "Convexity analysis of active contour problems," Image Vision Computing, Vol. 17, pp. 27-36, Jan. 1999. https://doi.org/10.1016/S0262-8856(98)00087-0
  11. I. Oikonomidis, N. Kyriazis and AA. Argyros, "Efficient Model-based 3D Tracking of Hand Articulations using Kinect," BMVC, pp. 101.1-101.11, Sep. 2011.
  12. Junyeong Choi, Hanhoon Park and Jong-ll Park, "Hand shape recognition using distance transform and shape decomposition," Image Processing(ICIP), pp. 3605-3608, Sept. 2011.
  13. Information technology - Rich media user interfaces - Part 2: Advanced user interaction (AUI) interfaces. - ISO/IEC 23007, Feb. 2012.
  14. Gukhee Hand, A-Ram Baek, Haechul Choi, "MPEGU part2 based advanced user interaction interface system," The Korea Contents Association Journal, Vol. 12, No. 12, pp. 54-62, Dec. 2012.
  15. KINECT. http://en.wikipedia.org/wiki/Kinect.
  16. Sara Taskinen and David I, "Robust estimation and inference for bivariate line ‐ fitting in allometry," Biometrical Journal, pp. 652-672, Jun. 2011.
  17. Pedro F. Felzenszwalb and Daniel P. Huttenlocher, "Distance Transforms of Sampled Functions," Theory of Computing, Vol. 8, pp. 415-428, Sep. 2012. https://doi.org/10.4086/toc.2012.v008a019