Vision and Depth Information based Real-time Hand Interface Method Using Finger Joint Estimation

손가락 마디 추정을 이용한 비전 및 깊이 정보 기반 손 인터페이스 방법

  • Park, Kiseo (Dept. of Electronic & Radio Engineering, Kyung Hee University) ;
  • Lee, Daeho (Dept. of Humanitas College, Kyung Hee University) ;
  • Park, Youngtae (Dept. of Electronic & Radio Engineering, Kyung Hee University)
  • 박기서 (경희대학교 전자전파공학과) ;
  • 이대호 (경희대학교 후마니타스 칼리지) ;
  • 박영태 (경희대학교 전자전파공학과)
  • Received : 2013.05.19
  • Accepted : 2013.07.20
  • Published : 2013.07.28


In this paper, we propose a vision and depth information based real-time hand gesture interface method using finger joint estimation. For this, the areas of left and right hands are segmented after mapping of the visual image and depth information image, and labeling and boundary noise removal is performed. Then, the centroid point and rotation angle of each hand area are calculated. Afterwards, a circle is expanded at following pattern from a centroid point of the hand to detect joint points and end points of the finger by obtaining the midway points of the hand boundary crossing and the hand model is recognized. Experimental results that our method enabled fingertip distinction and recognized various hand gestures fast and accurately. As a result of the experiment on various hand poses with the hidden fingers using both hands, the accuracy showed over 90% and the performance indicated over 25 fps. The proposed method can be used as a without contacts input interface in HCI control, education, and game applications.