DOI QR코드

DOI QR Code

Virtual Block Game Interface based on the Hand Gesture Recognition

손 제스처 인식에 기반한 Virtual Block 게임 인터페이스

  • Yoon, Min-Ho (Department of Computer Engineering, Seo-Kyeong University) ;
  • Kim, Yoon-Jae (Department of Computer Engineering, Seo-Kyeong University) ;
  • Kim, Tae-Young (Department of Computer Engineering, Seo-Kyeong University)
  • 윤민호 (서경대학교 컴퓨터공학과) ;
  • 김윤제 (서경대학교 컴퓨터공학과) ;
  • 김태영 (서경대학교 컴퓨터공학과)
  • Received : 2017.11.07
  • Accepted : 2017.12.20
  • Published : 2017.12.20

Abstract

With the development of virtual reality technology, in recent years, user-friendly hand gesture interface has been more studied for natural interaction with a virtual 3D object. Most earlier studies on the hand-gesture interface are using relatively simple hand gestures. In this paper, we suggest an intuitive hand gesture interface for interaction with 3D object in the virtual reality applications. For hand gesture recognition, first of all, we preprocess various hand data and classify the data through the binary decision tree. The classified data is re-sampled and converted to the chain-code, and then constructed to the hand feature data with the histograms of the chain code. Finally, the input gesture is recognized by MCSVM-based machine learning from the feature data. To test our proposed hand gesture interface we implemented a 'Virtual Block' game. Our experiments showed about 99.2% recognition ratio of 16 kinds of command gestures and more intuitive and user friendly than conventional mouse interface.

최근 가상현실 기술의 발전으로 가상의 3D 객체와 자연스러운 상호작용이 가능하도록 하는 사용자 친화적인 손 제스처 인터페이스에 대한 연구가 활발히 진행되고 있다. 그러나 대부분의 연구는 단순하고 적은 종류의 손 제스처만 지원되고 있는 실정이다. 본 논문은 가상환경에서 3D 객체와 보다 직관적인 방식의 손 제스처 인터페이스 방법을 제안한다. 손 제스처 인식을 위하여 먼저 전처리 과정을 거친 다양한 손 데이터를 이진 결정트리로 1차 분류를 한다. 분류된 데이터는 리샘플링을 한 다음 체인코드를 생성하고 이에 대한 히스토그램으로 특징 데이터를 구성한다. 이를 기반으로 학습된 MCSVM을 통해 2차 분류를 수행하여 제스처를 인식한다. 본 방법의 검증을 위하여 3D 블록을 손 제스처를 통하여 조작하는 'Virtual Block'이라는 게임을 구현하여 실험한 결과 16개의 제스처에 대해 99.2%의 인식률을 보였으며 기존의 인터페이스보다 직관적이고 사용자 친화적임을 알 수 있었다.

Keywords

References

  1. Jung-Ho Ahn, Jae-pil Ko, "A Study on Tangible Gesture Interface Prototype Development of the Quiz Game", Journal of Digital Contents Society 13(2), 235-245, 2012.06. https://doi.org/10.9728/dcs.2012.13.2.235
  2. Ki-Chang Park, Seong-Chae Seo, Seung-Moon Jeong, Im-Cheol Kang, Byung-Gi Kim, "Design of Gesture based Interfaces for Controlling GUI Applications", Journal of the Korea Contents Association 13(1), 55-63, 2013.1. https://doi.org/10.5392/JKCA.2013.13.01.055
  3. Min-Sam Ko, Kwang-Hee Lee, Chang-woo Kim, Jun-Ho Ahn, In-Jung Kim, "An Implementation of User Interface Using Vision-based Gesture Recognition", Korea Information Science Society 35(1C), 507-511, 2008.6.
  4. Ji-Seong Jeong, Jong-Oh Kim, Do-Hyeong Kim, Sun-Ock Kwon, Seong-Yeon Ju, Won-Keun Oh, Kwan-Hee Yoo, "A Hand Gesture Interface for Controlling 3D e-Books", Korean Society For Computer Game, Volume.25, No.4 December 2012.
  5. Pankoo Kim, "Hand Gesture and Character Recognition Based on Kinect Sensor", Hindawi Publishing Corporation International Journal of Distributed Sensor Networks, Vol. 2014, Article ID 278460, pp. 6, 2014.
  6. Z. Ren, J. Meng, J. Yuan, Z. Zhang, "Robust hand gesture recognition with Kinect sensor", Proc. 19th ACM Int. Conf. Multimedia, pp. 759-760, 2011.
  7. In-ho Shin, Dong-hun Cheon, Han-hoon Park, "Implementing Leap-Motion-Based Interface for Enhancing the Realism of Shooter Games", Journal of the HCI Society of Korea No.1, May 2016.
  8. Hyang-han Joo, Min-soo Cho, Seung-Kyo In, Kyu-won Cho, Jun-Ki Min, "Development of Baseball Game Using Leap Motion Controllers", KIISE Transactions on Computing Practices, 21(5), 343-350. 2015. https://doi.org/10.5626/KTCP.2015.21.5.343
  9. Jae-Hyun Nam, Seung-Hun Yang, Woong Hu, Byung-Gyu Kim, "A new study on hand gesture recognition algorithm using leap motion system", Journal of Korea Multimedia Society Vol. 17, No. 11, November 2014.
  10. Min-Jae Kim, Jeong-man Heo, Jin-Hyoung Kim, So-Young Park, Juno Chang, "Development and Evaluation of Leapmotion-based Game Interface Considering Intuitive Hand Gestures", Korean Society For Computer Game 27(4), 69-75. 2014.
  11. Bassem Khelil, Hamid Amiri, "Hand Gesture Recognition Using Leap Motion Controller for Recognition of Arabic Sign Language", Proceedings of Engineering & Technology (PET), Vol. 3, pp. 233-238, 2016.
  12. R. Aigner, D. Wigdor, H. Benko, M. Haller, D. Lindlbauer, A. Ion, S.Zhao et al, "Understanding Mid-Air Hand Gestures: A Study of Human Preferences in Usage of Gesture Types for HCI", Microsoft Research TechReport. MSR-TR-2012-111, 2012.
  13. https://developer.leapmotion.com/documentation/csharp/devguide/Leap_Overview.html