DOI QR코드

DOI QR Code

Hand Tracking Based Projection Mapping System and Applications

손 위치 트래킹 기반의 프로젝션 매핑 시스템 및 응용

  • 이청운 (동국대학교 멀티미디어학과) ;
  • 박상훈 (동국대학교 멀티미디어학과)
  • Received : 2016.05.17
  • Accepted : 2016.08.29
  • Published : 2016.09.01

Abstract

In this paper we present a projection mapping system onto human's moving hand by a projector as information delivery media and Kinect to recognize hand motion. Most traditional projection mapping techniques project a variety of images onto stationary objects, however, our system provides new user experience by projecting images onto the center of the moving palm. We explain development process of the system, and production of content as applications on our system. We propose hardware organization and development process of open software architecture based on object oriented programming approach. For stable image projection, we describe a device calibration method between the projector and Kinect in three dimensional space, and a denoising technique to minimize artifacts from Kinect coordinates vibration and unstable hand tremor.

본 논문은 빛을 이용한 영상 투사 매체인 프로젝터와 사용자의 신체를 인식하는 키넥트 센서를 이용하여 움직이는 사람의 손에 영상을 프로젝션 매핑하는 시스템 개발을 제안한다. 기존 프로젝션 매핑은 고정된 물체에 영상을 투사하는 경우가 대부분이지만, 본 시스템은 움직이는 손을인식해 손바닥의 중심점에 영상을 투사하여 사용자에게 새로운 인지 경험을 제공하기 위해 개발되었다. 본 논문에서는 시스템 제작 과정과 이를 기반으로 제작된 콘텐츠와 응용 예에 대해 설명한다. 하드웨어구성과 조립방법을 구체적으로 제시하고객체지향개발 방법을 통한 오픈 소프트웨어 구조 개발과정에 대해 자세히 서술한다. 안정적인 사영을위해 3차원 공간상에서 프로젝터와 키넥트 센서 좌표 캘리브레이션, 그리고 키넥트 센서 좌표 노이즈, 손떨림으로 인해 발생하는 노이즈 감소 방법을 실험 결과와 함께 제시한다.

Keywords

Acknowledgement

Grant : 기관고유사업비

Supported by : 한국과학기술정보연구원

References

  1. Y. Kim, "Meaning and pragmatical usage of korean hand gestures," Korean Semantics, vol. 6, pp. 27-47, 2006.
  2. (2016, 01) Processing. [Online]. Available: https://processing.org
  3. H. Kim, Y. Kim, and I. Lee, "Interactive installations using kinect -case studies," vol. 38, no. 2C. KOREA INFORMATION SCIENCE SOCIETY, 11 2011, pp. 245-248.
  4. B. Jones. (2016, 01) The illustrated history of projection mapping. [Online]. Available: http://projection-mapping.org/the-history-of-projection-mapping/
  5. N. Seon, J. Lee, and J. Park, "A study on real-time vjing system for projection mapping." The HCI Society of Korea, 2013, pp. 666-669.
  6. P. Mistry. (2016, 01) Sixth-sense. [Online]. Available: http://www.pranavmistry.com/projects/sixthsense
  7. J. C. Lee. (2016, 01) Wii-mote. [Online]. Available: http://johnnylee.net/projects/wii/
  8. A. Davison. (2016, 01) Hand and finger detection. [Online]. Available: http://fivedots.coe.psu.ac.th/-ad/jg/nui055
  9. S. Lim and S. Kim, "A study on case analysis of media art works using spatial interaction," Journal of Digital Design, vol. 13, no. 2, pp. 255-264, 4 2013.
  10. J. Kim, J. Hur, and J. Jeung, "Effect of strength improvement of aluminum profiles fastening method," in Proceedings of the KSMPE Conference. The Korean Society of Manufacturing Process Engineers, 2014, pp. 104-104.
  11. O. Cho and W. Lee, "A study on the implementation of gesture recognition system applying to interactive media art," Journal of Digital Design, vol. 12, no. 2, pp. 123-130, 04 2012.
  12. E. Gamma, R. Helm, R. Johnson, and J. Vlissides, Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley, 1994.
  13. Wikipedia. (2016, 01) Lowpass filter. [Online]. Available: https://en.wikipedia.org/wiki/Low-pass-filter
  14. H. B. et al. (2015, 01) Generative-design. [Online]. Available: http://www.generative-gestaltung.de
  15. PICC. (2016, 01) Interpolation using an arbitrary quadrilateral. [Online]. Available: https://www.particleincell.com/2012/quad-interpolation
  16. Wikipedia. (2016, 01) Opencv. [Online]. Available: https://en.wikipedia.org/wiki/Low-pass-filter