Journal of Digital Convergence (디지털융복합연구)

The Society of Digital Policy and Management (한국디지털정책학회)
권호 표지
DOI QR코드

DOI QR Code

Realtime 3D Human Full-Body Convergence Motion Capture using a Kinect Sensor

Kinect Sensor를 이용한 실시간 3D 인체 전신 융합 모션 캡처

  • Kim, Sung-Ho (School of Computer, Information and Communication Engineering, Sangji Univ.)
  • 김성호 (상지대학교 컴퓨터정보공학부)
  • Received : 2015.11.23
  • Accepted : 2016.01.20
  • Published : 2016.01.28
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, there is increasing demand for image processing technology while activated the use of equipments such as camera, camcorder and CCTV. In particular, research and development related to 3D image technology using the depth camera such as Kinect sensor has been more activated. Kinect sensor is a high-performance camera that can acquire a 3D human skeleton structure via a RGB, skeleton and depth image in real-time frame-by-frame. In this paper, we develop a system. This system captures the motion of a 3D human skeleton structure using the Kinect sensor. And this system can be stored by selecting the motion file format as trc and bvh that is used for general purposes. The system also has a function that converts TRC motion captured format file into BVH format. Finally, this paper confirms visually through the motion capture data viewer that motion data captured using the Kinect sensor is captured correctly.

최근 카메라, 캠코더 및 CCTV 등의 사용이 활발해지면서 영상 처리 기술의 수요가 급증하고 있다. 특히 키넥트 센서와 같은 깊이(Depth) 카메라를 사용한 3D 영상 기술에 대한 연구개발이 더욱더 활성화되고 있다. 키넥트 센서는 RGB, 골격(Skeleton) 및 깊이(Depth) 영상을 통해 인체의 3D 골격 구조를 실시간 프레임 단위로 획득할 수 있는 고성능 카메라이다. 본 논문에서는 키넥트 센서를 사용하여 인체의 3D 골격 구조를 모션 캡처하고 범용으로 사용되고 있는 모션 파일 포맷($^*.trc$ 및 $^*.bvh$)으로 선택하여 저장할 수 있는 시스템을 개발한다. 또한 본 시스템은 광학식 모션 캡처 파일 포맷($^*.trc$)을 자기식 모션 캡처 파일 포맷($^*.bvh$)으로 변환할 수 있도록 하는 기능을 가진다. 마지막으로 본 논문에서는 키넥트 센서를 사용하여 캡처한 모션 데이터가 제대로 캡처되어졌는지 모션 캡처 데이터 뷰어를 통하여 확인한다.

Keywords

References

  1. K. Berger, K. Ruhl, C. Brummer, Y. Schroder, A. Scholz, M. Magnor, "Markerless motion capture using multiple color-depth sensors," In Proc. Vision, Modeling and Visualization (VMV), 2011.
  2. Xiaolin Wei, Peizhao Zhang, Jinxiang Chai, "Accurate realtime full-body motion capture using a single depth camera," ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012.
  3. A. Hadjakos. "Pianist Motion Capture with the Kinect Depth Camera," In Proceedings of the International Conference on Sound and Music Computing, Copenhagen, Denmark, 2012.
  4. Jeff K. T. Tang, Jacky C. P. Chan, Howard Leung, "Interactive dancing game with real-time recognition of continuous dance moves from 3D human motion capture," Proceedings of the 5th International Conference on Ubiquitous Information Management and Communication Article No. 50, 2011.
  5. Zheng Xiao, "3D Human Postures Recognition using Kinect," 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), pp. 26-27, PP.344-347, 2012.
  6. M. bin Mohd Sidik, M. bin Sunar, I. bin Ismail, M. bin Mokhtar, and N. Jusoh, "A study on natural interaction for human body motion using depth image data," in Proc. IEEE International Workshop on Digital Media and Digital Content Management (DMDCM, 2011), pp. 97-102, 2011.
  7. Andrea Sanna1, Fabrizio Lamberti1, Gianluca Paravati1, Felipe Domingues Rocha1, "A kinect-based interface to animate virtual characters," Journal on Multimodal User Interfaces, (C) OpenInterface Association 2012, 10.1007/s12193-012-0113-9, 2012.
  8. Myung-hwan Choi, Byoung-keon Park, Bon-yeol Koo, Je-wook Chae, Jay-jung Kim, "Human motion analysis based on a markerless motion capture using Kinect," The 8th Conference on National Defense Technology, pp. 619-623, 2012.
  9. Mankyu Sung, "3D Character Motion Synthesis and Control Method for Navigating Virtual Environment Using Depth Sensor," Journal of Korea Multimedia Society Vol.15 No.6, pp. 827-836, 2012. https://doi.org/10.9717/kmms.2012.15.6.827
  10. Hyun-Cheol Yoon, Jong-Seung Park, "Gesture-based Game Character Animation Using Motion Data Captured From the Kinect Sensor," Korean Society for Computer Game, Vol.26 No.2, pp. 147-153, 2013.
  11. List of motion and gesture file formats, http://en.wikipedia.org/wiki/List_of_motion_and_gesture_file_formats
  12. http://blogs.msdn.com/b/eternalcoding/archive/2011/06/13/unleash-the-power-of-kinect-for-windows-sdk.aspx
  13. http://cta-diderot.brucity.be/?page_id=11
  14. http://www.laserfocusworld.com/articles/2011/01/lasers-bring-gesture-recognition-to-the-home.html
  15. http://tech.integrate.biz/kinect_mocap.htm
  16. http://channel9.msdn.com/coding4fun/kinect/Saving-Kinect-Streams-Skeleton-Stream-to-BVH-Converter-and-Stream-Saver-Application
  17. Han Suk Choi, "Kinect-based Motion Recognition Model for the 3D Contents Control," Journal of the Korea Contents Association, Vol.14, No.1, pp.24-29, 2014.
  18. Yeong-Hyeon Byeon, Myung-Won Lee, and Keun-Chang Kwak, "A Trend Analysis of Motion Capture Systems for Sports Motion Analysis," Journal of KIIT. Vol.11, No.5, pp.191-201, 2013
  19. Zhang, Zhengyou. "Microsoft kinect sensor and its effect." MultiMedia, IEEE 19.2 (2012): 4-10.