Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

Dragging Body Parts in 3D Space to Direct Animated Characters

3차원 공간 상의 신체 부위 드래깅을 통한 캐릭터 애니메이션 제어

  • Lee, Kang Hoon (Dept. of Computer Science, Kwangwoon University) ;
  • Choi, Myung Geol (Dept. of Media Technology and Media Contents, The Catholic University of Korea)
  • 이강훈 (광운대학교 컴퓨터소프트웨어학과) ;
  • 최명걸 (가톨릭대학교 미디어기술콘텐츠학과)
  • Received : 2015.04.30
  • Accepted : 2015.05.28
  • Published : 2015.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

We present a new interactive technique for directing the motion sequences of an animated character by dragging its specific body part to a desired location in the three-dimensional virtual environment via a hand motion tracking device. The motion sequences of our character is synthesized by reordering subsequences of captured motion data based on a well-known graph representation. For each new input location, our system samples the space of possible future states by unrolling the graph into a spatial search tree, and retrieves one of the states at which the dragged body part of the character gets closer to the input location. We minimize the difference between each pair of successively retrieved states, so that the user is able to anticipate which states will be found by varying the input location, and resultantly, to quickly reach the desired states. The usefulness of our method is demonstrated through experiments with breakdance, boxing, and basketball motion data.

본 논문은 캐릭터의 특정 신체 부위를 3차원 가상 환경 안의 원하는 위치로 드래깅 함으로써 미래의 동작 시퀀스를 지시하는 새로운 대화형 기법을 제시한다. 캐릭터의 동작 시퀀스는 미리 촬영된 동작 데이터의 세부 구간들을 모션 그래프 구조에 따라 시간적으로 재배열 함으로써 합성한다. 손 동작 추적 장치에 의하여 사용자의 3차원 위치 입력이 주어지면, 모션 그래프를 공간 상에 펼침으로써 캐릭터의 현재 상태로부터 도달 가능한 잠재적 미래 상태들을 샘플링 하고, 선택된 신체 부위와 입력 위치 간의 거리가감소하는 미래 상태를 검출하여 해당 자세를 사용자에게 제시한다. 연속적으로 검출된 자세 간의 변화를 최소화 함으로써 사용자가 입력 위치를 변화 시킴에 따라 어떤 상태가 검출될지 예상하기 용이하도록 하고, 결과적으로 원하는 미래 상태에 신속하게 도달하도록 한다. 제안된 방법의유용성은 브레이크 댄스, 권투, 농구 등의 동작 데이터를 이용한 실험을 통하여 확인할 수 있었다.

Keywords

References

  1. J. Laszlo, M. van de Panne, and E. Fiume, "Interactive control for physically-based animation," in Proceedings of the 27th annual conference on Computer graphics and interactive techniques (SIGGRAPH 2000), 2000, pp. 201-208.
  2. J. Kim and N. S. Pollard, "Direct control of simulated nonhuman characters," vol. 31, no. 4, pp. 56-65, 2011. https://doi.org/10.1109/MCG.2011.58
  3. T. Igarashi, T. Moscovich, and J. F. Hughes, "Spatial keyframing for performance-driven animation," in Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 2005, pp. 107-115.
  4. M. Thorne, D. Burke, and M. van de Panne, "Motion doodles: an interface for sketching character motion," ACM Transactions on Graphics (SIGGRAPH 2004), vol. 23, no. 3, pp. 424-431, 2004.
  5. J. Davis, M. Agrawala, E. Chuang, Z. Popovic, and D. Salesin, "A sketching interface for articulated figure animation," in Proceedings of the ACM SIGGRAPH/ Eurographics Symposium on Computer Animation, 2003, pp. 320-329.
  6. I. Yoo, J. Vanek, and M. Nizovtseva, "Sketching human character animations by composing sequences from large motion database," Visual Computer, vol. 30, pp. 213-227, 2014. https://doi.org/10.1007/s00371-013-0797-1
  7. L. Kovar, M. Gleicher, and F. Pighin, "Motion graphs," ACM Transactions on Graphics (SIGGRAPH 2002), vol. 21, no. 3, pp. 473-482, 2002.
  8. J. Lee, J. Chai, P. S. A. Reitsma, J. K. Hodgins, and P. N. S., "Interactive control of avatars animated with human motion data," ACM Transactions on Graphics (SIGGRAPH 2002), vol. 21, no. 3, pp. 491-500, 2002.
  9. W.-Y. Lo and M. Zwicker, "Bidirectional search for interactive motion synthesis," Computer Graphics Forum, vol. 29, no. 2, pp. 563-573, 2010. https://doi.org/10.1111/j.1467-8659.2009.01626.x
  10. J. Min, Y.-I. Chen, and J. Chai, "Interactive generation of human animation with deformable motion models," ACM Transactions on Graphics, vol. 29, no. 1, pp. 9:1-9:12, 2009.
  11. M. P. Johnson, A.Wilson, B. Blumberg, C. Kline, and A. Bobick, "Sympathetic interfaces: using a plush toy to direct synthetic characters," in Proceedings of the SIGCHI conference on Human Factors in Computing Systems, 1999, pp. 152-158.
  12. M. Dontcheva, G. Yngve, and Z. Popovic, "Layered acting for character animation," ACM Transactions on Graphics (SIGGRAPH 2003), vol. 22, no. 3, pp. 409-416, 2003.
  13. N. Numaguchi, A. Nakazawa, T. Shiratori, and J. K. Hodgins, "A puppet interface for retrieval of motion capture data," in Proceedings of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 2011, pp. 157-166.
  14. R. Held, A. Gupta, B. Curless, and M. Agrawala, "3d puppetry: a kinect-based interface for 3d animation," in Proceedings of the 25th annual ACM symposium on User Interface software and technology (UIST '12), 2012, pp. 423-434.
  15. H. J. Shin, J. Lee, S. Y. Shin, and M. Gleicher, "Computer puppetry: an importance-based approach," ACM Transactions on Graphics, vol. 20, no. 2, pp. 67-94, 2001. https://doi.org/10.1145/502122.502123
  16. J. Chai and J. K. Hodgins, "Performance animation from lowdimensional control signals," ACM Transactions on Graphics (SIGGRAPH 2005), vol. 24, no. 3, pp. 686-696, 2005.
  17. R. Slyper and J. K. Hodgins, "Action capture with accelerometers," in Proceedings of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 2008, pp. 193-199.
  18. H. Liu, X. Wei, J. Chai, I. Ha, and T. Rhee, "Realtime human motion control with a small number of inertial sensors," in Proceedings of symposium on Interactive 3D Graphics and Games (I3D '11), 2011, pp. 133-140.
  19. H. Rhodin, J. Tompkin, K. I. Kim, K. Varanasi, H.-P. Seidel, and C. Theobalt, "Interactive motion mapping for real-time character control," Computer Graphics Forum, vol. 33, no. 2, pp. 273-282, 2014.
  20. Y. Seol, C. O'Sullivan, and J. Lee, "Creature features: online motion puppetry for non-human characters," in Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 2013, pp. 213-221.
  21. N. Lockwood and K. Singh, "Finger walking: motion editing with contact-based hand performance," in Proceedings of ACM SIGGRAPH/Eurographics conference on Computer Animation, 2012, pp. 43-52.
  22. M. Oshita, Y. Senju, and S. Morishige, "Chracter motion control interface with hand manipulation inspired by puppet mechanism," in Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, 2013, pp. 131-138.
  23. M. G. Choi, M. Kim, K. L. Hyun, and J. Lee, "Deformable motion: squeezing into cluttered environments," Computer Graphics Forum, vol. 30, no. 2, pp. 445-453, 2011.