Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지

Visualizing Motion Data as Sequential Images in Comic Book Layout

만화책 형식 동작 데이터 시각화

  • 이강훈 (광운대학교 컴퓨터소프트웨어학과)
  • Published : 2009.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

Captured motion data is widely used today in a variety of areas including film production, game development, sports analysis, and medical rehabilitation. The ability of analyzing and processing motion data has increased rapidly for last decades. However, it is still difficult for users to quickly understand the contents of motion data consisting of a series of time-varying poses. One typical approach is to visualize consecutive poses in sequence while adjusting three-dimensional view, which is often time-consuming and laborious especially when users need to repeatedly control time and view in order to search for desired motions. We present a method of visualizing motion data as a sequence of images in comic book layout so that users can rapidly understand the overall flows of motion data, and easily identify their desired motions. The usefulness of our approach is demonstrated by visualizing various kinds of motion data including locomotion, boxing, and interaction with environments.

오늘날 실제 사람의 움직임을 촬영하여 얻은 동작 데이터는 영화제작, 게임 개발, 재활의학, 스포츠 분석 등의 다양한 분야에서 활용되고 있다. 시간에 따라 변화하는 일련의 자세로 이루어진 동작 데이터는 그 내용을 신속하고 정확하게 파악하는 것이 쉽지 않다. 이는 특히 많은 양의 동작데이터를 관리하고 원하는 동작을 찾고자 할 때 장애가 되곤 한다. 널리 사용되는 한 가지 방법은 동영상을 재생하듯이 관찰 시점을 진전시키는 동시에 3차원 공간상의 시야를 조절하는 것이다. 하지만 이 방식은 시점과 시야의 두 요소를 함께 고려하면서 데이터의 길이에 비례하는 시간 동안 지속적인 상호작용을 수행하여야 하는 번거로움을 야기한다. 본 논문은 동작 데이터를 분석하여 일련의 효과적인 관찰 시점 및 시야를 자동으로 찾아내고, 이로부터 생성된 이미지 시퀀스를 만화책 레이아웃 형식으로 배치하는 새로운 시각화 방법을 제안한다. 사용자는 만화책을 읽는 것처럼 바르게 전체 흐름을 파악할 수 있고, 원하는 동작이 등장하는 부분을 쉽게 찾아낼 수 있다. 이동, 권투, 환경과의 상호작용 등 여러 종류의 동작 데이터를 만화책 형식으로 시각화한 결과를 보임으로써 제안된 방법의 유용성을 확인하였다.

Keywords

References

  1. J. Assa, Y. Caspi, and D. Cohen-Or, "Action synopsis: pose selection and illustration," ACM Transactions on Graphics (SIGGRAPH 2005), vol. 24, no. 3,p. 667-676, 2005. https://doi.org/10.1145/1073204.1073246
  2. CMU, "Graphics laboratory motion capture database," http://mocap.cs.cmu.edu.
  3. L. Kovar, M. Gleicher, and F. Pighin, "Motion graphs," ACM Transactions on Graphics (SIGGRAPH 2002), vol. 21, no. 3, pp. 473-482, 2002.
  4. J. Lee, J. Chai,. S. A. Reitsma,. K. Hodgins, and N. S. Pollard, "Interactive control of avatars animated with human motion data," ACM Transactions on Graphics (SIGGRAPH 2002), vol. 21, no. 3, pp. 491-500, 2002.
  5. Y. Sakamoto, S. Kuriyama, and T. Kaneko, "Motion map: image-based retrieval and segmentation of motion data," in SCA '04: Proceedings of the 2004 ACM SIG-GRAPH/Eurographics symposium on Computer animation, 2004, pp. 259-266.
  6. J. Barbic, A. Safonova, J.-Y. Pan, C. Faloutsos, J. K. Hodgins, and N. S. Pollard, "Segmenting motion capture data into distinct behaviors," in GI '04: Proceedings of Graphics Interface 2004, 2004, pp. 185-194.
  7. L. Kovar and M. Gleicher, "Automated extraction and parameterization of motions in large data sets," ACM Transactions on Graphics (SIGGRAPH 2004), vol. 23, no. 3, pp. 559-568, 2004. https://doi.org/10.1145/1015706.1015760
  8. H. J. Shin and H. S. Oh, "Fat graphs: constructing an interactive character with continuous controls," in SCA '06: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation, 2006, pp. 291-298.
  9. P. Beaudoin, M. van de Panne, P. Poulin, and S. Coros, "Motion-motif graphs," in SCA '08: Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation, 2008, pp. 117-126.
  10. J. Assa, D. Cohen-Or, I.-C. Yeh, and T.-Y. Lee, "Motion overview of human actions," ACM Transactions on Graph(SIGGRAPH ASIA 2008), vol. 27, no. 5, pp. 1-10, 2008.
  11. S. Bouvier-Zappa, V. Ostromoukhov, and P. Poulin, "Motion cues for illustration of skeletal motion capture data," in NPAR '07: Proceedings of the 5th international symposium on Non-photorealistic animation and rendering, 2007, pp. 133-140.
  12. B. T. Truong and S. Venkatesh, "Video abstraction: A systematic review and classification," ACM Transactions on Multimedia Computing, Communication and Applications, vol. 3, no.1, p. 3, 2007. https://doi.org/10.1145/1198302.1198305
  13. E. P. Bennett and L. McMillan, "Computational time-lapse video," ACM Transactions on Graphics (SIGGRAPH 2007), vol. 26, no. 3, p. 102, 2007. https://doi.org/10.1145/1276377.1276505
  14. Y. Pritch, A. Rav-Acha, and S. Peleg, "Nonchronological video synopsis and indexing," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 11, pp. 1971-1984, 2008. https://doi.org/10.1109/TPAMI.2008.29
  15. M. Irani and P. Anandan, "Video indexing based on mosaic representations," Proceedings of the IEEE, vol. 86, no. 5, pp. 905-921, 1998. https://doi.org/10.1109/5.664279
  16. D. B. Goldman, B. Curless, D. Salesin, and S. M. Seitz, "Schematic storyboarding for video visualization and editing," ACM Transactions on Graphics (SIGGRAPH 2006), vol. 25, no. 3, pp. 862-871, 2006. https://doi.org/10.1145/1141911.1141967
  17. J. Boreczky, A. Girgensohn, G. Golovchinsky, and S. Uchihashi, "An interactive comic book presentation for exploring video," in CHI '00: Proceedings of the SIGCHI conference on Human factors in computing systems, 2000, pp. 185-192.
  18. J. Calic, D. P. Gibson, and N. W. Campbell, "Efficient layout of comic-like video summaries," IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, no. 7, pp. 931-936, 2007. https://doi.org/10.1109/TCSVT.2007.897466