Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Production Pipeline for Third Person Virtual Reality Contents Based on Hand Interface

손 인터페이스 기반 3인칭 가상현실 콘텐츠 제작 공정에 관한 연구

  • Jeon, Changyu (Department of Software, Catholic University of Pusan) ;
  • Kim, Mingyu (Department of Software, Catholic University of Pusan) ;
  • Lee, Jiwon (Department of Software, Catholic University of Pusan) ;
  • Kim, Jinmo (Department of Software, Catholic University of Pusan)
  • 전찬규 (부산가톨릭대학교 소프트웨어학과) ;
  • 김민규 (부산가톨릭대학교 소프트웨어학과) ;
  • 이지원 (부산가톨릭대학교 소프트웨어학과) ;
  • 김진모 (부산가톨릭대학교 소프트웨어학과)
  • Received : 2017.06.24
  • Accepted : 2017.07.06
  • Published : 2017.07.14
Download PDF
⟨ Previous Next ⟩

Abstract

This study proposes a third-person virtual reality content production pipeline to provide users with a new experience and presence in a new virtual reality environment. For this purpose, we first create third-person virtual reality content, which includes a story, fun factors, and game characteristic. It consists of a tutorial scene in which a user can pre-learn the proposed interface suitable for a third person different from existing virtual reality content and a content scene that achieves its purpose by using game factors based on the background story. Next, we design an interface suitable for the third-person virtual reality content. This study proposes an interface in which users can interact with a virtual environment or object by using their hand. The proposed interface consists of three steps: character movement, virtual object selection with multiple selection, and 3D menu control using virtual space. Finally, through the survey experiment, third-person virtual reality content produced based on the proposed interface was confirmed to be easily controlled while ensuring high satisfaction.

본 연구는 사용자에게 새로운 가상현실 환경에서 새로운 경험과 현존감을 제공하기 위하여 3인칭 시점의 가상현실 콘텐츠 제작 공정을 제안한다. 이를 위해 우선 이야기, 재미요소 그리고 게임성을 포함하는 3인칭 관찰자 시점의 가상현실 콘텐츠를 제작한다. 이는 기존의 가상현실 콘텐츠와 다른 3인칭 시점에 적합한 인터페이스를 사용자가 사전에 학습할 수 있는 튜토리얼 장면과 배경 이야기를 토대로 게임적 요소를 활용하여 목적을 달성하는 콘텐츠 장면으로 구성한다. 다음은 3인칭 가상현실 콘텐츠에 적합한 인터페이스를 설계한다. 본 연구는 손을 사용하여 가상환경 또는 객체와 상호작용할 수 있는 인터페이스를 제안한다. 제안하는 인터페이스는 캐릭터의 이동, 다중 선택을 포함한 가상객체의 선택, 가상공간을 활용한 3차원 메뉴 제어의 3단계로 구성한다. 마지막으로 제안한 인터페이스를 통해 제작된 3인칭 가상현실 콘텐츠를 높은 만족감으로 편리하게 제어할 수 있음을 설문 실험을 통해 확인한다.

Keywords

References

  1. J.S. Steuer, "Defining virtual reality: dimensions determining telepresence." Journal of Communication, vol. 42, pp.73-93, 1992.
  2. I.E. Sutherland, "A head-mounted three dimensional display," In Proceedings of the AFIPS '68, pp. 757-764, 1968.
  3. C. Schissler, A. Nicholls and R. Mehra, "Efficient HRTF-based Spatial Audio for Area and Volumetric Sources," IEEE Transactions on Visualization and Computer Graphics, vol. 22, no. 4, pp.1356-1366, 2016. https://doi.org/10.1109/TVCG.2016.2518134
  4. S. Serafin, L. Turchet, R. Nordahl, S. Dimitrov, A. Berrezag and V. Hayward, "Identification of virtual grounds using virtual reality haptic shoes and sound synthesis," Proceedings of the Eurohaptics 2010 Special Symposium, pp.61-70, 2010.
  5. S. Seinfeld, I. Bergstrom, A. Pomes, J. Arroyo-Palacios, F. Vico, M. Slater and M. V. Sanchez-Vives, "Influence of Music on Anxiety Induced by Fear of Heights in Virtual Reality," Frontiers in Psychology, vol. 6, no. 1969, 2016.
  6. J. Tompson, M. Stein, Y. Lecun and K. Perlin, "Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks," ACM Trans. Graph., vol. 33, no. 5, pp.169:1-169:10, 2014.
  7. R. Nordahl, A. Berrezag, S. Dimitrov, L. Turchet, V. Hayward and S. Serafin, "Preliminary Experiment Combining Virtual Reality Haptic Shoes and Audio Synthesis," Proceedings of the 2010 International Conference on Haptics - Generating and Perceiving Tangible Sensations: Part II, Amsterdam, The Netherlands, pp.123-129, 2010.
  8. L.-P. Cheng, T. Roumen, H. Rantzsch, S. Kohler, P. Schmidt, R. Kovacs, J. Jasper, J. Kemper and P. Baudisch, "TurkDeck: physical virtual reality based on people," In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pp. 417-426, 2015.
  9. D. Leonardis, M. Solazzi, I. Bortone and A. Frisoli, "A 3-RSR HapticWearable Device for Rendering Fingertip Contact Forces," IEEE Transactions on Haptics, online published, 2016.
  10. D. Prattichizzo, F. Chinello, C. Pacchierotti and M. Malvezzi, "Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback," IEEE Transactions on Haptics, vol. 6, no. 4, pp.506-516, 2013. https://doi.org/10.1109/TOH.2013.53
  11. S. B. Schorr and A. Okamura, "Three-dimensional skin deformation as force substitution: Wearable device design and performance during haptic exploration of virtual environments," IEEE Transactions on Haptic, online published, 2017.
  12. M. Bianchi, E. Battaglia, M. Poggiani, S. Ciotti and A. Bicchi, "A Wearable Fabric-based display for haptic multi-cue delivery," 2016 IEEE Haptics Symposium (HAPTICS), Philadelphia, Pennsylvania, USA, pp.277-283, 2016.
  13. A. G. Perez, D. Lobo, F. Chinello, G. Cirio, M. Malvezzi, J. San Martin, D. Prattichizzo and M. A. Otaduy, "Optimization-Based Wearable Tactile Rendering," IEEE Transactions on Haptics, online published, 2016.
  14. M. Maisto, C. Pacchierotti, F. Chinello, G. Salvietti, A. De Luca and D. Prattichizzo, "Evaluation of wearable haptic systems for the fingers in Augmented Reality applications," IEEE Transactions on Haptics, online published, 2017.
  15. VR Gamerdude, "Third Person Perspective Gaming In VR Can Be Awesome!," Available online: http://www.vrspies.com/vrgamerdude/third-person-perspectivegaming-can-be-awesome (accessed on June 14, 2017), 2017.
  16. M. Slater and M. V. Sanchez-Vives, "Enhancing Our Lives with Immersive Virtual Reality," Front. Robot. AI, vol. 3, no. 74, 2016.
  17. S. Han and J. Kim, "A Study on Immersion of Hand Interaction for Mobile Platform Virtual Reality Contents," Symmetry, vol. 9, no. 2, pp.22:1-22:17, 2017. https://doi.org/10.3390/sym9100221
  18. Manufactura-K4, "Cartoon Town," Available online: https://www.assetstore.unity3d.com/en/#!/content/17254 (accessed on 21 September 2016), 2016.
  19. B.-G. Witmer, C.-J. Jerome, and M.-J. Singer, "The Factor Structure of the Presence Questionnaire," Presence: Teleoper. Virtual Environ., vol. 14, no. 3, pp.298-312, 2005. https://doi.org/10.1162/105474605323384654