Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Core Factors and Application of Asymmetric VR Content

Asymmetric VR 콘텐츠 제작의 핵심 요인과 활용에 관한 연구

  • Kim, Jinmo (Department of Software, Catholic University of Pusan)
  • 김진모 (부산가톨릭대학교 소프트웨어학과)
  • Received : 2017.10.31
  • Accepted : 2017.12.07
  • Published : 2017.12.08
Download PDF
⟨ Previous Next ⟩

Abstract

In this study, we propose the core factors and application of asymmetric virtual reality(VR) content in which head-mounted display(HMD) user and Non-HMD users can work together in a co-located space that can lead to various experiences and high presence. The core of the proposed asymmetric VR content is that all users are immersed in VR and participate in new experiences by reflecting widely a range of users' participation and environments, regardless of whether or not users wear the HMD. For this purpose, this study defines the role relationships between HMD user and Non-HMD users, the viewpoints provided to users, and the speech communication structure available among users. Based on this, we verified the core factors through the process of producing assistive asymmetric VR content and cooperative asymmetric VR content directly. Finally, we conducted a survey to examine the users' presence and their experience of the proposed asymmetric VR content and to analyze the application method. As a result, it was confirmed that if the purpose of asymmetric VR content and core factors between the two types of users are clearly distinguished and defined, the independent experience presented by the VR content together with perceived presence can provide a satisfactory experience to all users.

본 연구는 HMD 사용자와 Non-HMD 사용자가 같은 공간에서 함께 행동하면서 다양한 경험과 높은 현존감을 이끌어낼 수 있는 비대칭 가상현실(asymmetric VR) 콘텐츠의 핵심 요인과 활용 방안을 제안한다. 제안하는 asymmetric VR 콘텐츠의 핵심은 사용자들이 HMD 착용 유무에 상관없이 사용자가 콘텐츠에 참여하는 범위, 환경을 폭넓게 반영하여 모두가 가상현실에 몰입하고, 새로운 경험을 이끌어내는 것이다. 이를 위해 본 연구는 asymmetric VR 콘텐츠 제작에 필요한 핵심 요인으로 HMD 사용자와 Non-HMD 사용자의 역할관계, 사용자들에게 제시되는 시점 그리고 사용자들 간의 대화를 통한 의사소통 구조를 정의하였다. 이를 기반으로 보조형 asymmetric VR 콘텐츠와 협력형 asymmetric VR 콘텐츠를 직접 제작하는 과정을 통해 핵심 요인을 검증하였다. 마지막으로 제안한 asymmetric VR 콘텐츠에서의 현존감, 경험을 검증하고 활용 방안을 분석하기 위하여 참가자들을 대상으로 한 설문 실험을 진행하였다. 설문 결과 asymmetric VR 콘텐츠의 목적과 이를 체험하는 사용자들간의 핵심 요인들을 명확히 구분하고, 정의한다면 모든 사용자가 만족하는 현존감과 함께 콘텐츠가 제시하는 독립적인 경험을 제공받을 수 있음을 확인하였다.

Keywords

References

  1. S. Han and J. Kim, "A study on immersion of hand interaction for mobile platform virtual reality contents," Symmetry, vol. 9, no. 2, p. 22, 2017. [Online]. Available: http://www.mdpi.com/2073-8994/9/2/22 https://doi.org/10.3390/sym9020022
  2. J. Lee, M. Kim, and J. Kim, "A study on immersion and vr sickness in walking interaction for immersive virtual reality applications," Symmetry, vol. 9, no. 5, p. 78, 2017. [Online]. Available: http://www.mdpi.com/2073-8994/9/5/78 https://doi.org/10.3390/sym9050078
  3. M. Slater, "Presence and the sixth sense," Presence: Teleoper. Virtual Environ., vol. 11, no. 4, pp. 435-439, Aug. 2002. [Online]. Available: http://dx.doi.org/10.1162/105474602760204327
  4. M. Slater and M. V. Sanchez-Vives, "Enhancing our lives with immersive virtual reality," Frontiers in Robotics and AI, vol. 3, p. 74, 2016. [Online]. Available: http://journal.frontiersin.org/article/10.3389/frobt.2016.00074
  5. I. E. Sutherland, "A head-mounted three dimensional display," in Proceedings of the Fall Joint Computer Conference, Part I, ser. AFIPS'68 (Fall, part I). New York, NY, USA: ACM, 9-11 December 1968, pp. 757-764. [Online]. Available: http://doi.acm.org/10.1145/1476589.1476686
  6. H. Li, L. Trutoiu, K. Olszewski, L. Wei, T. Trutna, P.-L. Hsieh, A. Nicholls, and C. Ma, "Facial performance sensing head-mounted display," ACM Trans. Graph., vol. 34, no. 4, pp. 47:1-47:9, July 2015. [Online]. Available: http://doi.acm.org/10.1145/2766939
  7. C. Schissler, A. Nicholls, and R. Mehra, "Efficient hrtfbased spatial audio for area and volumetric sources," IEEE Transactions on Visualization and Computer Graphics, vol.22, no.4, pp.1356-1366, Apr. 2016. [Online]. Available: https://doi.org/10.1109/TVCG.2016.2518134
  8. M. Bianchi, E. Battaglia, M. Poggiani, S. Ciotti, and A. Bicchi, "A wearable fabric-based display for haptic multi-cuedelivery," in 2016 IEEE Haptics Symposium (HAPTICS). Los Alamitos, CA, USA: IEEE Computer Society Press, April 811 2016, pp. 277-283.
  9. J. Lee, K. Jeong, and J. Kim, "Mave: Maze-based immersive virtual environment for new presence and experience," Computer Animation and Virtual Worlds, vol. 28, no. 3-4, pp. e1756-n/a, 2017, e1756 cav.1756. [Online]. Available: http://dx.doi.org/10.1002/cav.1756
  10. K. Vasylevska, H. Kaufmann, M. Bolas, and E. A. Suma, "Flexible spaces: Dynamic layout generation for infinite walking in virtual environments," in 2013 IEEE Symposium on 3D User Interfaces (3DUI). Washington, DC, USA: IEEE Computer Society, 16-17 March 2013, pp. 39-42.
  11. W. Zhao, J. Chai, and Y.-Q. Xu, "Combining marker-based mocap and rgb-d camera for acquiring high-fidelity hand motion data," in Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ser. SCA '12. Aire-laVille, Switzerland, Switzerland: Eurographics Association, 29-31 July 2012, pp. 33-42. [Online]. Available: http://dl.acm.org/citation.cfm?id=2422356.2422363
  12. A. Venkatesh, E. Kruse, and E. C.-F. Shih, "The networked home: an analysis of current developments and future trends," Cognition, Technology & Work, vol. 5, no. 1, pp. 23-32, Apr 2003. [Online]. Available: https://doi.org/10.1007/s10111002-0113-8
  13. A. Voida and S. Greenberg, "Wii all play: The console game as a computational meeting place," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ser. CHI '09. New York, NY, USA: ACM, 2009, pp. 1559-1568. [Online]. Available: http://doi.acm.org/10.1145/1518701.1518940
  14. J. Lee, M. Kim, and J. Kim, "Rolevr: Multi-experience in immersive virtual reality between co-located hmd and non-hmd users," in Proceedings of the 25th IEEE Conference on Virtual Reality and 3D User Interfaces, 2017, submitted.
  15. E. F. Churchill and D. Snowdon, "Collaborative virtual environments: An introductory review of issues and systems," Virtual Reality, vol. 3, no. 1, pp. 3-15, Mar 1998. [Online]. Available: https://doi.org/10.1007/BF01409793
  16. D. N. E. Phon, M. B. Ali, and N. D. A. Halim, "Collaborative augmented reality in education: A review," in Proceedings of the 2014 International Conference on Teaching and Learning in Computing and Engineering, ser. LATICE '14. Washington, DC, USA: IEEE Computer Society, 2014, pp. 78-83. [Online]. Available: http://dx.doi.org/10.1109/LaTiCE.2014.23
  17. H. Ibayashi, Y. Sugiura, D. Sakamoto, N. Miyata, M. Tada, T. Okuma, T. Kurata, M. Mochimaru, and T. Igarashi, "Dollhouse vr: A multi-view, multi-user collaborative design workspace with vr technology," in SIGGRAPH Asia 2015 Emerging Technologies, ser. SA '15. New York, NY, USA: ACM, 2015, pp. 8:1-8:2. [Online]. Available: http://doi.acm.org/10.1145/2818466.2818480
  18. J. C. Oliveira, X. Shen, and N. D. Georganas, "Collaborative virtual environment for industrial training and e-commerce," in IEEE VRTS 288, 2000.
  19. J. Gugenheimer, E. Stemasov, J. Frommel, and E. Rukzio, "Sharevr: Enabling co-located experiences for virtual reality between hmd and non-hmd users," in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ser. CHI '17. New York, NY, USA: ACM, 2017, pp. 4021-4033. [Online]. Available: http://doi.acm.org/10.1145/3025453.3025683
  20. H. G. Hoffman, "Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments," in Virtual Reality Annual International Symposium, 1998. Proceedings., IEEE 1998. Washington, DC, USA: IEEE Computer Society, 14-18 March 1998, pp. 59-63.
  21. C. Carvalheiro, R. Nobrega, H. da Silva, and R. Rodrigues, "User redirection and direct haptics in virtual environ ments," in Proceedings of the 2016 ACM on Multimedia Conference, ser. MM '16. New York, NY, USA: ACM, 15-19 October 2016, pp. 1146-1155. [Online]. Available: http://doi.acm.org/10.1145/2964284.2964293
  22. S. B. Schorr and A. Okamura, "Three-dimensional skin deformation as force substitution: Wearable device design and performance during haptic exploration of virtual environments," IEEE Transactions on Haptics, vol. PP, no. 99, pp. 1-1, 2017.
  23. V. Hayward, O. R. Astley, M. Cruz-Hernandez, D. Grant, and G. Robles-De-La-Torre, "Haptic interfaces and devices," Sensor Review, vol. 24, no. 1, pp. 16-29, 2004. [Online]. Available: http://dx.doi.org/10.1108/02602280410515770
  24. M. Kim, C. Jeon, and J. Kim, "A study on immersion and presence of a portable hand haptic system for immersive virtual reality," Sensors, vol. 17, no. 5, p. 1141, 2017. [Online]. Available: http://www.mdpi.com/14248220/17/5/1141 https://doi.org/10.3390/s17051141
  25. O. Otto, D. Roberts, and R. Wolff, "A review on effective closely-coupled collaboration using immersiv ecve's," in Proceedings of the 2006 ACM International Conference on Virtual Reality Continuum and Its Applications, ser. VRCIA'06. New York, NY, USA: ACM, 2006, pp. 145-154. [Online]. Available: http://doi.acm.org/10.1145/1128923.1128947
  26. T. Duval and C. Fleury, "An asymmetric 2d pointer/3d ray for 3d interaction within collaborative virtual environments," in Proceedings of the 14th International Conference on 3D Web Technology, ser. Web3D '09. New York, NY, USA: ACM, 2009, pp. 33-41. [Online]. Available: http://doi.acm.org/10.1145/1559764.1559769
  27. O. Oda, C. Elvezio, M. Sukan, S. Feiner, and B. Tversky, "Virtual replicas for remote assistance in virtual and augmented reality," in Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, ser. UIST '15. New York, NY, USA: ACM, 2015, pp. 405-415. [Online]. Available: http://doi.acm.org/10.1145/2807442.2807497
  28. Team-Future, "Black hat cooperative," Game [HTC Vive], 2016. [Online]. Available: http://store.steampowered.com/app/503100/Black_Hat_Cooperative/
  29. Foreign-VR, "Ruckus ridge vr party," Game [HTC Vive], 2016. [Online]. Available: http://store.steampowered.com/app/443800/Ruckus_Ridge_VR_Party/
  30. DIVR, "Blue effect vr," Game [HTC Vive], 2016. [Online]. Available: http://store.steampowered.com/app/522020/Blue_Effect_VR/
  31. VinLia-Games, "Eye in the sky," Game [HTC Vive], 2017. [Online]. Available: http://store.steampowered.com/app/566 700/Eye_in_the_Sky/
  32. Andromeda-Studio, "Zombie vr," Game [Oculus Rift], 2016. [Online]. Available: http://www.studioandro.com/?portfolio=the-corpse/
  33. L.-P. Cheng, P. Luhne, P. Lopes, C. Sterz, and P. Baudisch, "Haptic turk: A motion platform based on people," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ser. CHI '14. New York, NY, USA: ACM, 26 April-1 May 2014, pp. 3463-3472.[Online]. Available: http://doi.acm.org/10.1145/2556288.2557101
  34. L.-P. Cheng, T. Roumen, H. Rantzsch, S. Kohler, P. Schmidt, R. Kovacs, J. Jasper, J. Kemper, and P. Baudisch, "Turkdeck: Physical virtual reality based on people," in Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, ser. UIST '15. New York, NY, USA: ACM, 8-11 November 2015, pp. 417-426. [Online]. Available: http://doi.acm.org/10.1145/2807442.2807463
  35. B. G. Witmer, C. J. Jerome, and M. J. Singer, "The factor structure of the presence questionnaire," Presence: Teleoper. Virtual Environ., vol. 14, no. 3, pp. 298-312, jun 2005. [Online]. Available: http://dx.doi.org/10.1162/105474605323384654
  36. W. A. Ijsselsteijn, Y. A. W. de Kort, and K. Poels, "The Game Experience Questionnaire: Development of aself-report measure to assess the psychological impact of digital games. Manuscript in Preparation," 2013.