Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Production and Experience of Immersive Contents based on Mixed Reality and Virtual Reality using Meta Quest Pro

메타 퀘스트 프로를 활용한 혼합현실과 가상현실 기반의 몰입형 콘텐츠 제작 및 경험에 관한 연구

  • Jongseon Kim (Division of Computer Engineering, Hansung University) ;
  • Sumin Kong (Division of Computer Engineering, Hansung University) ;
  • Moonsu Jang (Division of Computer Engineering, Hansung University) ;
  • Jinmo Kim (Division of Computer Engineering, Hansung University)
  • Received : 2024.06.15
  • Accepted : 2024.07.05
  • Published : 2024.07.25
Download PDF
⟨ Previous Next ⟩

Abstract

This study organizes an immersive content production pipeline using Meta Quest Pro as an asymmetric virtual environment where mixed reality(MR) and virtual reality(VR) users participate and interact together. Based on this, we compare and analyze the differences in presence and experience provided by the user's experience environment. The proposed production process is to build an integrated development environment using Meta XR All-in-One SDK based on the Unity 3D engine. This includes a real space analysis method using the Room Model function for organic and accurate interaction between MR users in the real world and VR users based on virtual scenes at fixed coordinates. Based on this, this study produces immersive table tennis content where MR and VR users participate together. Finally, we conduct survey experiments to compare and analyze the effects of differences in platform and participation methods on presence and experience using the produced content. As a result, this study confirmed that all users can feel a satisfactory presence and experience within an experience environment where real and virtual correspond.

본 연구는 혼합현실 사용자와 가상현실 사용자가 함께 참여하여 상호작용하는 비대칭 가상환경으로 메타 퀘스트 프로를 활용한 몰입형 콘텐츠 제작공정을 정리한다. 이를 기반으로 사용자의 체험 환경이 제공하는 현존감과 경험의 차이를 비교 분석한다. 제안하는 제작공정은 유니티 3D 엔진을 기반으로 Meta XR All-in-One SDK를 활용하여 통합 개발환경을 구축하는 것이다. 이는 현실 세계의 혼합현실 사용자와 가상 장면을 기반으로 하는 가상현실 사용자가 고정된 좌표에서 유기적이고 정확한 상호작용을 위하여 Room Model 기능을 활용한 현실 공간 분석 방법을 포함한다. 이를 토대로, 본 연구는 혼합현실 사용자와 가상현실 사용자가 함께 활동하는 몰입형 탁구 콘텐츠를 제작한다. 마지막으로, 제작된 콘텐츠를 활용하여 플랫폼 및 참여 방식의 차이가 현존감과 경험에 미치는 영향을 비교 분석하기 위한 설문 실험을 진행한다. 그 결과, 본 연구는 현실과 가상이 대응되는 체험 환경 내에서 모든 사용자가 만족하는 현존감과 경험을 느낄 수 있음을 확인하였다.

Keywords

References

  1. Y. Cho, M. Park and J. Kim, "XAVE: Cross-Platform Based Asymmetric Virtual Environment for Immersive Content," IEEE Access, vol. 11, pp. 71890-71904, 2023. https://doi.org/10.1109/ACCESS.2023.3294390
  2. Zhu E, Hadadgar A, Masiello I, and Zary N. "Augmented reality in healthcare education: an integrative review," PeerJ, 8;2: e469. 2014.
  3. X. Qian, F. He, X. Hu, T. Wang, A. Ipsita, and K. Ramani. "ScalAR: Authoring Semantically Adaptive Augmented Reality Experiences in Virtual Reality," In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22), Association for Computing Machinery, New York, NY, USA, Article 65, 1-18, 2022.
  4. J. Lee and T. Lee, "Development of contents based on virtual environment of basic physics education," Journal of the Korea Computer Graphics Society, vol. 29. no. 3 pp. 149-158, 2023. https://doi.org/10.15701/kcgs.2023.29.3.149
  5. T. Kang, D. Lee and J. Kim, "Production of Digital Fashion Contents based on Augmented Reality Using CLO 3D and Vuforia," Journal of the Korea Computer Graphics Society, vol. 26. no. 3 pp. 21-29, 2020. https://doi.org/10.15701/kcgs.2020.26.3.21
  6. J. Kim, J. Song, J. Park, J. Nam, S. Yoon and S. Park, "Mixed Reality Extension System Using Beam Projectors : Beyond the Sight," Journal of the Korea Computer Graphics Society, vol. 25. no. 3 pp. 65-73, 2019.
  7. De Back, T. T., Tinga, A. M., and Louwerse, M. M,. "Learning in immersed collaborative virtual environments: design and implementation," Interactive Learning Environments, vol. 31, no. 8, pp. 5364-5382, 2021. https://doi.org/10.1080/10494820.2021.2006238
  8. S. Park, W. Park, H. Heo and J. Kim, "A Study on Presence of Collaboration based Multi-user Interaction in Immersive Virtual Reality," Journal of the Korea Computer Graphics Society, vol. 24. no. 3 pp. 11-20, 2018. https://doi.org/10.15701/KCGS.2018.24.3.11
  9. Lee, J., Kim, M. and Kim, J., "RoleVR: Multi-experience in immersive virtual reality between co-located HMD and non-HMD users," Multimedia Tools and Applications, vol. 79, pp. 979-1005, 2020. https://doi.org/10.1007/s11042-019-08220-w
  10. Cho Y, Kang J, Jeon J, Park J, Kim M, and Kim J., "X-person asymmetric interaction in virtual and augmented realities," Computer Animation and Virtual Worlds, vol. 32, issue 5, e1985, 2020.
  11. P. Jansen, F. Fischbach, J. Gugenheimer, E. Stemasov, J. Frommel and E. Rukzio, "ShARe: Enabling Co-Located Asymmetric Multi-User Interaction for Augmented Reality Head-Mounted Displays," In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology, Association for Computing Machinery, New York, NY, USA, 459-471, 2020.
  12. J. An, J. H. Lee, S. Park and I. Ihm, "Integrating Heterogeneous VR Systems Into Physical Space for Collaborative Extended Reality," IEEE Access, vol. 12, pp. 9848-9859, 2024. https://doi.org/10.1109/ACCESS.2023.3347781
  13. L. Oppermann, F. Buchholz and Y. Uzun, "Industrial Metaverse: Supporting remote maintenance with avatars and digital twins in collaborative XR environments," In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA '23), Association for Computing Machinery, New York, NY, USA, Article 178, 1-5, 2023.
  14. K. Le, M. Fjeld, A. Alavi and A. Kunz, "Immersive environment for distributed creative collaboration," In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (VRST '17), Association for Computing Machinery, New York, NY, USA, Article 16, 1-4, 2017.
  15. J. G. Grandi, H. G. Debarba, I. Bemdt, L. Nedel and A. Maciel, "Design and Assessment of a Collaborative 3D Interaction Technique for Handheld Augmented Reality," 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Tuebingen/Reutlingen, Germany, pp. 49-56, 2018.
  16. T. Duval and C. Fleury, "An asymmetric 2D Pointer/3D Ray for 3D interaction within collaborative virtual environments," In Proceedings of the 14th International Conference on 3D Web Technology (Web3D '09), Association for Computing Machinery, New York, NY, USA, 33-41, 2009.
  17. J. G. Grandi, H. G. Debarba and A. Maciel, "Characterizing Asymmetric Collaborative Interactions in Virtual and Augmented Realities," 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan, 2019.
  18. J. Gugenheimer, E. Stemasov, J. Frommel and E. Rukzio, "ShareVR: Enabling Co-Located Experiences for Virtual Reality between HMD and Non-HMD Users," In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), Association for Computing Machinery, New York, NY, USA, 4021-4033, 2017.
  19. N. Feld and B. Weyers, "Mixed Reality in Asymmetric Collaborative Environments: A Research Prototype for Virtual City Tours," in 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Lisbon, Portugal, pp. 250-256, 2021.
  20. S. Karaosmanoglu, K. Rogers, D. Wolf, E. Rukzio, F. Steinicke and L.E. Nacke, "Feels like Team Spirit: Biometric and Strategic Interdependence in Asymmetric Multiplayer VR Games," In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21), Association for Computing Machinery, New York, NY, USA, Article 443, 1-15, 2021.
  21. M. Sra, S. Garrido-Jurado and P. Maes, "Oasis: Procedurally Generated Social Virtual Spaces from 3D Scanned Real Spaces," IEEE Transactions on Visualization and Computer Graphics, vol. 24, no. 12, pp. 3174-3187, 1 Dec. 2018. https://doi.org/10.1109/TVCG.2017.2762691
  22. H. Tian, G. A. Lee, H. Bai and M. Billinghurst, "Using Virtual Replicas to Improve Mixed Reality Remote Collaboration," IEEE Transactions on Visualization and Computer Graphics, vol. 29, no. 5, pp. 2785-2795, May 2023. https://doi.org/10.1109/TVCG.2023.3247113
  23. A. Prouzeau, Y. Wang, B. Ens, W. Willett and T. Dwyer, "Corsican Twin: Authoring In Situ Augmented Reality Visualisations in Virtual Reality," In Proceedings of the International Conference on Advanced Visual Interfaces (AVI '20), Association for Computing Machinery, New York, NY, USA, Article 11, pp. 1-9, 2020.
  24. I. Radu, T. Joy and B. Schneider, "Virtual Makerspaces: Merging AR/VR/MR to Enable Remote Collaborations in Physical Maker Activities," In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, New York, NY, USA, Article 202, pp. 1-5, 2021.
  25. E. Schott, E.B. Makled, T.J. Zoeppig, S. Muehlhaus, F. Weidner, W. Broll and B. Froehlich, "UniteXR: Joint Exploration of a Real-World Museum and its Digital Twin," In Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology (VRST '23), Association for Computing Machinery, New York, NY, USA, Article 25, pp. 1-10, 2023.
  26. Unity engine, UnityTechnologies, [Internet] Available: https://unity.com/, 2022.
  27. Meta XR All-in-One SDK, Meta Quest, [Internet] Available: https://assetstore.unity.com/packages/tools/integration/meta-xr-all-in-one-sdk-269657, 2024.
  28. Photon Engine, Photon, [Internet] Available: https://www.photonengine.com/ko-kr, 2024.
  29. B. Witmer., C. Jerome, and M. Singer, "The factor structure of the presence questionnaire," Presence: Teleoperators and Virtual Environments, vol. 14, no. 3, pp. 298-312, 2005. https://doi.org/10.1162/105474605323384654
  30. Poels, K., de Kort, Y. A. W., and IJsselsteijn, W. A., "Game Experience Questionnaire: development of a self-report measure to assess the psychological impact of digital games," Technische Universiteit Eindhoven, pp. 1-9, 2013.