Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Presence of Collaboration based Multi-user Interaction in Immersive Virtual Reality

몰입형 가상현실에서의 협업 기반 다수 사용자 상호작용의 현존감에 관한 연구

  • Park, Seongjun (Department of Software, Catholic University of Pusan) ;
  • Park, Wonjun (Department of Software, Catholic University of Pusan) ;
  • Heo, Hayoung (Department of Software, Catholic University of Pusan) ;
  • Kim, Jinmo (Department of Software, Catholic University of Pusan)
  • 박성준 (부산가톨릭대학교 소프트웨어학과) ;
  • 박원준 (부산가톨릭대학교 소프트웨어학과) ;
  • 허하영 (부산가톨릭대학교 소프트웨어학과) ;
  • 김진모 (부산가톨릭대학교 소프트웨어학과)
  • Received : 2018.06.12
  • Accepted : 2018.07.04
  • Published : 2018.07.10
Download PDF
⟨ Previous Next ⟩

Abstract

This study proposes collaboration based multi-user interaction to provide improved presence and satisfying experience to multiple HMD users in immersive virtual reality. The core of the proposed multi-user interaction is to present the direction in which HMD users in virtual reality environment can interact through communication and collaboration with each other based on their separate roles and behaviors. Each user in the virtual collaborative environment uses a hand to interact with a virtual environment or virtual objects. Based on the basic structure, this study designs methods (synchronization and communication) that can be achieved a common goal together through communication and collaboration. Then, this study creates a virtual reality application of arcade genre that considers communication and collaboration in order to verify whether the proposed multi-user interaction provides improved presence and satisfaction experience. And, the survey experiments are conducted for participants. Through these processes, it is confirmed that the interaction in the proposed immersive virtual collaborative environments provide the presence and experience that is satisfactory to all users.

본 연구는 몰입형 가상현실에 존재하는 다수의 HMD 사용자들에게 보다 향상된 현존감과 만족스러운 경험을 제공하기 위하여 협업기반 다수 사용자 상호작용을 제안한다. 제안하는 다수 사용자 상호작용의 핵심은 가상현실 환경에 존재하는 HMD 사용자가 각자 구분된 역할과 행동을 기반으로 소통과 협업을 통해 상호작용할 수 있는 방향을 제시하는 것이다. 가상협업환경에 존재하는 사용자 각각은 손을 활용하여 가상 환경 또는 가상의 객체와 직접적으로 상호작용하는 기본 구조를 바탕으로 사용자간 소통과 협업을 통해 공동의 목표를 수행해 갈 수 있는 방식(동기화, 의사소통)을 함께 설계한다. 그런 다음 제안하는 다수 사용자 상호작용을 통해 향상된 현존감과 만족하는 경험을 제공하는지를 검증하기 위하여 소통과 협업을 고려한 아케이드 장르의 가상현실 어플리케이션을 제작한다. 그리고 참가자들을 대상으로 한 설문 실험을 진행한다. 이러한 과정들을 통해 제안한 몰입형 가상협업환경에서의 상호작용이 사용자 모두에게 만족하는 현존감과 경험을 제공함을 확인한다.

Keywords

References

  1. I. E. Sutherland, "A head-mounted three dimensional display," in Proceedings of the Fall Joint Computer Conference, Part I, ser. AFIPS'68 (Fall, part I). ACM, 9-11 December 1968, pp. 757-764.
  2. S. Han and J. Kim, "A study on immersion of hand interaction for mobile platform virtual reality contents," Symmetry, vol. 9, no. 2, p. 22, 2017. https://doi.org/10.3390/sym9020022
  3. D. Leonardis, M. Solazzi, I. Bortone, and A. Frisoli, "A 3-rsr haptic wearable device for rendering fingertip contact forces," IEEE Transactions on Haptics, vol. 10, no. 3, pp. 305-316, July 2017. https://doi.org/10.1109/TOH.2016.2640291
  4. Z.-C. Dong, X.-M. Fu, C. Zhang, K.Wu, and L. Liu, "Smooth assembled mappings for large-scale real walking," ACM Trans. Graph., vol. 36, no. 6, pp. 211:1-211:13, Nov. 2017.
  5. C. Schissler and D. Manocha, "Interactive sound propagation and rendering for large multi-source scenes," ACM Trans. Graph., vol. 36, no. 1, Sept. 2016.
  6. H. Joo, T. Simon, and Y. Sheikh, "Total capture: A 3d deformation model for tracking faces, hands, and bodies," CoRR, vol. abs/1801.01615, 2018.
  7. M. Kim, J. Lee, C. Jeon, and J. Kim, "A study on interaction of gaze pointer-based user interface in mobile virtual reality environment," Symmetry, vol. 9, no. 9, p. 189, 2017. https://doi.org/10.3390/sym9090189
  8. M. Kim, C. Jeon, and J. Kim, "A study on immersion and presence of a portable hand haptic system for immersive virtual reality," Sensors, vol. 17, no. 5, p. 1141, 2017. https://doi.org/10.3390/s17051141
  9. J. Lee, K. Jeong, and J. Kim, "Mave: Maze-based immersive virtual environment for new presence and experience," Computer Animation and Virtual Worlds, vol. 28, no. 3-4, p. e1756, 2017. https://doi.org/10.1002/cav.1756
  10. L.-P. Cheng, T. Roumen, H. Rantzsch, S. Kohler, P. Schmidt, R. Kovacs, J. Jasper, J. Kemper, and P. Baudisch, "Turkdeck: Physical virtual reality based on people," in Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, ser. UIST '15. ACM, 8-11 November 2015, pp. 417-426.
  11. J. Gugenheimer, E. Stemasov, J. Frommel, and E. Rukzio, "Sharevr: Enabling co-located experiences for virtual reality between hmd and non-hmd users," in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ser. CHI '17. ACM, 2017, pp. 4021-4033.
  12. C. Schissler, A. Nicholls, and R. Mehra, "Efficient hrtf-based spatial audio for area and volumetric sources," IEEE Transactions on Visualization and Computer Graphics, vol. 22, no. 4, pp. 1356-1366, Apr. 2016. https://doi.org/10.1109/TVCG.2016.2518134
  13. D. Prattichizzo, F. Chinello, C. Pacchierotti, and M. Malvezzi, "Towards wearability in fingertip haptics: A 3-dof wearable device for cutaneous force feedback," IEEE Transactions on Haptics, vol. 6, no. 4, pp. 506-516, Oct 2013. https://doi.org/10.1109/TOH.2013.53
  14. W. Zhao, J. Chai, and Y.-Q. Xu, "Combining markerbased mocap and rgb-d camera for acquiring high-fidelity hand motion data," in Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ser. SCA '12. Eurographics Association, 29-31 July 2012, pp. 33-42.
  15. E. Remelli, A. Tkach, A. Tagliasacchi, and M. Pauly, "Lowdimensionality calibration through local anisotropic scaling for robust hand model personalization," in 2017 IEEE International Conference on Computer Vision (ICCV), 2017, pp. 2554-2562.
  16. V. Hayward, O. R. Astley, M. Cruz-Hernandez, D. Grant, and G. Robles-De-La-Torre, "Haptic interfaces and devices," Sensor Review, vol. 24, no. 1, pp. 16-29, 2004. https://doi.org/10.1108/02602280410515770
  17. R. Nordahl, A. Berrezag, S. Dimitrov, L. Turchet, V. Hayward, and S. Serafin, "Preliminary experiment combining virtual reality haptic shoes and audio synthesis," in Proceedings of the 2010 International Conference on Haptics - Generating and Perceiving Tangible Sensations: Part II, ser. Euro-Haptics'10. Springer-Verlag, 8-10 July 2010, pp. 123-129.
  18. D. N. E. Phon, M. B. Ali, and N. D. A. Halim, "Collaborative augmented reality in education: A review," in Proceedings of the 2014 International Conference on Teaching and Learning in Computing and Engineering, ser. LATICE '14. IEEE Computer Society, 2014, pp. 78-83.
  19. K.-D. Le, M. Fjeld, A. Alavi, and A. Kunz, "Immersive environment for distributed creative collaboration," in Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, ser. VRST '17. ACM, 2017, pp. 16:1-16:4.
  20. S. Marwecki, M. Brehm, L. Wagner, L.-P. Cheng, F. F. Mueller, and P. Baudisch, "Virtualspace - overloading physical space with multiple virtual reality users," in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ser. CHI '18. ACM, 2018, pp. 241:1-241:10.
  21. J. Lacoche, N. Pallamin, T. Boggini, and J. Royan, "Collaborators awareness for user cohabitation in co-located collaborative virtual environments," in Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, ser. VRST '17. ACM, 2017, pp. 15:1-15:9.
  22. T. Piumsomboon, A. Day, B. Ens, Y. Lee, G. Lee, and M. Billinghurst, "Exploring enhancements for remote mixed reality collaboration," in SIGGRAPH Asia 2017 Mobile Graphics&Interactive Applications, ser. SA '17. New York, NY, USA: ACM, 2017, pp. 16:1-16:5.
  23. N. Pretto and F. Poiesi, "Towards gesture-based multi-user interactions in collaborative virtual environments," ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-2/W8, pp. 203-208, 2017. https://doi.org/10.5194/isprs-archives-XLII-2-W8-203-2017
  24. H. Ibayashi, Y. Sugiura, D. Sakamoto, N. Miyata, M. Tada, T. Okuma, T. Kurata, M. Mochimaru, and T. Igarashi, "Dollhouse vr: A multi-view, multi-user collaborative design workspace with vr technology," in SIGGRAPH Asia 2015 Emerging Technologies, ser. SA '15. ACM, 2015, pp. 8:1-8:2.
  25. Farpoint-VR, "Farpoint vr," Game [Playstation VR], 2018. [Online]. Available: https://www.playstation.com/enus/games/farpoint-ps4/
  26. B. G. Witmer, C. J. Jerome, and M. J. Singer, "The factor structure of the presence questionnaire," Presence: Teleoper. Virtual Environ., vol. 14, no. 3, pp. 298-312, jun 2005. https://doi.org/10.1162/105474605323384654
  27. W. A. Ijsselsteijn, Y. A.W. de Kort, and K. Poels, "The Game Experience Questionnaire:Development of a self-report measure to assess the psychological impact of digital games. Manuscript in Preparation," 2013.

Cited by

  1. Study on the Expanded Interface in Immersive Virtual Reality Content vol.21, pp.9, 2018, https://doi.org/10.9728/dcs.2020.21.9.1599
  2. Study on the Expanded Interface in Immersive Virtual Reality Content vol.21, pp.9, 2018, https://doi.org/10.9728/dcs.2020.21.9.1599
  3. Study on the Expanded Interface in Immersive Virtual Reality Content vol.21, pp.9, 2018, https://doi.org/10.9728/dcs.2020.21.9.1599
  4. Analysis of AR · VR-based Visual Design Cases for Realistic reporting Graphics vol.22, pp.3, 2018, https://doi.org/10.9728/dcs.2021.22.3.405