Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Immersive Interaction Between HMD User and Non-HMD User for Presence of Asymmetric Virtual Reality

비대칭 가상현실에서의 현존감을 위한 HMD 사용자와 Non-HMD 사용자간 몰입형 상호작용에 관한 연구

  • Lee, Jiwon (Department of Software, Catholic University of Pusan) ;
  • Kim, Mingyu (Interdisciplinary Program in Visual Information Processing, Korea University) ;
  • Kim, Jinmo (Department of Software, Catholic University of Pusan)
  • 이지원 (부산가톨릭대학교 소프트웨어학과) ;
  • 김민규 (고려대학교 영상정보처리협동과정) ;
  • 김진모 (부산가톨릭대학교 소프트웨어학과)
  • Received : 2018.06.11
  • Accepted : 2018.07.04
  • Published : 2018.07.10
Download PDF
⟨ Previous Next ⟩

Abstract

This study proposes an immersive interaction optimized for the user's experience environment to provide an improved presence for both HMD and Non-HMD users in the asymmetric virtual reality (VR) environment. The core of the proposed immersive interaction is to distinguish the differences of the asymmetric environment between the HMD and Non-HMD users and present the optimized interaction to the user. And, in order to increase the presence by providing improved immersion in the asymmetric virtual reality environment given to each user, we design the walking interaction to improve the immersion of space for the HMD users, a hand-based interface that improves immersion by fully understanding and managing the situation through direct control. Finally, through the experiment using questionnaire, it is verified that the immersive interaction provides all users with an enhanced presence and specialized experience in each environment experience. Through these processes, we confirmed that the Non-HMD user can be immersed in an asymmetric virtual reality using by proposed interaction as participant rather than assistant with HMD user.

본 연구는 비대칭 가상현실 환경에 존재하는 HMD 사용자와 Non-HMD 사용자 모두에게 향상된 현존감을 제공하기 위하여 사용자의 체험 환경에 최적화된 몰입형 상호작용을 제안한다. 제안하는 몰입형 상호작용의 핵심은 HMD 사용자와 Non-HMD 사용자 사이의 비대칭 환경의 차이를 구분하여 사용자에게 최적화된 상호작용을 제시하는 것이다. 그리고 사용자 각각에게 주어지는 비대칭 가상현실 환경에서 향상된 몰입을 제공하여 현존감을 높이기 위하여 HMD 사용자에게는 공간의 몰입을 향상시키는 걷기 상호작용을, Non-HMD 사용자에게는 직접적인 조작을 통해 상황을 전체적으로 이해하고 관리함으로써 몰입을 향상시키는 손 기반 인터페이스를 설계한다. 마지막으로 몰입형 상호작용을 통해 모든 사용자가 향상된 현존감을 제공받으면서 동시에 각각의 체험에 환경에 특화된 경험을 하였음을 설문실험을 통해 검증한다. 이러한 과정들을 통하여 제안한 상호작용이 비대칭 가상현실에서 Non-HMD 사용자도 보조자가 아닌 참가자로써 HMD 사용자와 함께 몰입할 수 있음을 확인한다.

Keywords

References

  1. H. Joo, T. Simon, and Y. Sheikh, "Total capture: A 3d deformation model for tracking faces, hands, and bodies," CoRR, vol. abs/1801.01615, 2018.
  2. S. Marwecki, M. Brehm, L. Wagner, L.-P. Cheng, F. F. Mueller, and P. Baudisch, "Virtualspace - overloading physical space with multiple virtual reality users," in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ser. CHI '18. ACM, 2018, pp. 241:1-241:10.
  3. S. Han and J. Kim, "A study on immersion of hand interaction for mobile platform virtual reality contents," Symmetry, vol. 9, no. 2, p. 22, 2017. https://doi.org/10.3390/sym9020022
  4. C. Schissler, A. Nicholls, and R. Mehra, "Efficient hrtf-based spatial audio for area and volumetric sources," IEEE Transactions on Visualization and Computer Graphics, vol. 22, no. 4, pp. 1356-1366, Apr. 2016. https://doi.org/10.1109/TVCG.2016.2518134
  5. M. Kim, C. Jeon, and J. Kim, "A study on immersion and presence of a portable hand haptic system for immersive virtual reality," Sensors, vol. 17, no. 5, p. 1141, 2017. https://doi.org/10.3390/s17051141
  6. Y. Visell, J. R. Cooperstock, B. L. Giordano, K. Franinovic, A. Law, S. Mcadams, K. Jathal, and F. Fontana, "A vibrotactile device for display of virtual ground materials in walking," in Proceedings of the 6th International Conference on Haptics: Perception, Devices and Scenarios, ser. EuroHaptics '08. Springer-Verlag, 11-13 June 2008, pp. 420-426.
  7. C. D. Metcalf, S. V. Notley, P. H. Chappell, J. H. Burridge, and V. T. Yule, "Validation and application of a computational model for wrist and hand movements using surface markers," IEEE Transactions on Biomedical Engineering, vol. 55, no. 3, pp. 1199-1210, March 2008. https://doi.org/10.1109/TBME.2007.908087
  8. W. Zhao, J. Chai, and Y.-Q. Xu, "Combining markerbased mocap and rgb-d camera for acquiring high-fidelity hand motion data," in Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Eurographics Association, 29-31 July 2012, pp. 33-42.
  9. C. Carvalheiro, R. N'obrega, H. da Silva, and R. Rodrigues, "User redirection and direct haptics in virtual environments," in Proceedings of the 2016 ACM on Multimedia Conference, ser. MM '16. ACM, 15-19 October 2016, pp. 1146-1155.
  10. E. Remelli, A. Tkach, A. Tagliasacchi, and M. Pauly, "Lowdimensionality calibration through local anisotropic scaling for robust hand model personalization," in 2017 IEEE International Conference on Computer Vision (ICCV), 2017, pp. 2554-2562.
  11. K. Vasylevska, H. Kaufmann, M. Bolas, and E. A. Suma, "Flexible spaces: Dynamic layout generation for infinite walking in virtual environments," in 2013 IEEE Symposium on 3D User Interfaces. IEEE, 16-17 March 2013, pp. 39-42.
  12. Z.-C. Dong, X.-M. Fu, C. Zhang, K.Wu, and L. Liu, "Smooth assembled mappings for large-scale real walking," ACM Trans. Graph., vol. 36, no. 6, pp. 211:1-211:13, Nov. 2017.
  13. J. Lee, K. Jeong, and J. Kim, "Mave: Maze-based immersive virtual environment for new presence and experience," Computer Animation and Virtual Worlds, vol. 28, no. 3-4, p. e1756, 2017. https://doi.org/10.1002/cav.1756
  14. D. Leonardis, M. Solazzi, I. Bortone, and A. Frisoli, "A 3-rsr haptic wearable device for rendering fingertip contact forces," IEEE Transactions on Haptics, vol. 10, no. 3, pp. 305-316, July 2017. https://doi.org/10.1109/TOH.2016.2640291
  15. D. Prattichizzo, F. Chinello, C. Pacchierotti, and M. Malvezzi, "Towards wearability in fingertip haptics: A 3-dof wearable device for cutaneous force feedback," IEEE Transactions on Haptics, vol. 6, no. 4, pp. 506-516, Oct 2013. https://doi.org/10.1109/TOH.2013.53
  16. J. Gugenheimer, E. Stemasov, J. Frommel, and E. Rukzio, "Sharevr: Enabling co-located experiences for virtual reality between hmd and non-hmd users," in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ser. CHI '17. ACM, 2017, pp. 4021-4033.
  17. M. Slater and M. Usoh, "Simulating peripheral vision in immersive virtual environments," Computers & Graphics, vol. 17, no. 6, pp. 643 - 653, 1993. https://doi.org/10.1016/0097-8493(93)90113-N
  18. M. Slater, M. Usoh, and A. Steed, "Taking steps: The influence of a walking technique on presence in virtual reality," ACM Trans. Comput.-Hum. Interact., vol. 2, no. 3, pp. 201-219, Sept. 1995. https://doi.org/10.1145/210079.210084
  19. V. Vinayagamoorthy, M. Garau, A. Steed, and M. Slater, "An eye gaze model for dyadic interaction in an immersive virtual environment: Practice and experience," Computer Graphics Forum, vol. 23, no. 1, pp. 1-11, 2004. https://doi.org/10.1111/j.1467-8659.2004.00001.x
  20. M. Slater and M. V. Sanchez-Vives, "Transcending the self in immersive virtual reality," Computer, vol. 47, no. 7, pp. 24-30, July 2014. https://doi.org/10.1109/MC.2014.198
  21. M. Slater and M. V. Sanchez-Vives, "Enhancing our lives with immersive virtual reality," Frontiers in Robotics and AI, vol. 3, p. 74, 2016.
  22. M. Roussou and M. Slater, "Comparison of the effect of interactive versus passive virtual reality learning activities in evoking and sustaining conceptual change," IEEE Transactions on Emerging Topics in Computing, pp. 1-1, 2017.
  23. R. Hortensius, S. Neyret, M. Slater, and B. de Gelder, "The relation between bystanders' behavioral reactivity to distress and later helping behavior during a violent conflict in virtual reality," PLOS ONE, vol. 13, no. 4, pp. 1-20, 04 2018.
  24. J. Lee, M. Kim, and J. Kim, "A study on immersion and vr sickness in walking interaction for immersive virtual reality applications," Symmetry, vol. 9, no. 5, p. 78, 2017. https://doi.org/10.3390/sym9050078
  25. C. Carlsson and O. Hagsand, "Dive a multi-user virtual reality system," in Proceedings of IEEE Virtual Reality Annual International Symposium, Sep 1993, pp. 394-400.
  26. K.-D. Le, M. Fjeld, A. Alavi, and A. Kunz, "Immersive environment for distributed creative collaboration," in Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, ser. VRST '17. ACM, 2017, pp. 16:1-16:4.
  27. S. W. Hong, A. E. Antably, and Y. E. Kalay, "Architectural design creativity in multi-user virtual environment: A comparative analysis between remote collaboration media," Environment and Planning B: Urban Analytics and City Science, 2017.
  28. S. Greenwald, A. Kulik, A. Kunert, S. Beck, B. Frohlich, S. Cobb, S. Parsons, N. Newbutt, C. Gouveia, C. Cook, A. Snyder, S. Payne, J. Holland, S. Buessing, G. Fields, W. Corning, V. Lee, L. Xia, and P. Maes, "Technology and applications for collaborative learning in virtual reality," in Making a Difference: Prioritizing Equity and Access in CSCL, 12th International Conference on Computer Supported Collaborative Learning (CSCL), ser. CSCL '17. International Society of the Learning Sciences, 18-22 June 2017, pp. 719-726.
  29. D. Economou, I. Doumanis, L. Argyriou, and N. Georgalas, "User experience evaluation of human representation in collaborative virtual environments," Personal Ubiquitous Comput., vol. 21, no. 6, pp. 989-1001, Dec. 2017. https://doi.org/10.1007/s00779-017-1075-4
  30. J. C. Oliveira, X. Shen, and N. D. Georganas, "Collaborative virtual environment for industrial training and e-commerce," in IEEE VRTS 288, 2000.
  31. T. Duval and C. Fleury, "An asymmetric 2d pointer/3d ray for 3d interaction within collaborative virtual environments," in Proceedings of the 14th International Conference on 3D Web Technology. ACM, 2009, pp. 33-41.
  32. O. Oda, C. Elvezio, M. Sukan, S. Feiner, and B. Tversky, "Virtual replicas for remote assistance in virtual and augmented reality," in Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, ser. UIST '15. ACM, 2015, pp. 405-415.
  33. D. Clergeaud, J. S. Roo, M. Hachet, and P. Guitton, "Towards seamless interaction between physical and virtual locations for asymmetric collaboration," in Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, ser. VRST '17. ACM, 2017, pp. 17:1-17:4.
  34. L.-P. Cheng, P. Luhne, P. Lopes, C. Sterz, and P. Baudisch, "Haptic turk: A motion platform based on people," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 26 April-1 May 2014, pp. 3463-3472.
  35. L.-P. Cheng, T. Roumen, H. Rantzsch, S. Kohler, P. Schmidt, R. Kovacs, J. Jasper, J. Kemper, and P. Baudisch, "Turkdeck: Physical virtual reality based on people," in Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 8-11 November 2015, pp. 417-426.
  36. SCE-Japan-Studio, "The playroom vr," Game [PS4/PS VR], 2016. [Online]. Available: https://www.playstation.com/engb/games/the-playroom-vr-ps4/
  37. P. Sajjadi, E. O. Cebolledo Gutierrez, S. Trullemans, and O. De Troyer, "Maze commander: A collaborative asynchronous game using the oculus rift & the sifteo cubes," in Proceedings of the First ACM SIGCHI Annual Symposium on Computer-human Interaction in Play, ser. CHI PLAY '14. ACM, 2014, pp. 227-236.
  38. M. Kim, J. Lee, C. Kim, and J. Kim, "Tpvr: User interaction of third person virtual reality for new presence and experience," Symmetry, vol. 10, no. 4, p. 109, 2018. https://doi.org/10.3390/sym10040109
  39. B. G. Witmer, C. J. Jerome, and M. J. Singer, "The factor structure of the presence questionnaire," Presence: Teleoper. Virtual Environ., vol. 14, no. 3, pp. 298-312, jun 2005. https://doi.org/10.1162/105474605323384654
  40. W. A. Ijsselsteijn, Y. A.W. de Kort, and K. Poels, "The Game Experience Questionnaire:Development of a self-report measure to assess the psychological impact of digital games. Manuscript in Preparation," 2013.