Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

Exploring the Effects of Passive Haptic Factors When Interacting with a Virtual Pet in Immersive VR Environment

몰입형 VR 환경에서 가상 반려동물과 상호작용에 관한 패시브 햅틱 요소의 영향 분석

  • Donggeun KIM (Department of Electrical, Electronic and Computer Engineering, University of Ulsan) ;
  • Dongsik Jo (Department of IT Convergence, University of Ulsan)
  • 김동근 (울산대학교 전기전자컴퓨터공학과) ;
  • 조동식 (울산대학교 IT융합학부)
  • Received : 2024.06.15
  • Accepted : 2024.07.05
  • Published : 2024.07.25
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, with immersive virtual reality(IVR) technologies, various services such as education, training, entertainment, industry, healthcare and remote collaboration have been applied. In particular, researches are actively being studied to visualize and interact with virtual humans, research on virtual pets in IVR is also emerging. For interaction with the virtual pet, similar to real-world interaction scenarios, the most important thing is to provide physical contact such as haptic and non-verbal interaction(e.g., gesture). This paper investigates the effects on factors (e.g., shape and texture) of passive haptic feedbacks using mapping physical props corresponding to the virtual pet. Experimental results show significant differences in terms of immersion, co-presence, realism, and friendliness depending on the levels of texture elements when interacting with virtual pets by passive haptic feedback. Additionally, as the main findings of this study by statistical interaction between two variables, we found that there was Uncanny valley effect in terms of friendliness. With our results, we will expect to be able to provide guidelines for creating interactive contents with the virtual pet in immersive VR environments.

최근, 몰입형 가상현실(IVR) 환경에서 가상 객체(Virtual Object)를 이용한 상호작용을 통해 교육, 의료, 산업, 원격지 협업 등 다양한 서비스에 활용되고 있다. 특히, 인공지능(AI) 기술을 접목하여 가상 휴먼을 사용자에게 가시화하고, 상호작용을 수행하는 연구가 활발하게 진행되고 있고, 이를 확장한 가상 반려동물에 관한 연구도 시작되고 있는 단계이다. 몰입 VR공간에서 가상 반려동물과 상호작용을 수행하기 위해서는 실제 환경에서 반려동물과 신체 접촉(쓰다듬기 등) 및 제스처와 같은 비언어적 상호작용(Non-verbal Interaction)이 소통을 위해 중요한 것처럼 가상 환경에서도 이러한 상호작용의 재현을 통해 몰입 경험을 높이는 요소에 대한 영향 분석이 필요하다. 본 논문에서는 몰입형 VR 환경에서 사용자가 가상 반려동물과 상호작용 체험을 수행할 때 패시브 햅틱(Passive Haptic)을 제공하고, 그 촉각(Tactile) 요소에 대한 영향 분석을 수행하였다. 패시브 햅틱의 촉각(Tactile) 요소를 모양(shape), 재질(texture) 항목으로 분류하여 그 변화의 정도에 따라 상호작용 효과에 어떠한 영향이 있는지 측정하였다. 실험 결과, 패시브 햅틱 피드백이 제공되는 몰입형 가상 환경에서 가상 반려동물 상호작용을 수행할 때 재질 요소의 단계(Level)의 차이에 따라 몰입감(Immersion), 공존감(Co-presence), 사실감(Realism), 친근감(Fridenliness) 측면에서 통계적으로 유의미한 차이가 있다는 것을 알 수 있었다. 또한, 재질과 모양에 따른 통계적 상호작용 영향 분석에서 친근함 측정 결과에서 불쾌한 골짜기(Uncanny Valley) 효과가 있다는 것을 확인하였다. 본 논문의 연구 결과는 가상 반려동물 상호작용을 수행하는 콘텐츠 개발에 가이드라인으로 기여할 것으로 기대된다.

Keywords

Acknowledgement

본 과제(결과물)는 2023년도 교육부의 재원으로 한국연구재단의 지원을 받아 수행된 지자체-대학 협력기반 지역혁신 사업의 결과입니다. (2021RIS-003)

References

  1. K. Christos, and D. M.-Grigoriou, "Social interaction with agents and avatars in immersive virtual environments: A survey." Frontiers in Virtual Reality, 2, 786665, 2022.
  2. N. Norouzi, G. Bruder, J. Bailenson, and G. Welch, "Investigating augmented reality animals as companions." 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), IEEE, pp. 400-403. 2019.
  3. A. Griffin, K. Hurley, and S. McCune, "Human-animal interaction research: Progress and possibilities." Frontiers in Psychology, 10, 479105, 2019.
  4. D. Bylieva, N. Almazova, V. Lobatyuk, and A. Rubtsova, "Virtual pet: trends of development.", The 2018 International Conference on Digital Science., pp. 545-554., 2019.
  5. R. Ismo et al, "Technologies for multimodal interaction in extended reality-a scoping review." Multimodal Technologies and Interaction., 5, 12, 81, 2021.
  6. C. Simon, M. Boukli-Hacene, F. Lebrun, S. Otmane, and A. Chellali, "Impact of Multimodal Instructions for Tool Manipulation Skills on Performance and User Experience in an Immersive Environment." 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)., pp. 670-680, 2024.
  7. M. Marucci, G. Di Flumeri, G. Borghini, N. Sciaraffa, M. Scandola, E. Pavone, and P. Arico, "The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence." Scientific Reports , 11, 1, 4831, 2021.
  8. J.A.Oxley, K.Santa, G.Meyer, and C.Westgarth. "A systematic scoping review of human-dog interactions in virtual and augmented reality: The use of virtual dog models and immersive equipment." Frontiers in Virtual Reality, 3, 782023, 2022.
  9. I.Rakkolainen, A.Farooq, J.Kangas, J.Hakulinen, J.Rantala, M.Turunen, and R.Raisamo. "Technologies for multimodal interaction in extended reality-a scoping review." Multimodal Technologies and Interaction ,5, 12, 81, 2021.
  10. J.Grubert, L.Witzani, E.Ofek, M.Pahud, M.Kranz, and P.O.Kristensson. "Text entry in immersive head-mounted display-based virtual reality using standard keyboards." 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 159-166, 2018.
  11. D.Kim, Y.Kim, and D.Jo. "Exploring the Effect of Virtual Environments on Passive Haptic Perception." Applied Sciences, 13, 1 ,299, 2022.
  12. Z.Y.Zhang, H.X.Chen, S.H.Wang, and H.R.Tsai. "ELAXO: Rendering Versatile Resistive force feedback for fingers grasping and twisting." Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology, pp.1-14, 2022.
  13. A.Zenner, K.Ullmann, and A.Kruger. "Combining dynamic passive haptics and haptic retargeting for enhanced haptic feedback in virtual reality." IEEE Transactions on Visualization and Computer Graphics, 27, 5, pp.2627-2637, 2021. https://doi.org/10.1109/TVCG.2021.3067777
  14. B.Freeling, F.Lecuyer, and A.Capobianco. "Petting a cat helps you incarnate the avatar: Influence of the emotions over embodiment in VR." 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 141-149, 2022.
  15. K.McAnally, and G.Wallis. "Visual-haptic integration, action and embodiment in virtual reality." Psychological Research, 86, 6, pp.1847-1857, 2022. https://doi.org/10.1007/s00426-021-01613-3
  16. N.Norouzi, K.Kim, G.Bruder, J.N. Bailenson, P.Wisniewski, and G.F.Welch. "The advantages of virtual dogs over virtual people: Using augmented reality to provide social support in stressful situations." International Journal of Human-Computer Studies,165, 102838, 2022.
  17. S.Lim, and S.Y.Dong. "Effects of Interaction with Virtual Pets on Self-Disclosure in Mixed Reality." 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 1-9, 2023.
  18. W.Liang, X.Yu, R.Alghofaili, Y.Lang, and L.F.Yu. "Scene-aware behavior synthesis for virtual pets in mixed reality." Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp.1-12, 2021.
  19. S.Aziz, D.J.Lohr, L.Friedman, and O.Komogortsev. "Evaluation of Eye Tracking Signal Quality for Virtual Reality Applications: A Case Study in the Meta Quest Pro." arXiv preprint arXiv:2403.07210, 2024.
  20. Z.Yang, C.Y.Li, A.Bhalla, B.Y.Zhao, and H.Zheng. "Inception Attacks: Immersive Hijacking in Virtual Reality Systems." arXiv preprint arXiv:2403.05721, 2024.
  21. L.D.Riek. "Wizard of oz studies in hri: a systematic review and new reporting guidelines." Journal of Human-Robot Interaction, 1, 1, pp. 119-136, 2012. https://doi.org/10.5898/JHRI.1.1.Riek
  22. D.Kim, and D.Jo. " Relative Benefit Evaluation on Animation Quality for Augmented Reality Pet." PROCEEDINGS OF HCI KOREA 2024, pp. 43-47, 2024.
  23. A.Blandford, D.Furniss, and S.Makri. "Qualitative HCI research: Going behind the scenes." Morgan & Claypool Publishers, 2016.