The Journal of the Convergence on Culture Technology (문화기술의 융합)

The International Promotion Agency of Culture Technology (국제문화기술진흥원)
권호 표지
DOI QR코드

DOI QR Code

A Study on Proposing an Interaction Design Prototype that Reflects User Behavior Elements for VR Collaboration Tool

VR 협업 툴을 위한 사용자 행동 요소를 반영한 인터랙션 디자인 프로토타입 제안 연구

  • Shin, Jongeun ;
  • Kang, Jeannie (Dept. of Media Interaction Design, Ewha Womans Univ)
  • 신종은 (이화여자대학교 조형예술대학 디자인학부) ;
  • 강수진 (이화여자대학교 조형예술대학 디자인학부)
  • Received : 2024.04.22
  • Accepted : 2024.06.15
  • Published : 2024.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

Today, the development of new technologies due to the 4th industrial revolution requires work performance methods such as non-face-to-face collaboration. In response to this, various VR collaboration tools are emerging, but VR collaboration tools for brainstorming, which are used in collaboration or design development work, are not provided. Therefore, despite the advantages and possibilities of VR for non-face-to-face collaboration, there are limitations in practical use. Accordingly, the development of VR collaboration tools in a digitalized work environment is necessary, and research on UI design development for this is required. The purpose of this study is to propose a VR collaboration tool prototype by developing an interaction UI design that applies user hand behavior elements that appear during collaboration sessions through user research. This study was a qualitative study. The research method was to conduct user research through observation and in-depth interviews, and as a result of analyzing the data obtained from this, five types of user hand behavior elements were derived. In this study, an interaction UI design was developed that reflects hand gestures as behavioral elements. And using Unity and the Oculus Integration SDK Kit, we created a prototype VR collaboration tool that can be used without a controller. As a result of conducting a user evaluation of the prototype produced in this study, it was found that users had difficulty making hand gestures accurately, and it was possible to find areas for improvement in UI design. It is expected that this study will help develop interaction UI design for VR collaboration tools that can increase work efficiency.

오늘날 4차 산업 혁명에 따른 새로운 기술의 발전은 비대면 협업과 같은 업무수행 방식이 요구되고 있다. 이에 부응하여 다양한 VR 협업 툴이 등장하고 있으나 협업이나 디자인 개발 업무에서 활용되고 있는 VR 협업 툴이 제한적이. 따라서 비대면 협업을 위한 VR의 장점과 가능성에도 불구하고 실무 활용에 있어 한계가 있다. 이에 따라 디지털화되고 있는 업무 환경에서 효과적인 협업을 위한 VR 협업 툴 개발이 필요하며 이를 위한 UI 디자인 개발에 관한연구가 요구된다. 본 연구의 목적은 사용자 조사를 통하여 협업 시 첫 단계인 브레인스토밍 단계에서 나타나는 사용자 행동 요소를 적용한 인터랙션 및 UI 디자인을 개발함으로써 VR 협업 툴 프로토타입을 제안하는 데 있다. 본 연구는 질적 연구로 연구 방법은 관찰과 심층 인터뷰를 통한 사용자 조사를 수행하고 이로부터 얻은 데이터를 분석한 결과로 5가지 사용자의 손짓 행동 요소를 도출하였다. 행동 요소로서의 손짓을 반영한 인터랙션 UI를 디자인하고 Unity와 Oculus Integration SDK Kit를 사용하여 컨트롤러 없이 사용할 수 있는 VR 협업 툴 프로토타입을 제작하였다. 본 연구에서 제작한 프로토타입에 대한 사용성 평가를 실시한 결과 사용자가 손짓을 정확히 행하여야 한다는 어려움이 나타나 UI 디자인의 보완점을 찾아볼 수 있었다. 또한 VR 협업 공간에서 개인 작업과 공유를 위한 공간의 구분을 조절할 수 있는 UI 디자인의 필요성도 알 수 있었다. 본 연구가 업무의 효율성을 높여줄 수 있는 VR 협업툴을 위한 인터랙션 및 UI 디자인 개발에 도움이 되기를 기대한다.

Keywords

References

  1. K. Park, "A Study on the Predictors of College Students' Institutional Commitment in Online Learning Environment: Focusing on Educational Presence," Unpublished Master's degree thesis, Hankuk University, 2022.
  2. M. Friend, L. Cook, D. Chamberlain, & C. Shamberger, "Co-Teaching : An illustration of complexity of collaboration in special education," Journal of Educational and Psychological Consulatation, Vol. 20, No. 1, pp. 9-27, 2010. DOI:10.1080/10474410903535380
  3. S. Kim, "The Study on the College Students' Recognition to Collaboration," Korean Journal of General Education, Vol. 12, No. 3, pp. 11-37, 2018.
  4. G. Lee, I. Park, & E. Ju, "Exploring classroom culture for improving children's collaborative problem-solving ability," Journal of Learner-Centered Curriculum and Instruction, Vol. 19, NO.3, pp. 707-734, 2019. DOI:10.22251/jlcci.2019.19.3.707
  5. J. Boo & D. Lee, "The VR Campus: Architectural Panorama-A Study of Institutional Architecture for 3D Panoptic Environment," Jourmal of the HCI Society of Korea, Vol.2005, No.1, pp. 1237-1242.
  6. M. An, H. Park, & J. Hwang, "VR-based brainstorming collaboration service," Annual Conference of Korean Information Processing Society Vol. 29 No. 1, pp. 675-678, 2022.
  7. Holt, K. (2019, September 25). Social VR world "Facebook Horizon" comes to Oculus in 2020. Engadget. https://www.engadget.com/2019-09-25-oculus-social-vr-world-facebook-horizon.html?guce_referrer=aHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnLw&guce_referrer_sig=AQAAAFUwWpgZGD34YhohbcDbqbOKnKghGX7UIpuJT-hYax7PAfs6l8LcVqVxMnmgFgm1VQGOxykjv5o20b0YfT_ZImlXPNTcNVj2iky9Nv1NsgGr3mztFnqkhrx8CbIlAiKZPZAZ9xCfmGTn1_rYf1ODCXRNPWc5wbAiwM8Y7cw-qaFz
  8. Enable hand tracking, Oculus Developers. (n.d.). https://developer.oculus.com/documentation/native/android/mobile-hand-tracking/
  9. About MootUp, (2021, November 30). Immersive virtual event platform. MootUp. https://mootup.com/about-us/
  10. Alexander, J. (December 22, 2017). "VRChat is a bizarre phenomenon that has Twitch, YouTube obsessed". Polygon. Vox Media, Inc. https://www.polygon.com/2017/12/22/16805452/vrchat-steam-vive-oculus-twitch-youtube
  11. Forrest, D. (February 1, 2017). "'VRChat' Is A Social Platform, A Dev Sandbox, And A Step In The Right Direction". Tom's Hardware. Retrieved from: https://www.tomshardware.com/news/vrchat-oculus-rift-htc-vive,33557.html#:~:text=Virtual%20Reality-,'VRChat'%20Is%20A%20Social%20Platform%2C%20A%20Dev%20Sandbox%2C,Step%20In%20The%20Right%20Direction&text=VRChat%20Inc.,and%20immersive%20application%20called%20VRChat
  12. Oculus Touch Hand Poses. (n.d.). VRChat Guides. https://docs.vrchat.com/docs/touch
  13. The Wild Overview (2021, December 1). G2. Retrieved May 15, 2024, from https://www.g2.com/products/the-wild/reviews
  14. M. An, H. Park, & J. Hwang, "VR-based brainstorming collaboration service," Annual Conference of Korean Information Processing Society Vol. 29 No. 1, pp. 675-678. 2022.
  15. J. Lee, D. Ma, H. Cho, & S. Bae, "Post-Post-it: A Spatial Ideation System in VR for Overcoming Limitations of Physical Post-it Notes," In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems Association for Computing Machinery, pp. 1-7, 2021.
  16. Detienne, F. (2006). Collaborative design: Managing task interdependencies and multiple perspectives. Interacting With Computers, 18(1), 1-20.
  17. Detienne, F. (2006). Collaborative design: Managing task interdependencies and multiple perspectives. Interacting With Computers, 18(1), 1-20.
  18. Bresciani, S., & Eppler, M. J. (2009). The benefits of synchronous collaborative Information visualization: Evidence from an experimental evaluation. IEEE transactions on visualization and computer graphics, 15(6), 1073-1080.
  19. Bonfert, M., Reinschluessel, A. V., Putze, S., Lai, Y., Alexandrovsky, D., Malaka, R., & Doring, T. (2023). Seeing the faces is so important: Experiences from online team meetings on commercial virtual reality platforms. Frontiers in Virtual Reality, 3, 945791.
  20. Stahl, G. (2013). Transactive discourse in CSCL. International Journal of Computer-Supported Collaborative Learning, 8(2), 145-147.
  21. Gonzalez-Franco, M., Maselli, A., Florencio, D., Smolyanskiy, N., & Zhang, Z. (2017). Concurrent talking in immersive virtual reality: on the dominance of visual speech cues. Scientific reports, 7(1), 3817.
  22. M. An, H. Park, & J. Hwang, "VR-based brainstorming collaboration service," Annual Conference of Korean Information Processing Society Vol. 29 No. 1, pp. 675-678. 2022.
  23. Poeschl, S., Wall, K., and Doering, N. (2013). "Integration of spatial sound in immersive virtual environments an experimental study on effects of spatial sound on presence," in 2013 IEEE Virtual Reality (VR), Lake Buena Vista, FL, USA, 18-20 March 2013 (IEEE). doi:10.1109/VR.2013.6549396
  24. Kern, A. C., & Ellermeier, W. (2020). Audio in VR: Effects of a soundscape and movement-triggered step sounds on presence. Frontiers in Robotics and AI, 7, 20.
  25. Clark, H.H., Brennan, S.E., 1991. Grounding in communication. In: Resnick, L., Levine, J.-M., Teasley, S.D. (Eds.), Perspectives on Socially Shared Cognition. APA, Washington DC, 127-149.
  26. M. An, H. Park, & J. Hwang, "VR-based brainstorming collaboration service," Annual Conference of Korean Information Processing Society Vol. 29 No. 1, pp. 675-678. 2022.
  27. 국립국어원 표준국어대사전, https://stdict.korean.go.kr/main/main.do (accessed October. 08. 2023)
  28. D. Park, "Nonverbal communication application research : Optical communication focussed" Unpublished Master's degree thesis, Chongsin University, 2017.
  29. U. Kim & H. Kim, The history of communication, from beacons to iPhones, Comminiction Books: Seoul, 2015.
  30. D. Park, "Nonverbal communication application research : Optical communication focussed" Unpublished Master's degree thesis, Chongsin University, 2017. p.30.
  31. 국립국어원 표준국어대사전, https://stdict.korean.go.kr/main/main.do (accessed October. 08. 2023)
  32. Aseeri, S., Marin, S., Landers, R. N., Interrante, V., & Rosenberg, E. S. (2020, March). Embodied realistic avatar system with body motions and facial expressions for communication in virtual reality applications. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 580-581). IEEE.
  33. M.. Kurzweg & K.. Wolf, "Body Language of Avatars in VR Meetings as Communication Status Cue: Recommendations for Interaction Design and Implementation," i-com, Vol. 21, No. 1, pp. 175-201, 2022. DOI:10.1515/icom-2021-0038
  34. M.. Cai, J. Tanaka, "Go together: providing nonverbal awareness cues to enhance co-located sensation in remote communication," Hum. Cent. Comput. Inf. Sci. 9, 19. p.1. DOI:10.1186/s13673-019-0180-y
  35. 이노미. (2006). 손짓언어에 관한 문화 간 커뮤니케이션 인지능력 평가 연구. 스피치와 커뮤니케이션, 6, 135-167.
  36. 정혜선, & 김후성. (2015). 한국인의 손짓언어를 활용한 3D 제스처인터랙션 어휘연구. 한국디자인문화학회지, 21(4), 633-646.
  37. 정혜선, & 김후성. (2015). 한국인의 손짓언어를 활용한 3D 제스처인터랙션 어휘연구. 한국디자인문화학회지, 21(4), 633-646.
  38. 정혜선, & 김후성. (2015). 한국인의 손짓언어를 활용한 3D 제스처인터랙션 어휘연구. 한국디자인문화학회지, 21(4), 633-646.
  39. Jackson, R. L., Drummond, D. K., & Camara, S. (2007). What is qualitative research?. Qualitative research reports in communication, 8(1), pp. 21-28, DOI:10.1080/17459430701617879
  40. M, Suwa, & B, Tversky, "What do architects and students perceive in their design sketches?" A protocol analysis, Design Studies, Vol. 18, No. 4, pp. 385-403, 1997.
  41. C, Robson, Real world research :a resource for social scientists and practitioner researchers, Oxford: Blackwell Publishers. 2nd ed., p. 67, 2002.
  42. Designing Facebook Spaces (Part 4)-Creating a VR interface. https://medium.com/@christauziet/designing-facebook-spaces-part-4-creating-a-vr-interface-821861159495 (accessed December. 01. 2023)
  43. Designing Facebook Spaces (Part 4)-Creating a VR interface. https://medium.com/@christauziet/designing-facebook-spaces-part-4-creating-a-vr-interface-821861159495 (accessed December. 01. 2023)
  44. 한상열, 김항규. (2021). VR(Virtual Reality) 원격 협업 사용경험 조사, 소프트웨어 정책연구소, IS112. 3-19.
  45. Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of usability studies, 4(3), 114-123.
  46. Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of usability studies, 4(3), 114-123.