Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Interaction of Gaze-based User Interface in Mobile Virtual Reality Environment

모바일 가상현실 환경에서의 시선기반 사용자 인터페이스 상호 작용에 관한 연구

  • Kim, Mingyu (Department of Software, Catholic University of Pusan) ;
  • Lee, Jiwon (Department of Software, Catholic University of Pusan) ;
  • Jeon, Changyu (Department of Software, Catholic University of Pusan) ;
  • Kim, Jinmo (Department of Software, Catholic University of Pusan)
  • 김민규 (부산가톨릭대학교 소프트웨어학과) ;
  • 이지원 (부산가톨릭대학교 소프트웨어학과) ;
  • 전찬규 (부산가톨릭대학교 소프트웨어학과) ;
  • 김진모 (부산가톨릭대학교 소프트웨어학과)
  • Received : 2017.06.24
  • Accepted : 2017.07.06
  • Published : 2017.07.14
Download PDF
⟨ Previous Next ⟩

Abstract

This study proposes a gaze-based user interface to provide user oriented interaction suitable for the virtual reality environment on mobile platforms. For this purpose, a mobile platform-based three-dimensional interactive content is produced, to test whether the proposed interface increases user satisfaction through the interactions in a mobile virtual reality environment. The gaze-based interface, the most common input method for mobile virtual reality content, is designed by considering two factors: the field of view and the feedback system. The performance of the proposed gaze-based interface is analyzed by conducting experiments on whether or not it offers motives for user interest, effects of enhanced immersion, differentiated formats from existing ones, and convenience in operating content.

본 연구는 모바일 플랫폼의 가상현실 환경에 적합한 사용자 중심의 상호작용을 제공하기 위하여 시선기반 사용자 인터페이스를 제안한다. 이를 위해 제안하는 인터페이스가 모바일 가상 환경에서 사용자에게 상호작용의 만족도를 높이는지 여부를 실험하기 위하여 모바일 플랫폼 기반의 3차원 대화형 콘텐츠를 제작한다. 그리고 모바일 가상현실 콘텐츠의 입력 처리 방법으로 가장 일반적인 시선을 활용한 인터페이스를 시야 범위, 피드백 시스템의 2단계로 나누어 설계한다. 제안한 인터페이스 방법이 사용자에게 몰입감 향상의 효과, 기존과 차별화된 형식, 콘텐츠를 조작하는데 편리함을 제공하는 지 여부를 실험을 통해 분석한다.

Keywords

References

  1. M. E. Feisst, "Enabling virtual reality on mobile devices: enhancing students' learning experience," Proc. SPIE 8065, SPIE Eco-Photonics 2011: Sustainable Design, Manufacturing, and Engineering Workforce Education for a Green Future, 2011.
  2. M. M. Hayhoe, A. Shrivastava, R. Mruczek and J. Pelz, "Visual memory and motor lanning in a natural task," Journal of Vision, vol. 3, no. 1, pp.49-63, 2003.
  3. I.E. Sutherland, "A head-mounted three dimensional display," In Proceedings of the AFIPS '68, pp. 757-764, 1968.
  4. M. Ortega and S. Coquillart, "Prop-based haptic interaction with co-location and immersion: an automotive application," IEEE International Workshop on Haptic Audio Visual Environments and their Applications, Ottawa, ON, Canada, 1-2 October, 2005.
  5. J. P. Schulze, C. E. Hughes, L. Zhang, E. Edelstein and E. Macagno, "CaveCAD: a tool for architectural design in immersive virtual environments," Proc. SPIE 9012, The Engineering Reality of Virtual Reality 2014, 2014.
  6. P. Hoberman, D. M. Krum, E. A. Suma and M. Bolas, "Immersive training games for smartphone-based head mounted displays," Proc. of 2012 IEEE Virtual Reality Workshops (VRW), pp.151-152, 2012.
  7. R.S. Johansson, G. Westling, A. Bckstrm and J.R. Flanagan, "Eye-hand coordination in object manipulation," The Journal of Neuroscience, vol. 21, no. 17, pp.6917-6932, 2001. https://doi.org/10.1523/JNEUROSCI.21-17-06917.2001
  8. J.B. Pelz, R. Canosa, J. Babcock and J. Barber, "Visual perception in familiar, complex tasks," Proceedings of the 2001 International Conference on Image Processing, pp.12-15, 2001.
  9. C. Antonya, "Accuracy of gaze point estimation in immersive 3D interaction interface based on eye tracking," Control Automation Robotics Vision (ICARCV), 2012 12th International Conference on, pp.1125-1129, 2012.
  10. N. Sidorakis, G. A. Koulieris and K. Mania, "Binocular eyetracking for the control of a 3D immersive multimedia user interface," Everyday Virtual Reality (WEVR), 2015 IEEE 1st Workshop on, pp.15-18, 2015.
  11. E.M. Kolasinski, "Simulator sickness in virtual environments," Technical report DTIC Document, 1995.
  12. J.D. Moss and E.R. Muth, "Characteristics of head-mounted displays and their effects on simulator sickness," Human Factors: The Journal of the Human Factors and Ergonomics Society, vol. 53, no. 3, pp.308-319, 2011. https://doi.org/10.1177/0018720811405196
  13. J. Reason, "Motion sickness adaptation: a neural mismatch model," Journal of the Royal Society of Medicine, vol. 71, no. 11, pp.819-829, 1978. https://doi.org/10.1177/014107687807101109
  14. H,B,-L. Duh, D.E. Parker, J.O. Philips and T.A. Furness, "Conflicting motion cues to the visual and vestibular selfmotion systems around 0.06hz evoke simulator sickness," Human Factors: The Journal of the Human Factors and Ergonomics Society, vol. 46, no. 1, pp.142-153, 2004. https://doi.org/10.1518/hfes.46.1.142.30384
  15. T.A. Stoffregen and L.J. Jr Smart LJ, "Postural instability precedes motion sickness," Brain research bulletin, vol.47, no. 5, pp.437-448, 1998. https://doi.org/10.1016/S0361-9230(98)00102-6
  16. Y. Kim, Gun A. Lee, Do. Jo, U. Yang, G. Kim and J. Park, "Analysis on virtual interaction-induced fatigue and difficulty in manipulation for interactive 3D gaming console," Consumer Electronics (ICCE), 2011 IEEE International Conference on, pp.269-270, 2011.
  17. J. Lee, M. Kim, C. Jeon and J. Kim, "A Study on Gamepad/Gaze based Input Processing for Mobile Platform Virtual Reality Contents," Journal of the Korea Computer Graphics Societ, vol. 22, no. 3, pp.31-41, 2016. https://doi.org/10.15701/kcgs.2016.22.3.31
  18. B.-G. Witmer, C.-J. Jerome, and M.-J. Singer, "The Factor Structure of the Presence Questionnaire," Presence: Teleoper. Virtual Environ., vol. 14, no. 3, pp.298-312, 2005. https://doi.org/10.1162/105474605323384654

Cited by

  1. Design of Handwriting-based Text Interface for Support of Mobile Platform Education Contents vol.27, pp.5, 2021, https://doi.org/10.15701/kcgs.2021.27.5.81