Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

Use of Mini-maps for Detection and Visualization of Surrounding Risk Factors of Mobile Virtual Reality

미니맵을 사용한 모바일 VR 사용자 주변 위험요소 시각화 연구

  • Kim, Jin (Department of Computer Engineering, Hongik University) ;
  • Park, Jun (Department of Computer Engineering, Hongik University)
  • 김진 (홍익대학교 컴퓨터공학과) ;
  • 박준 (홍익대학교 컴퓨터공학과)
  • Received : 2016.11.04
  • Accepted : 2016.12.05
  • Published : 2016.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

Mobile Virtual Reality Head Mount Displays such as Google Cardboard and Samsung Gear VR are being released, as well as PC-based VR HMDs such as Oculus Rift and HTC Vive. However, when the user wears HMD, it hides the external view of the user. Therefore, it may happen that the user is struck by the surrounding objects such as furniture, and there is no definite solution to this problem. In this paper, we propose a method to reduce the risk of injuries by visualizing the location and information of obstacles scanned by using a RGB-D camera.

Oculus Rift, HTC Vive 등의 PC기반 Virtual Reality Head Mount Display 뿐 아니라, Google Cardboard, Samsung Gear VR등과 같은 모바일 VR HMD들이 출시 되고 있다. 그런데 HMD는 착용 시 사용자의 외부시야를 가리게 되므로 VR을 체험하는 공간의 실제 환경에 존재하는 각종 가구에 걸려 넘어지거나 벽 등의 위험요소들에 의해 사용자가 부딪혀 다치고 또는 가구 등이 파손 되는 상황이 일어날 수 있지만 아직 이것에 대해서 확실한 방안이 연구되어 있지 않은 상태이다. 본 논문에서는 Microsoft Kinect V1를 이용하여 사용자가 움직일 공간을 미리 3d Scanning하고 Minimap 방식으로 Scanning한 장애물의 위치 및 정보를 몰입감을 덜 저하시키면서 시각화하여 사용자에게 알려줌으로써 부상위험을 줄이는 방법으로 VR의 대중화를 돕는 방안을 제시 한다.

Keywords

Acknowledgement

Supported by : 정보통신기술진흥센터, 한국연구재단

References

  1. Marina Rey, Inatan Hertzog, Nicolas Kagami, Luciana Nedel "Blind Guardian: A Sonar-Based Solution for Avoiding Collisions with the Real World" , XVII Symposium on Virtual and Augmented Reality IEEE, pp. 237-244, 2015.
  2. Dong-Cheol Kim, Baek-Ki Kim, "Ultrasonic Sensor Loaded Hat For Blind Person", The Journal of Korean Institute of Information, pp. 363-364, 2015.
  3. Muhammad Sheikh Sadi, Saifuddin Mahmud, Md. Mostafa Kamal, Abu Ibne Bayazid, "Automated Walk-in Assistant for the Blinds", International Conference on Electrical Engineering and Information & Communication Technology (ICEEICT), 2014.
  4. Michael Brock, Per Ola Kristensson, "Supporting Blind Navigation using Depth Sensing and Sonification", UbiComp'13, pp. 255-258, 2013.
  5. Jinwook Choi, Deukhyeon Kim, Hunjae Yoo, Kwanghoon Sohn, "Rear Obstacle Detection System Based on Depth From Kinect", 15th International IEEE Conference on Intelligent Transportation Systems, pp. 98-101, 2012.
  6. Shrinivas Pundlik, Matteo Tomasi, Gang Luo, "Collision Detection for Visually Impaired from a Body-Mounted Camera", Computer Vision and Pattern Recognition, pp. 41-47, 2013.
  7. Zhang Yankun, Hong Chuyang, Weyrich, Norman, "A Single Camera Based Rear Obstacle Detection System", IEEE Intelligent Vehicles Symposium (IV), pp. 485-490. 2011.
  8. Ruiqi Cheng, Kaiwei Wang, Kailun Yang, Xiangdong Zhao, "A GROUND AND OBSTACLE DETECTION ALGORITHM FOR THE VISUALLY IMPAIRED", Biomedical Image and Signal Processing, 2015.
  9. Seonghoon Kang Seong-Whan Lee, "Wearable Machine Vision Technologies for the Visually Impaired", Korean Society for Brain and Neural Science, pp. 127-137, 2001.
  10. Anuar bin Mohamed Kassim,Takashi Yasuno, Hazriq Izzuan Jaafar, Mohd Shahrieel Mohd Aras and Norafizah Abas, "Performance Analysis ofWirelessWarning Device for Upper Body Level of Deaf-Blind Person", SICE Annual Conference, pp. 252- 257, 2015.
  11. Yutaka Tange, Shunsuke Takeno, Junichi Hori, "Development of the Obstacle Detection System Combining Orientation Sensor of Smartphone and Distance Sensor", IEEE, pp. 6696-6699, 2015.
  12. Hsieh-Chang Huang, Ching-Tang Hsieh, Cheng-Hsiang Yeh, "An Indoor Obstacle Detection System Using Depth Information and Region Growth", Sensors, pp. 27116-27141, 2015.
  13. Thomas Nescher, Markus Zank, Andreas Kunz, "Simultaneous Mapping and Redirected Walking for ad hoc Free Walking in Virtual Environments", IEEE Virtual Reality Conference, pp. 239-240, 2016.
  14. Misha Sra, Chris Schmandt, "Bringing real objects, spaces, actions, and interactions into social VR", IEEE Third VR International Workshop on Collaborative Virtual Environments, pp. 16-17, 2016.
  15. Md Hossain Shuvo, Yujian Fu, "Sonar Sensor Virtualization For Object Detection And Localization", IEEE SoutheastCon, 2016.
  16. Razali Tomari, Yoshinori Kobayashi, Yoshinori Kuno, "Wide Field of View Kinect Undistortion for Social Navigation Implementation", International Symposium on Visual Computing, pp. 526-535, 2012.
  17. Huisung Kim, Minyoung Lee, Sangchel Park, Sooyong Lee, "Stair Detection System using the Infrared Range Sensors for the Blind", Korean institute of next generation computing, pp. 12-18, 2010.
  18. Marcus Tonnis, David A. Plecher, Gudrun Klinker, "Representing information - Classifying the Augmented Reality presentation space", Computers&Graphics, pp. 997-1011, 2013.
  19. Thomas Whelan, Stefan Leutenegger, Renato F. Salas-Moreno, Ben Glocker, Andrew J. Davison, "ElasticFusion: Dense SLAM Without A Pose Graph", Robotics: Science and Systems (RSS), 2015. URL https://github.com/mp3guy/ElasticFusion.

Cited by

  1. 하이브리드 센싱 기반 다중참여형 가상현실 이동 플랫폼 개발에 관한 연구 vol.24, pp.3, 2016, https://doi.org/10.9717/kmms.2020.24.3.355