Journal of the Korea Computer Graphics Society (한국컴퓨터그래픽스학회논문지)

Korea Computer Graphics Society (한국컴퓨터그래픽스학회)
권호 표지
DOI QR코드

DOI QR Code

Location-based Space-Time Interlinked Extended Reality using HMD

HMD를 이용한 위치 기반 시공간 연동 확장현실

  • Ahyeon Park (Global School of Media, Soongsil University) ;
  • Sangjoon Bae (Dept. of Digital Media, Soongsil University) ;
  • Mijin Kim (Dept. of Culture Contents, Soongsil University) ;
  • Woohyun Lee (Dept. of Digital Media, Soongsil University) ;
  • Dongho Kim (Global School of Media, Soongsil University)
  • 박아연 (숭실대학교 글로벌미디어학부) ;
  • 배상준 (숭실대학교 미디어학과) ;
  • 김미진 (숭실대학교 문화콘텐츠학과) ;
  • 이우현 (숭실대학교 미디어학과) ;
  • 김동호 (숭실대학교 글로벌미디어학부)
  • Received : 2024.06.15
  • Accepted : 2024.07.05
  • Published : 2024.07.25
Download PDF
⟨ Previous Next ⟩

Abstract

Extended Reality (XR) is an immersive technology that combines the real and virtual worlds and is being actively researched across various industries. This study proposes a method for utilizing the Meta Quest 3, a head-mounted display (HMD) that provides mixed reality, outdoors for the first time by leveraging the GPS information from a smartphone. Augmented virtual objects are positioned using location information and the orientation. Additionally, by using the features of the Meta Quest 3, virtual objects are made to appear alongside the real world, allowing users to interact with virtual objects through hand gestures. This study aims to link present and past spaces by using location information and photographs on the HMD, providing a novel experience of freely traversing time and space.

확장현실(eXtended Reality, XR)은 현실과 가상 세계를 결합한 초실감형 기술로, 다양한 산업에서 활발히 연구되고 있다. 본 연구는 혼합현실을 제공하는 HMD인 메타 퀘스트3을 스마트폰의 GPS 정보를 활용하여 실외에서 활용하기를 처음 시도하며 그 방법을 제안한다. 증강하는 가상 객체는 위치 정보와 HMD를 착용하고 바라보는 방향 정보를 활용하여 배치하였다. 또한, 메타 퀘스트3의 기능들을 활용하여 가상 객체가 현실 세계에 함께 보이고, 사용자의 손을 통해 가상 객체와 상호작용할 수 있도록 하였다. 본 연구는 HMD에서 위치 정보와 사진을 활용하여 현재와 과거의 공간을 연동하고, 이를 통해 시공간을 자유롭게 넘나드는 새로운 경험을 제공하는 것을 목표로 한다.

Keywords

Acknowledgement

본 연구는 과학기술정보통신부 및 정보통신기획평가원의 메타버스 융합대학원의 연구 결과로 수행되었음 (IITP-2024-RS-2024-00430997).

References

  1. Korea Information and Communication Technology Association. "eXtended Reality, XR". Korea Information and Communication Technology Association, https://terms.tta.or.kr/dictionary/dictionaryView.do?word_seq=180912-2. accessed 10 June 2024.
  2. S. Vi, T. S. da Silva, and F. Maurer , "User experience guidelines for designing HMD extended reality applications," Human-Computer Interaction-INTERACT 2019: 17th IFIP TC 13 International Conference, Paphos, Cyprus, September 2-6, 2019, Proceedings, Part IV 17. Springer International Publishing, pp. 319-341, 2019.
  3. J. W. Lee, "A Study on Industry Trends and Possibilities related to the Metaverse," Journal of the Korean Society for Wellness, 18(1), pp. 45298, 2023.
  4. R. T. Azuma, "A survey of augmented reality," Presence: teleoperators & virtual environments, 6(4), pp. 355-385, 1997. https://doi.org/10.1162/pres.1997.6.4.355
  5. T. Starner, S. Mann, B. Rhodes, J. Levine, J. Healey, D. Kirsch, R. W. Picard, and A. Pentland, "Augmented Reality Through Wearable Computing," Presence: teleoperators & virtual environments, 6(4), pp. 386-398, 1997. https://doi.org/10.1162/pres.1997.6.4.386
  6. S. H. Jang, J. S. Choi, and K. W. Lee, "Evaluating the sense of presence for mobile augmented reality application design.," Society of Design Convergence, 12(5), pp. 335-350, 2013.
  7. SPRi Issue Report, 2020, Game Changer of Un-tact Era, Extended Reality, IS-095, https://www.spri.kr/posts/view/22973?code=issue_reports/.
  8. E. Waisberg, J. Ong, M. Masalkhi, N. Zaman, P. Sarker, A. G. Lee, and A. Tavakkoli, "Meta smart glasses-large language models and the future for assistive glasses for individuals with vision impairments," Eye, 38, pp. 1036-1038, 2024. https://doi.org/10.1038/s41433-023-02842-z
  9. Meta. "How to protect your Meta Quest headset from sun damage". Meta, https://www.meta.com/help/quest/articles/headsets-and-accessories/product-care-and-best-practices/avoiding-sunlight-damage/. accessed 1 June 2024.
  10. Meta. "Build Believable Mixed Reality Experiences with Mesh API and Depth API". Meta, https://developer.oculus.com/blog/mesh-depth-api-meta-quest-3-developers-mixed-reality/. accessed 2 June 2024.
  11. J. Schiller, A. Voisard, 2004, Location-Based Services, Morgan Kaufmann.
  12. H. Huang ,G. Gartner, J. M. Krisp, M. Raubal, and N. Van de Weghe, "Location based services: ongoing evolution and research agenda.Journal of Location Based Services," Journal of Location Based Services , 12(2), pp. 63-93, 2018. https://doi.org/10.1080/17489725.2018.1508763
  13. M. Leach, S. Maddock, D. Hadley, C. Butterworth, J. Moreland, G. Dean, R. Mackinder, K. Pach, N. Bax, M. Mckone, and D. Fleetwood , "Recreating Sheffield's Medieval Castle in situ using Outdoor Augmented Reality," Lecture Notes in Computer Science , 11162, pp. 213-229, 2018.
  14. J. Grandinetti, C. Ecenbarger, "Imagine Pokemon in the "Real" world: a Deleuzian approach to Pokemon GO and augmented reality. Critical Studies in Media Communication," Critical Studies in Media Communication , 35(5), pp. 440-454, 2018. https://doi.org/10.1080/15295036.2018.1512751
  15. H. W. Park, "Study on composite images through Augmented Reality over old images tagged location data," Journal of Digital Convergence, 12(5), pp. 221-229, 2014. https://doi.org/10.14400/JDC.2014.12.5.221
  16. N. Snavely, S. M. Seitz, and R. Szeliski, "Photo tourism: Exploring photo collections in 3D," ACM Transactions on Graphics, 25(3), pp. 835-846, 2006. https://doi.org/10.1145/1141911.1141964
  17. Ostloong. "OUTDOOR AR". Ostloong, https://ostloong.com/sirius/. accessed 4 June 2024.
  18. L. Premont, "Towards Navigational Aids using Augmented Reality for People with Alzheimer's Disease in Outdoor Environments: A user study using HoloLens 2 around a University campus," KTH, School of Electrical Engineering and Computer Science, 2023.
  19. Apple. "Apple Vision Pro". Apple, https://www.apple.com/apple-vision-pro/. accessed 5 June 2024.
  20. Meta. "Full color pass-through from Meta Quest". Meta, https://www.meta.com/ko-kr/help/quest/articles/getting-started/getting-started-with-quest-pro/full-color-passthrough/. accessed 5 June 2024.
  21. Meta. "Getting started with hand tracking on your Meta Quest headset". Meta, https://www.meta.com/ko-kr/help/quest/articles/headsets-and-accessories/controllers-and-hand-tracking/hand-tracking/. accessed 5 June 2024.