DOI QR코드

DOI QR Code

A Study on Metaverse Construction Based on 3D Spatial Information of Convergence Sensors using Unreal Engine 5

언리얼 엔진 5를 활용한 융복합센서의 3D 공간정보기반 메타버스 구축 연구

  • Oh, Seong-Jong (Department of Urban Convergence Engineering, Incheon National University) ;
  • Kim, Dal-Joo (Department of Urban Convergence Engineering, Incheon National University) ;
  • Lee, Yong-Chang (Department of Urban Engineering, Incheon National University)
  • 오성종 (인천대학교 도시융.복합학과) ;
  • 김달주 (인천대학교 도시융.복합학과) ;
  • 이용창 (인천대학교 도시과학대학 도시공학과)
  • Received : 2022.09.28
  • Accepted : 2022.11.22
  • Published : 2022.12.10

Abstract

Recently, the demand and development for non-face-to-face services are rapidly progressing due to the pandemic caused by the COVID-19, and attention is focused on the metaverse at the center. Entering the era of the 4th industrial revolution, Metaverse, which means a world beyond virtual and reality, combines various sensing technologies and 3D reconstruction technologies to provide various information and services to users easily and quickly. In particular, due to the miniaturization and economic increase of convergence sensors such as unmanned aerial vehicle(UAV) capable of high-resolution imaging and high-precision LiDAR(Light Detection and Ranging) sensors, research on digital-Twin is actively underway to create and simulate real-life twins. In addition, Game engines in the field of computer graphics are developing into metaverse engines by expanding strong 3D graphics reconstuction and simulation based on dynamic operations. This study constructed a mirror-world type metaverse that reflects real-world coordinate-based reality using Unreal Engine 5, a recently announced metaverse engine, with accurate 3D spatial information data of convergence sensors based on unmanned aerial system(UAS) and LiDAR. and then, spatial information contents and simulations for users were produced based on various public data to verify the accuracy of reconstruction, and through this, it was possible to confirm the construction of a more realistic and highly utilizable metaverse. In addition, when constructing a metaverse that users can intuitively and easily access through the unreal engine, various contents utilization and effectiveness could be confirmed through coordinate-based 3D spatial information with high reproducibility.

최근, 코로나 바이러스 감염증으로 인해 발생한 팬데믹의 영향으로 비대면 서비스에 대한 수요와 발전이 급속도로 진행되고 있는 가운데 중심에 있는 메타버스(Metaverse)에 대한 이목이 집중되고 있다. 가상과 현실을 초월하는 세계를 의미하는 메타버스는 4차 산업혁명 시대에 접어들어 다양한 센싱기술과 3D 재현기술이 융합되어 사용자에게 쉽고 빠르게 다양한 정보를 제공하고 서비스가 가능하다. 특히, 이 가운데 고해상도의 영상촬영이 가능한 무인항공기(UAV) 및 정밀도 높은 LiDAR 센서와 같은 융복합센서의 소형화 및 경제성 증가로 인해 높은 재현도 및 정확도를 가진 3D 공간정보를 획득하여 현실의 쌍둥이를 만들어 시뮬레이션하는 디지털 트윈(Digital-Twin)에 대한 연구가 활발히 진행되고 있다. 또한, 컴퓨터 그래픽 분야의 게임엔진(Game engine)이 강력한 3D 그래픽 재현 및 역학적 연산을 바탕으로 한 시뮬레이션 등이 확장되어 메타버스 엔진으로 발전하고 있다. 본 연구는 무인항공시스템(UAS)과 LiDAR 센서를 융합하여 획득한 정확도 높은 3D 공간정보 데이터를 최근 발표된 메타버스 엔진인 언리얼 엔진을 활용하여 실세계 좌표기반 현실을 반영한 거울세계 형태의 메타버스를 구축하였다. 이후, 다양한 공공데이터를 기반으로 사용자를 위한 공간정보 컨텐츠 및 시뮬레이션을 구축하여 재현 정확도를 검증하고, 이를 통해 보다 실감나고 공간정보 활용성이 높은 메타버스 구축에 대하여 고찰하였다. 또한, 언리얼 엔진을 통해 사용자가 직관적이고 쉽게 접근할 수 있는 메타버스를 구축할 경우 재현도 높은 좌표기반의 3D 공간정보를 통해 다양한 컨텐츠 활용성과 효용성을 확인할 수 있었다.

Keywords

References

  1. Kim TH, Lee YC. 2020. Comparison of Open Source based Algorithms and Filtering Methods for UAS Image Processing. Journal of Cadastre & InformatiX. 50(2):155-168.
  2. Do MS, Lim ET, Chae JH, Kim SH. 2018. Accuracy Evaluation and Terrain Model Creation of Urban Space Using Unmanned Aerial Vehicle. The Korea Institute of Intelligent Transport Systems. 17(5):117-127. https://doi.org/10.12815/kits.2018.17.5.117
  3. Park SK, Yang JY, Kim HJ, Cho MK, Kwon YS. 2021. Safety Design of Smart Children's Pedestrian Space Based on Digital Twin Using Unreal Engine - Focused on the Elementary School Located in Uijeongbu -. Architectural Institute of Korea Conference Spring 2021, 41(1): 651-652.
  4. Baek JS, Jung JM. 2022. 5G mmWave Handover Technology for Real-Time Metaverse Technology Using XR. KICS Conference Winter 2022, pp. 1060-1061.
  5. Shin CS. 2022. Metaverse-based Cultural Content R&D Trend. ICT Convergence Korea. 39(4): 61-66.
  6. Oh SJ, Lee YC. 2021. A Study on the 3D Reconstruction and Historical Evidence of Recumbent Buddha Based on Fusion of UAS, CRP and Terrestrial LiDAR. Journal of Cadastre & InformatiX. 51(1):111-124.
  7. Oh SJ, Park SH, Lee YC. 2022. Metaverse Reconstruction Based on Drone Imagery and Open-Source Tools. Korea Spatial Information Society Conference Spring 2022. pp. 123-125.
  8. Lee GH, Ahn GH, Kim JG. 2022. Model and Simulation Based Digital Twin for Immersive Metaverse Environments. Communications of the Korean Institute of Information Scientists and Engineers. 40(2):27-31.
  9. Lee MY, Lee DH, Kwon SC. 2019. A Study of 3D Scan Data Acquisition in Game Engine. Korea Institute of Design Reserch Society Conference 2019. pp. 13-16.
  10. Lee YC, Kang JO. 2019. The Precise Three Dimensional Phenomenon Modeling of the Cultural Heritage Based on UAS Imagery. Journal of Cadastre & InformatiX. 49(1):85-101.
  11. Lee HS, Ryoo ST, Seo SH. 2019. A Comparative Study on the Structure and Implementation of Unity and Unreal Engine 4. Korea Computer Graphics Society. 25(4):17-24. https://doi.org/10.15701/kcgs.2019.25.4.17
  12. Jo SH, Kim TY. 2021. Drone Obstacle Avoidance Algorithm using Camera-based Reinforcement Learning. Journal of the Korea Computer Graphics Society. 27(5):63-71. https://doi.org/10.15701/kcgs.2021.27.5.63
  13. Choi GS. 2021. Convergence of Game Engine and Spatial Information 3D Contents: Cesium for Unreal. FOSS4G Korea 2021.
  14. Choi SJ. 2022. The Story of a Game Engine Entering the Realm of Industry. IE Magazine. 29(1):33-37.
  15. Fabio MD, Luis S, Joao PM, Nuno MMR. 2020. Improving Project Communication in the Architecture, Engineering and Construction Industry: Coupling Virtual Reality and Laser Scanning. Journal of Building Engineering 30:101287
  16. Jakob I, Carlos C, Stefano P, Livia P, James OC, Jacqueline R. 2019. Structure from Motion Photogrammetry in Forestry: a Review. Current Forestry Reports. 5:155-168. https://doi.org/10.1007/s40725-019-00094-3
  17. John S, Jamais C, Jerry P. 2007. Metaverse Roadmap Pathways to the 3D Web. Acceleration Studies Foundation. A Cross-Industry Public Foresight Project: 5-16.
  18. Juho-Pekka V, Sylvie D, Tuomas T, Lingli Z, Arttu J, Hannu H, Juha H. 2020. Interactive Dense Point Clouds in a Game Engine. ISPRS Journal of Photogrammetry and Remote Sensing 163: 375-389. https://doi.org/10.1016/j.isprsjprs.2020.03.007
  19. Wei W, Ishan K. 2015. Design for Sustainable Aging: Improving Design Communication through Building Information Modeling and Game Engine Integration. Procedia Engineering 118:926-933. https://doi.org/10.1016/j.proeng.2015.08.532
  20. NGII. 2018. Guidelines for Public Surveying Using Unmanned Aerial Vehicles [Internet]. [https://law.go.kr/admRulLsInfoP.do?admRulSeq=2100000118823]. Last accessed 15 September 2022.
  21. Apple. 2020. iPad Pro 11 3rd Generation [Internet]. [https://apple.com]. Last accessed 8 September 2022.
  22. Autel Robotics. 2021. Evo 2 Pro Enterprise [Internet]. [https://autelrobotics.com/productdetail/evo-ii-enterprise-drones.html]. Last accessed 8 September 2022.
  23. Cesium for Unreal. 2022. Cesium [Internet]. [https://cesium.com]. Last accessed 15 April 2022.
  24. Epic Games. 2022. Unreal Engine 5 [Internet]. [https://unrealengine.com]. Last accessed 2 September 2022.
  25. Trimble. 2022. Trimble SX10 [Internet]. [https://www.trimble.com]. Last accessed 8 September 2022.
  26. Unity Technologies. 2022. Unity Engine [Internet]. [https://unity.com/kr]. Last accessed 10 September 2022.