Journal of the Semiconductor & Display Technology (반도체디스플레이기술학회지)

The Korean Society Of Semiconductor & Display Technology (한국반도체디스플레이기술학회)
권호 표지

Implementation of Metaverse User-Avatar Interaction using Real-time Motion Data

실시간 모션 데이터를 활용한 메타버스 사용자-아바타 상호작용 구현

  • Gang In Lee (Dept. of Digital Content Engineering, Wonkwang University) ;
  • Eun Hye Noh (Dept. of Digital Content Engineering, Wonkwang University) ;
  • Young Jae Jo (Dept. of Computer Software Engineering, Wonkwang University) ;
  • Yong-Hwan Lee (Dept. of Digital Content Engineering, Wonkwang University)
  • 이강인 (원광대학교 디지털콘텐츠공학과) ;
  • 노은혜 (원광대학교 디지털콘텐츠공학과) ;
  • 조영재 (원광대학교 컴퓨터소프트웨어공학과) ;
  • 이용환 (원광대학교 디지털콘텐츠공학과)
  • Received : 2023.12.08
  • Accepted : 2023.12.18
  • Published : 2023.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

With the expansion of metaverse content and hardware platforms, various interactions in the virtual world have been built, raising expectations for an increase in immersion which is a major element of the metaverse. However, among hardware platforms that increase virtual immersion elements, the typical HMD platform can be a barrier to new user inflows due to its high cost. Thus, this paper focused on improving virtual-to-real interactions by extracting motion data using relatively inexpensive webcam equipment in PC environments, utilizing Unity game engines, Photon unity network, multi-platform implementations, and Barracuda neural network inference libraries.

Keywords

Acknowledgement

본 논문은 2023 학년도 원광대학교의 교비 지원에 의해 수행됨.

References

  1. Jung Hyun Yoon, "Metaverse, beyond the boundaries of virtual and real life", Future Horizon+, Institute for Science and Technology Policy, vol.49, no.2, pp.3-8, 2021.
  2. Taylor Larn, Hanson Wang, Sunny Chen, Mark Lian, Eric Ma, "The Metaverse Overview: Vision, Technology, and Tactics", DeloitteKorea, 2022.
  3. Ji-eun Jung, Na-yeon Son, Hyun-jung Kim, "A Case Study of Cultural Content using the Metaverse", Cultural Industry Research, 22(1), pp.201-213, 2022. https://doi.org/10.35174/JKCI.2022.03.22.1.201
  4. Hee Kyung Cho, "A Case Study of Trans Branding Strategies in the Metaverse Environment", Journal of the Korean Society of Design and Culture, 28(1), pp.451-465, 2022. https://doi.org/10.18208/ksdc.2022.28.1.451
  5. Hyun-Woo Nam, "Core Technologies and Use Case Analysis for Metaverse", TTA journal, No.205, pp.73-75, 2023.
  6. Website: https://docs.unity3d.com/Packages/com.unity.barracuda@1.0/manual/index.html
  7. Website: https://github.com/digital-standard/ThreeDPoseUnityBarracuda
  8. Yoon-sung, Cho, "The Effect of Visual Characteristics of HMD on VR Content Engagement", Korea Design Research, 8(1), pp.60-69, 2023. https://doi.org/10.46248/kidrs.2023.1.60
  9. Jin-ho Joo, "A Practical Study through the Construction of a Metaverse Class Environment to Improve the Sense of Social Presence", Journal of the Digital Content Society, 24(8), 1637-1647, 2023. https://doi.org/10.9728/dcs.2023.24.8.1637
  10. Chung Sup Lee, Seongjin Ahn, "A study on Evaluation Factors for the Suitability of Educational Content in the Metaverse Environment", Journal of Korean Association of Computer Education, vol.26, no.5, 2023.
  11. Jooyoung Kim, "Advertising in the Metaverse: Research Agenda", Journal of Interactive Advertising, vol.3, no.3, pp.141-144, 2021. https://doi.org/10.1080/15252019.2021.2001273
  12. Lik-Hang Lee, Tristan Braud, Pengyuan Zhou, Lin Wang, Dianlei Xu, Zijun Lin, Abhishek Kumar, Carlos Bemejo, Pan Hui, "All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agenda", arXiv preprint arXiv:2110.05352, 2021.
  13. Marc Erich Latoschik, Daniel Roth, Dominik Gall, Jascha Achenhach, Thomas Waltemate, Mario Botsch, "The Effect of Avatar Realism in Immersive Social Virtual Realities", Proceeding of the ACM Symposium on Virtual Reality Software and Technology, 2017.
  14. Ke Sun, Bin Xiao, Dong Liu, Jingdong Wang, "Deep High-Resolution Representation Learning for Human Pose Estimation", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019.
  15. Tobias Zimmermann, Bertram Taetx, Gabeiele Bleser, "IMU-to-Segment Assignment and Orientation Alignment for the Lower Body using Deep Learning", Sensors, 18(1), 2018.
  16. Young Han Yun, Hoon Choi, "A Middleware Supporting the Detect Interaction of Multiple User for Metaverse Services", Journal of Knowledge Information Technology and Systems, vol.18, no.4, pp.805-815, 2023.
  17. YoungHo Park, NamChoul Song, "A state of the art Microdisplay report for Metaverse device", KEIT PD Issue Report, vol.22-12, 2022.
  18. Jehyun Kim, Seok-hee Oh, "Metaverse based Virtual Space Consulting Service Platform Research and Development", Journal of the Semiconductor & Display Technology, vol.20, no.4, pp.130-133, 2021.
  19. Hae-Kyyng Chung, JangHyok Ko, "Metaverse Friend Making System Design and Implement", Journal of the Semiconductor & Display, vol.20, no.3, 2021.