The Journal of the Korea institute of electronic communication sciences (한국전자통신학회논문지)

Korea Institute of Electronic Communication Science (한국전자통신학회)
권호 표지
DOI QR코드

DOI QR Code

Research on Realizing Continuous Movements of Responsive Digital Humans

반응형 디지털 휴먼의 연속적 상호작용 시스템 개발

  • Song-Won Kim ;
  • Ye-Jun Choi ;
  • David June-Sok Lee ;
  • Mi-Kyeong Moon (Dept. Software, Dongseo University)
  • 김송원 (동서대학교) ;
  • 최예준 (동서대학교) ;
  • 이준석 (동서대학교) ;
  • 문미경 (동서대학교 소프트웨어학과)
  • Received : 2024.07.11
  • Accepted : 2024.10.12
  • Published : 2024.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

Digital humans have human-like forms, allowing for natural interaction with users, and are widely used in fields where communication such as information guidance, promotional marketing, and education is prevalent. Most digital humans pre-plan interaction scenarios with users and prepare actions accordingly. However, it is practically impossible to predict all scenarios, leading to unnatural movements in unexpected interaction situations. This paper describes a method for seamless and continuous realization of movements in interactions between users and digital humans. The study connects specific actions based on hand gestures recognized through a webcam with continuous situational awareness to enable digital humans to maintain a natural flow of movements. It is expected that in fields requiring interaction with humans, digital humans can become more familiar to people through this approach.

디지털 휴먼은 사람과 유사한 형태를 지니고 있어 사용자와의 자연스러운 상호작용이 가능하며, 정보 안내, 홍보 마케팅, 교육 등 소통이 많이 이루어지는 분야에서 널리 활용되고 있다. 대부분의 디지털 휴먼은 사용자와의 상호작용 시나리오를 미리 계획하고 이에 대비한 동작을 준비하고 있다. 그러나 모든 시나리오를 예측하는 것은 사실상 불가능하며, 예기치 않은 상호작용 상황에서 부자연스러운 동작이 발생할 수 있다. 본 논문에서는 사용자와 디지털 휴먼 간의 상호작용에서 동작이 끊어짐 없이 연속적으로 실현될 수 있는 방법에 대해 기술한다. 본 연구는 웹캠을 통해 인식된 사용자의 손동작에 따른 특정 동작과 지속적인 상황 인식에 따른 동작들을 연결하여, 디지털 휴먼이 자연스러운 동작 흐름을 유지할 수 있도록 한다. 이를 통해 사람과 상호작용해야 하는 분야에서 디지털 휴먼이 사람들에게 보다 친숙하게 다가갈 수 있을 것으로 기대된다.

Keywords

Acknowledgement

본 논문은 2024년 과학기술정보통신부 및 정보통신기획평가원의 SW중심대학사업의 연구결과로 수행되었음" (2019-0-01817)

References

  1. J. Hwang, J. Park, and S. Lee, "A Study on the Development of a Platform for the Prevention of Digital Sexual Crimes in the Virtual-Reality Metaverse," J. of the Korea Institute of Electronic Communication Science, vol. 17, no. 6, 2022, pp. 1157-1166. http://dx.doi.org/10.13067/JKIECS.2022.17.6.115
  2. H. Song, I. Kim, and D. Jo, "Virtual Human Interaction Based on Reinforcement Learning," J. of the Korea Institute of Information and Communication Engineering, vol. 24, no. 1, 2020, pp. 437-439. https://doi.org/10.4218/etrij.16.0116.0106
  3. H. Nam, "Current Status and Prospects of Digital Human Development Technology," J. of the Korean Institute of Communication Sciences, vol. 39, no. 5, 2022, pp. 67-73.
  4. J. Kim and H. Sim, "Development of a Sign Language Learning Assistance System using Mediapipe for Sign Language Education of Deaf-Mutility," J. of the Korea Institute of Electronic Communication Science, vol. 16, no. 6, 2021, pp. 1355-1362.
  5. S. Choi, J. Park, G. Ham, H. Son, and T. Yun, "Development of Boxing Game Contents Using Motion Recognition," Proc. of the Korea Society of Computer Information Conference, Daejeon, Korea, 2023, pp. 271-272. https://doi.org/10.3745/KTSDE.2022.11.2.101
  6. J. Chung and D. Jo, "Automatic Adaptation Based Metaverse Virtual Human Interaction," J. of the Korea Information Processing Society, vol. 11, no. 2, 2022, pp. 101-106. https://doi.org/10.9708/jksci.2019.24.01.067
  7. K. Shin and D. Jo, "Exploring the Effects of the Virtual Human with Physicality on Co-presence and Emotional Response," J. of the Korea Society of Computer Information, vol. 24, no. 1, 2019, pp. 67-71. https://doi.org/10.9708/jksci.2019.24.01.067
  8. D. Kim and D. Jo, "Exploring the Effects of Gesture Interaction on Co-presence of a Virtual Human in a Hologram-like System," J. of the Korea Institute of Information and Communication Engineering, vol. 24, no. 10, 2020, pp. 1390-1393. https://doi.org/10.13067/JKIECS.2022.17.6.1193
  9. H. Lee and Y. Park, "A study of Attendance Check System using Face Recognition," J. of the Korea Institute of Electronic Communication Science, vol. 17, no. 6, 2022, pp. 1193-1198. http://dx.doi.org/10.13067/JKIECS.2021.16.6.1355
  10. J. Ki, "Design of Communication Module for Virtual Serial Wireless LAN," J. of the Institute of Internet, Broadcasting and Communication, vol. 23, no. 5, 2023, pp. 35-40. https://doi.org/10.7236/JIIBC.2023.23.5.35