The Journal of Korea Institute of Information, Electronics, and Communication Technology (한국정보전자통신기술학회논문지)

Korea Information Electronic Communication Technology (한국정보전자통신기술학회)
권호 표지
DOI QR코드

DOI QR Code

Development of An Interactive System Prototype Using Imitation Learning to Induce Positive Emotion

긍정감정을 유도하기 위한 모방학습을 이용한 상호작용 시스템 프로토타입 개발

  • Received : 2021.08.03
  • Accepted : 2021.08.13
  • Published : 2021.08.30
Download PDF
⟨ Previous Next ⟩

Abstract

In the field of computer graphics and HCI, there are many studies on systems that create characters and interact naturally. Such studies have focused on the user's response to the user's behavior, and the study of the character's behavior to elicit positive emotions from the user remains a difficult problem. In this paper, we develop a prototype of an interaction system to elicit positive emotions from users according to the movement of virtual characters using artificial intelligence technology. The proposed system is divided into face recognition and motion generation of a virtual character. A depth camera is used for face recognition, and the recognized data is transferred to motion generation. We use imitation learning as a learning model. In motion generation, random actions are performed according to the first user's facial expression data, and actions that the user can elicit positive emotions are learned through continuous imitation learning.

컴퓨터 그래픽스 및 HCI 분야에서 캐릭터를 만들고 자연스럽게 상호작용하는 시스템에 관한 많은 연구가 있었다. 이와 같은 연구들은 사용자의 행동에 대한 반응에 중점을 두었으며, 사용자에게 긍정적 감정을 끌어내기 위한 캐릭터의 행동 연구는 여전히 어려운 문제로 남아있다. 본 논문에서는 인공지능 기술을 이용하여 가상 캐릭터의 움직임에 따른 사용자의 긍정적 감정을 끌어내기 위한 상호작용 시스템 프로토타입을 개발한다. 제안된 시스템은 표정 인식과 가상 캐릭터의 동작 생성으로 구분된다. 표정 인식을 위해 깊이 카메라를 사용하며 인식된 사용자의 표정 데이터는 동작 생성으로 전달된다. 우리는 개인화된 상호작용 시스템 개발을 위하여 학습모델로서 모방학습을 사용한다. 동작 생성에서는 최초 사용자의 표정 데이터에 따라 무작위 행동을 수행하고 지속적인 모방학습을 통하여 사용자가 긍정적 감정을 끌어낼 수 있는 행동을 학습한다.

Keywords

Acknowledgement

This work was supported by Gyeongsang National University Grant in 2020~2021.

References

  1. Barnabas Takacs, Klara Csizinszky, Daniele Mazzei, Lajos Simonl. "A psychological framework to objectively evaluate socially capable robots for interactive tutoring systems." 15th International Conference on Control, Automation and Systems (ICCAS). IEEE, 2015.
  2. Lisa FanMatthias Scheut , Monika Lohani, Marissa McCoy, Charlene Stokes. "Do we need emotionally intelligent artificial agents? First results of human perceptions of emotional intelligence in humans compared to robots." International Conference on Intelligent Virtual Agents. Springer, Cham, 2017.
  3. Alemi, Omid, and Philippe Pasquier. "WalkNet: A neural-network-based interactive walking controller." International Conference on Intelligent Virtual Agents. Springer, Cham, 2017.
  4. Iwan de Kok, Felix Hulsmann, Thomas Waltemate, Cornelia Frank, Julian Hough, Thies Pfeiffer, David Schlangen, Thomas Schack, Mario Botsch, Stefan Kopp, "The intelligent coaching space: a demonstration." International Conference on Intelligent Virtual Agents. Springer, Cham, 2017.
  5. Neto, Amyr Borges Fortes, Catherine Pelachaud, and Soraia Raupp Musse. "Giving emotional contagion ability to virtual agents in crowds." International Conference on Intelligent Virtual Agents. Springer, Cham, 2017.
  6. David C. Jeong, Dan Feng, Nicole C. Kramer, Lynn C. Miller, Stacy Marsella, "Negative feedback in your face: examining the effects of proxemics and gender on learning." International conference on intelligent virtual agents. Springer, Cham, 2017.
  7. Parviainen, Jaana, and Mark Coeckelbergh. "The political choreography of the Sophia robot: beyond robot rights and citizenship to political performances for the social robotics market." AI & SOCIETY (2020):1-10.
  8. Jason Wu, Sayan Ghosh, Mathieu Chollet, Steven Ly, Sharon Mozgai, Stefan Scherer, "Nadia: Neural network driven virtual human conversation agents." Proceedings of the 18th International Conference on Intelligent Virtual Agents. 2018.
  9. Ada [Website]. (2019, 10, 11. ) Retrieved from https://www.microsoft.com/artist-in-residence/collaborations/ada/
  10. Samsung Ballie at CES 2020 [Website]. (2020. 0 7. 20.) Retrieved from https://news.samsung.com /us/samsung-ballie-ces-2020/
  11. NUITRACK [computer software]
  12. Arthur Juliani, Vincent-Pierre Berges, Ervin Teng, Andrew Cohen, Jonathan Harper, Chris Elion, Chris Goy, Yuan Gao, Hunter Henry, Marwan Mattar, Danny Lange, "Unity: A general platform for intelligent agents." arXiv preprint arXiv:1809.02627 (2018).
  13. John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, Oleg Klimov, "Proximal policy optimization algorithms." arXiv preprint arXiv:1707.06347 (2017).