The Journal of the Convergence on Culture Technology (문화기술의 융합)

The International Promotion Agency of Culture Technology (국제문화기술진흥원)
권호 표지
DOI QR코드

DOI QR Code

The Effect of Interjection in Conversational Interaction with the AI Agent: In the Context of Self-Driving Car

인공지능 에이전트 대화형 인터랙션에서의 감탄사 효과: 자율주행 맥락에서

  • 이수지 (연세대학교 정보대학원 UX트랙) ;
  • 서지윤 (연세대학교 정보대학원 UX트랙) ;
  • 최준호 (연세대학교 정보대학원 UX트랙)
  • Received : 2021.12.31
  • Accepted : 2022.01.08
  • Published : 2022.01.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study aims to identify the effect on the user experiences when the embodied agent in a self-driving car interacts with emotional expressions by using 'interjection'. An experimental study was designed with two conditions: the inclusion of injections in the agent's conversation feedbacks (with interjections vs. without interjections) and the type of conversation (task-oriented conversation vs. social-oriented conversation). The online experiment was conducted with the four video clips of conversation scenario treatments and measured intimacy, likability, trust, social presence, perceived anthropomorphism, and future intention to use. The result showed that when the agent used interjection, the main effect on social presence was found in both conversation types. When the agent did not use interjection in the task-oriented conversation, trust and future intention to use were higher than when the agent talked with emotional expressions. In the context of the conversation with the AI agent in a self-driving car, we found only the effect of adding emotional expression by using interjection on the enhancing social presence, but no effect on the other user experience factors.

이 연구의 목적은 자율 주행 차량의 체화된 에이전트가 '감탄사'를 사용하여 감정 표현을 드러낸 대화 상호작용을 할 경우 사용자 경험에 어떠한 효과를 나타내는지 확인하는 것이다. 감탄사 포함 유무와 대화 유형(과제 중심적 대화 vs. 관계 중심적 대화)의 조건에 따라 실험을 설계하였다. 온라인 실험으로 각 조건별로 4가지 대화 시나리오영상을 시청한 후, 해당 에이전트에 대한 친밀도, 호감도, 신뢰도, 사회적 실재감, 지각된 의인화, 향후 이용 의도를 측정하였다. 분석 결과, 에이전트가 감탄사를 사용할 경우 두 대화 유형 모두에서 사회적 실재감의 주 효과가 나타났다. 에이전트가 감탄사를 사용하지 않을 경우 과제 중심적 대화 유형에서 신뢰와 향후 이용 의도가 높았다. 에이전트가 감탄사를 사용하여 감정적 표현을 더하는 것은 사회적 실재감을 높이는 효과는 발견했지만, 다른 사용자 경험 요인에 대한 영향은 나타나지 않았다.

Keywords

Acknowledgement

이 논문은 2021년도 연세대학교 정보대학원 BK21의 연구 지원에 의하여 연구되었음.

References

  1. Red Dot, "Red Dot Design Award: Nomi Mate 1.5," 2021. Avaliable: https://www.red-dot.org/project/nomi-mate-15-46042
  2. S. Okamoto and S. Sano, "Anthropomorphic AI agent mediated multimodal interactions in vehicles," Proceedings of the 9th international conference on automotive user interfaces and interactive vehicular applications adjunct, pp. 110-114, 2017. Avaliable: https://doi.org/10.1145/3131726.3131736
  3. E. Go, "Does Message Interactivity Help or Hinder the Effects of Anthropomorphic Online Chat Agents? Compensation vs. Expectation Effects in Organizational Websites," The Pennsylvania State University, August 2015.
  4. Consumer Insight, "2019-2020 AI Speaker Usage Status-Satisfaction Comparison," 2021. Available: https://www.consumerinsight.co.kr/voc_view.aspx?no=3170&id=ins02_list
  5. D. Bohus, "Error awareness and recovery in conversational spoken language interfaces," PhD Thesis, Carnegie Mellon University, 2007.
  6. W. Choi, "The effect of conversational agent's error message strategy and anthropomorphism on error recovery," Master Thesis, Seoul National University, January 2020.
  7. N. Clifford and K. M. Lee, "Does computer-generated speech manifest personality? An experimental test of similarity-attraction," Proceedings of the SIGCHI conference on Human Factors in Computing Systems, 2000.
  8. M. Kwak, "Predictors of the intention to use AI-based interview system: Co-presence, trust, perceived usefulness and perceived ease of use," Master Thesis, The Graduate School of Education, Ewha Womans University, December 2020.
  9. H. Detjen, S. Faltaous, B. Pfleging, S. Geisler and Schneegass, S., "How to increase automated vehicles' acceptance through in-vehicle interaction design: A Review," International Journal of Human-Computer Interaction, Vol. 37, No. 4, pp. 308-330, 2021. Avaliable: https://doi.org/10.1080/10447318.2020.1860517
  10. J. Lee, H. Joo, and J. Choi, "Effects of Agent Interaction on Driver Experience in a Semi-autonomous Driving Experience Context - With a Focus on the Effect of Self-Efficacy and Agent Embodiment - ," The Journal of the Convergence on Culture Technology (JCCT), Vol. 5, No. 1, pp. 361-369, February 2019. https://doi.org/10.17703/JCCT.2019.5.1.361
  11. Y. Lee, S. Park, and H. Suk, "Applying Social Strategies for Breakdown Situations of Conversational Agents: A Case Study using Forewarning and Apology," Science of Emotion & Sensibility, Vol. 21, pp. 59-70, March 2018. https://doi.org/10.14695/KJSOS.2018.21.1.59
  12. S. Jeong, "Conversational level of vocal artificial intelligent agent in accordance with autonomous driving level 2, 3," Master Thesis, Graduate School of Information, Yonsei University, June 2018.
  13. W. Edda, and F. Hundsnurscher, "Dialoganalyse II : Referate der 2. Arbeitstagung, Bochum 1988," Walter de Gruyter, 1989.
  14. Y. Cho, Y. Choi, and S. Park, "A qualitative study on analyzing the conversation of interacting with Embodied conversational agents on mobile environments," Journal of Korea Design Knowledge, Vol. 9, pp. 63-71, March 2009. https://doi.org/10.17246/jkdk.2009..9.007
  15. Y. Kang, G. Na, and J. Choi, "The Effect of Preceding Utterance on the User Experience in the Voice Agent Interactions - Focus on the Conversational Types in the Smart Home Context -," The Journal of the Convergence on Culture Technology (JCCT), Vol.7, No.1, pp. 620-631, 2021. https://doi.org/10.17703/JCCT.2021.7.1.620
  16. B. Lee and J. Yun, "Effects of Korean Honorifics and Exclamations in Voice User Interface(VUI)," Proceedings of HCI Korea 2019, pp. 750-754, February 2019.
  17. K. Nam and Y. Koh, "Pyo-jun GookeoMun BeobRon[Theory of Standard Korean Grammar]," Seoul, Korea: Top Publishing, 1993.
  18. S. Oh, "Gookeohak-ui Yeehae-Gamtansa [Understanding of Korean Language - Interjection]," Saegookeo Saeng-hwal, Vol. 15, No. 2, 2005.
  19. J. Jang and D. Ju, "Usability Test of Emotional Speech from AI Speaker," Proceedings of HCI Korea 2019, pp. 705-712, February 2019.
  20. H. G. Kim, J. S. Kim, and S. D Ji, "Character-based interactive artificial intelligence design using multiple agents," Proceedings of the Korea Society for Simulation Conference, pp. 75-79, 2017.
  21. S. Brave, C. Nass and K. Hutchinson, "Computers that care: investigating the effects of orientation of emotion exhibited by anembodied computer agent," International Journal of Human-Computer Studies, Vol. 62, No. 2, pp. 161-178, 2005. https://doi.org/10.1016/j.ijhcs.2004.11.002
  22. R. Beale and C. Creed, "Affective interaction: how emotional agents affect users," International Journal of Human-Computer Studies, Vol. 67, No. 9, pp. 755-776, September 2009. DOI:10.1016/j.ijhcs.2009.05.001
  23. H. Maldonado, J. R. Lee, S. Brave, C. Nass, H. Nakajima, R. Yamada, K. Iwamura, and Y. Morishima, "We learn better together: enhancing eLearning with emotional characters," CSCL '05: Proceedings of th 2005 conference on Computer support for collaborative learning: learning 2005: the next 10 years!, pp. 408-417, May 2005. DOI:10.3115/1149293.1149347
  24. Prendinger, H., Mayer, S., Mori, J., Ishizuka, M., "Persona Effect Revisited: Using Bio-Signals to Measure and Reflect the Impact of Character-Based Interfaces," Proceedings 4th International Workshop on Intelligent Virtual Agents (IVA-03), pp. 283-291, 2003.
  25. Y. Song and S. M. Choi, "The Effects of Chatbots' Anthropomorphism and Self-disclosure on Consumers' Perceptions of andAttitude toward the Chatbots," Journal of the HCI Society of Korea, Vol. 15, No. 1, pp. 17-28, March 2020. https://doi.org/10.17210/jhsk.2020.03.15.1.17
  26. E. Hong, K. Cho, and J. Choi, "Effects of Anthropomorphic Conversational Interface for Smart Home : An Experimental Study on the Voice and Chatting Interactions," Journal of the HCI Society of Korea, Vol. 12, No. 1, pp. 15-23, February, 2017. DOI : 10.17210/jhsk.2017.02.12.1.15
  27. J. Short, E. Williams, and B. Christie, "The social psychology of telecommunications," Toronto; London; New York : Wiley, 1976.
  28. A. S. Leh, "Computer-mediated communication and social presence in a distance learning environment," International Journal of Educational Telecommunications, Vol. 7, No. 2, pp. 109-128, January 2001.
  29. K. M. Lee, "Presence, explicated," Communication theory, Vol. 14, No. 1, pp. 27-50, 2004. https://doi.org/10.1093/ct/14.1.27
  30. K. M. Lee, N. Park, and H. Song, "Can a robot be perceived as a developing creature?," Human Communication Research, Vol. 31, No. 4, pp. 538-563, 2005. https://doi.org/10.1093/hcr/31.4.538
  31. Y. Lee, S. Park, and H. Suk, "Applying Social Strategies for Breakdown Situations of Conversational Agents: A Case Study using Forewarning and Apology," Science of Emotion & Sensibility, Vol. 21, pp. 59-70, March 2018. https://doi.org/10.14695/KJSOS.2018.21.1.59
  32. V. Groom, C. Nass, T. Chen, A. Nielsen, J.K. Scarborough, and E. Robles, "Evaluating the effects of behavioral realism in embodied agents," International Journal of Human-Computer Studies, Vol. 67, No. 10, pp. 842-849, October 2009. DOI: 10.1016/j.ijhcs.2009.07.001
  33. B. Hilpert, P. Gebhard, and T. Schneeberger, "Employing Virtual Agents for Building Trust in Driving Automation : A Qualitative Pilot Study," In Workshop on Robo-Identity: Artificial identity and multi embodiment at the 16th International Conference on Human-Robot Interaction(HRI '21), March 2021.
  34. M. Braun, A. Mainz, R. Chadowitz, B. Pfleging, and F. Alt, "At Your Service: Designing Voice Assistant Personalities to Improve Automotive User Interfaces," Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1-11, May 2019. DOI: 10.1145/3290605.3300270