The Journal of the Convergence on Culture Technology (문화기술의 융합)

The International Promotion Agency of Culture Technology (국제문화기술진흥원)
권호 표지
DOI QR코드

DOI QR Code

Effects of Personalization and Types of Interface in Task-oriented Chatbot

과업형 챗봇에서 개인화와 담화 종류에 따른 인터페이스의 차이가 수용의도, 만족도에 미치는 영향

  • 박소현 (연세대학교 정보대학원 UX트랙) ;
  • 정윤현 (연세대학교 정보대학원 UX트랙) ;
  • 강현민 (연세대학교 정보대학원)
  • Received : 2020.12.22
  • Accepted : 2021.01.14
  • Published : 2021.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

In response to increasing demand of contactless services, the overall usage of "task-oriented chatbots" in the industry is on the rise. The purpose of a task-oriented chatbot is to raise the efficiency of data sharing and workflow; in order to establish a guideline, there must be a discussion on "what" and "how" to share information. We investigate the effects of personalization and different types of the interface on 'performance expectancy', 'effort expectancy', 'intention to use', and 'satisfaction' in the context of a task-oriented chatbot. Results show that 'intention to use' and 'satisfaction' were higher when the level of personalization was higher. Within the closed-discourse interface, 'intention to use' and 'satisfaction' were higher when personalization was lower. We highlight the practical insights in the use of personalization and types of chatbot interface based on 'perceived personalization', 'expectation disconfirmation theory', 'privacy concern' and 'privacy paradox'.

4차 산업 혁명과 비대면 서비스의 증가로 과업형 챗봇에 대한 수요와 공급이 증가하고 있다. 효과적인 정보 처리를 돕는 과업형 챗봇으로 사용자들에게 긍정적인 경험을 주기 위해서는 챗봇에서 제시할 정보 및 인터페이스에 대한 가이드라인이 필요하다. 본 연구는 과업형 챗봇의 맥락에서 개인화 및 담화 종류에 따른 인터페이스의 차이가 성과기대, 예상노력, 수용의도 그리고 만족도에 미치는 영향을 살펴봄으로써 추후 개발될 과업형 챗봇에 실무적 도움을 주고자 하였다. 연구 결과, 개인화 수준에 따른 주효과가 수용의도 및 만족도에서 보고되었으며, 닫힌 담화에 한해서 개인화 수준이 낮을 때에 수용의도와 만족도가 더 높은 것이 발견되었다. 본 연구는 과업형 챗봇 내에서 개인화 적용의 이점 및 닫힌 담화 내에서 개인화 수준에 따른 차이를 실증적으로 검증하고 있으며 이를 인지된 개인화, 기대불일치 이론, 프라이버시 염려, 프라이버시 역설에 근거하여 설명하고 있다.

Keywords

References

  1. J. Huang, O. Kwon, K. Lee, and Y. Kim, "A Chatter Bot for a Task-oriented Dialogue System," KIPS Transactions on Software and Data Enginnering, Vol. 6, No. 11, pp. 499-506, 2017. DOI : 10.3745/KTSDE.2017.6.11.499
  2. S. Kinjo, "Chatbot Revolution: A map of the Business Future Created by Chatbots," Ebizbooks, 2020.
  3. J. Kim and H. Jo, "Development of Conversational News Chatbot System Based on User Intent Analysis," Journal of Digital Contents Society, Vol. 20, No. 5, pp. 963-972, 2019. DOI : 10.9728/dcs.2019.20.5.963
  4. http://m.fss.or.kr:8000/fss/board//bodoBoardDetail.do?seqNo=21570&gubun=01&mId=M01050200000000
  5. https://dbr.donga.com/article/view/1101/article_no/8181/ac/special.html
  6. M. Mehrjardi, A. Trabelsi, and O. Zaiane, "Self Attentiaonal Models Application in Task-oriented Dialogue Generation Systems," Proce dings of Recent Advances in Natural Language Processing (RANLP) Conference, 2019.
  7. H. Yoo and J. Lee, "A Study on the Development of Interaction Design Framework Based on Personality of Customized Chatbot Design," Journal of Integrated Design Research, Vol. 18, No. 1, pp. 77-94, 2019. DOI : 10.21195/jidr.2019.18.1.005
  8. F. A. Smeaton and J. Callan, "Personalisation and Recommender Systems in Digital Libraries," International Journal on digital libraries, Vol. 5, No. 4, pp. 299-308, 2005. DOI : 10.1007/s00799-004-0100-1
  9. Y. Kim and S. Lee, "A Study on the Consumers' Perceptions toward Personalized Service," The Korean Journal of Advertising, Vol. 27, No. 7, pp. 31-57, 2016. https://doi.org/10.14377/KJA.2016.10.15.31
  10. A. Benlian, "Web Personalization Cues and Their Differential Effects on User Assessments of Website Value," Journal of Management Information Systems, Vol. 32, No. 1, pp.225-260, 2015. DOI : 10.1080/07421222.2015.1029394
  11. J. Gratch, S. Kang, and N. Wang, "Using Social Agents to Explore Theories of Rapport and Emotional Resonance," Social Emotions in Nature and Artifact, pp. 181-197, 2013.
  12. X. Ma, J. Hancock, and M. Naaman, "Anonymitiy, Intimacy and Self-disclosure in Social Media," Proceedings of the 2016 Conference on Human Factors in Computing Systems, pp. 3857-3869, 2016.
  13. L. Kim, H. Cha, and Y. Ji, "A Study on the Client Experience Using Chatbot based on Counseling Theory," Journal of Ergonomics Society of Korea, Vol. 38, No. 3, pp.161-175, 2019. DOI : 10.5143/JESK.2019.38.3.161
  14. J. Ahn, "Online Behavioral Advertising and Privacy," Journal of Cyber Communication Academic Society, Vol. 30, No. 4, pp.43-86, 2013.
  15. S. Byun and C. Cho, "The Effect of the Anthropomorphism Level and Personalization Level on AI Financial Chatbot Recommendation Messages on Customer Response," The Korean Journal of Advertising and Public Relations, Vol. 22, No. 2, pp. 466-502, 2020. https://doi.org/10.16914/kadpr.2020.22.2.466
  16. K. Kuligowska, "Commercial Chatbot: Performance Evaluation, Usability Metrics and Quality Standards of Embodied Conversational Agents," Professionals Center for Business Research, Vol. 2, pp. 1-16, 2015. https://doi.org/10.18483/PCBR.22
  17. S. Shon and J. Yoo, "Influence of the Evolutionary Direction of the Mobile Advertising Market on Social Welfare," Korea Information Society Development Institute, 2012.
  18. M. Jones, G. Buchanan, and H. Thimbleb, "Improving Web Search on Small Screen Devices," Interacting with Computers, Vol. 15, No. 4, pp. 479-495, 2003. DOI : 10.1016/S0953-5438(03)00036-5
  19. Y. Park, "A Study on the Discourse of Counseling-oriented Chatbot Service," Master Dissertation, Graduate school of Ewha Womans University, 2018.
  20. H. Baek, S. Kim, and S. Lee, "Effects of Interactivity and Usage Mode on User Experience in Chatbot Interface," Jourmal of the HCI Society of Korea, Vol. 14, No. 1, pp. 35-43, 2019. DOI : 10.17210/jhsk.2019.02.14.1.35
  21. V. Venkatesh, M. Morris, G. Davis, and F. Davis, "User Acceptance of Information Technology: Toward a Unified View," MIS quarterly, Vol. 27, No. 3, pp. 425-478, 2003. DOI : 10.2307/30036540
  22. M. Kim and G. Song, "An Exploratory Study on the Determinants of Chatbot Acceptance Using Unified Theory of Acceptance and Use of Technology," Proceedings of the 2017 Conference on Korea Technology Innovation Society, pp. 623-643, 2017.
  23. M. Kang, Y. Chi, and H. Kang, "A Study on the Effects of Mobile Native Advertising based on Social Media on Using Intention," The Korean Journal of Advertising, Vol. 27, No. 2, pp. 7-28, 2016. DOI : 10.14377/KJA2016.2.28.7
  24. A. Bhattacherjee and C. Sanfor, "Influence Processes for Information Technology Acceptance: an Elaboration Likelihood Model," MIS quarterly, Vol. 30, No. 4, pp. 805-825, 1989. DOI : 10.2307/25148755
  25. S. Lee and J. Choi, "Enhancing User Experience with Conversational Agent for Movie Recommendation: Effects of Self-disclosure and Reciprocity," International Journal of Human-Computer Studies, Vol. 103, pp. 95-105, 2017. DOI : 10.1016/j.ijhcs.2017.02.005
  26. Y. Kim, "Research Trend of Recommendation System for Personalized Service," Industrial Engineering Magazine, Vol. 19, No 1, pp. 37-42, 2013.
  27. S. Komiak and I. Benbasat, "The Effects of Personalization and Familiarity on Trust and Adoption of Recommendation Agents," MIS quarterly, Vol. 30, No. 4, pp. 941-960, 2006. DOI : 10.2307/25148760
  28. Y. Bang, D. Lee, and Y. Bae, "The Role of Perceived Personalization and Understanding in the Adoption of Personalization Services," Korean Management Review, Vol. 40, No. 2, pp. 355-382, 2011.
  29. R. Oliver, "Effect of Expectation and Disconfirmation on Post-exposure Product Evaluations: an Alternative Interpretation," Journal of Applied Psychology, Vol. 62, No. 4, pp. 480-486, 1977. DOI : 10.1037/0021-9010.62.4.480
  30. http://m.wsobi.com/news/articleView.html?idxno=109760#_enliple.html
  31. Y. Kim, J. Kim, and B. Ahn, "Privacy Paradox in Providing Personal Information," The Journal of Internet Electronic Commerce Research, Vol. 16, No. 1, pp. 119-151, 2016.
  32. C. Kang, G. Choi, and H. Kang, "A Study on the User Experience according to the Existence of Explanation Facilities and Individuals Privacy Concern Level," Journal of Korea Contents Association, Vol. 20, No. 2, pp. 203-214, 2020. https://doi.org/10.5392/JKCA.2020.20.02.203
  33. K. Min, K. Lee, "A Study on Non-Facing Services of National Pension in the Era of the 4th Industrial Revolution," The Journal of the Convergence on Culture Technology (JCCT), Vol. 4, No. 3, pp. 139-147, 2018. DOI : 10.17703/JCCT.2018.4.3.139
  34. H. Kim, S. Jung, and G. Ryu, "A Study on the Restaurant Recommendation Service App Based on AI Chatbot Using Personalization Information," International Journal of Advanced Culture Technology (IJACT), Vol. 8, No. 4, pp. 263-270, 2020. DOI : 10.17703/IJACT.2020.8.4.263
  35. http://www.epnc.co.kr/news/articleView.html?idxno=93544.html
  36. D. Berlyne, "Conflict, Arousal, and Curiosity," McGraw-Hill Book company, 1960.