The Journal of Information Systems (한국정보시스템학회지:정보시스템연구)

Korea Association of Information Systems (한국정보시스템학회)
권호 표지
DOI QR코드

DOI QR Code

A Study of Negative Factors Affecting Perceived Usefulness and Intention to Continue Using ChatGPT: Focusing on the moderating effect of AI literacy

ChatGPT의 인지적 유용성과 지속 사용 의도에 영향 미치는 부정 요인에 관한 연구: AI 리터러시의 조절 효과를 중심으로

  • 조상리 (동의대학교 유통물류학과) ;
  • 정석찬 ( 동의대학교 e-비즈니스학과, 인공지능 그랜드 ICT 연구센터)
  • Accepted : 2024.07.22
  • Published : 2024.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Purpose This study aims to identify the factors that negatively affect the perceived usefulness of ChatGPT and their impact on perceived usefulness. Furthermore, this study aims to investigate whether AI literacy can reduce the degree of influence in the relationship between negative factors and perceived usefulness. Design/methodology/approach In this study, we surveyed users aged 20 or older who have been using ChatGPT for at least 3 months. A total of 191 questionnaires were distributed and collected for analysis. To test the hypotheses, path analysis and multiple group analysis were performed. Findings Privacy, limited comprehension, and hallucination were found to have a negative impact on perceived usefulness, while cost risk had no effect. AI literacy was also found to moderate in the relationships between privacy and perceived usefulness and between limited comprehension and perceived usefulness.

Keywords

Acknowledgement

본 논문은 정부(과학기술정보통신부)의 재원으로 정보통신기획평가원의 지원을 받아 수행된 지역지능화혁신인재양성사업임(IITP-2024-2020-0-01791)

References

  1. 고윤정, "AI 리터러시 향상이 자기 효능감에 미치는 영향," 한국지식정보기술학회 논문지, 제17권, 제5호, 2022, pp. 1017-1028.
  2. 김선경, "빅데이터 시대에 개인화서비스와 프라이버시 패러독스의 고찰: 사회기술적 관점을 중심으로," 한국지적정보학회지, 제16권, 제2호, 2014, pp. 193-207.
  3. 김선미, 손영두, "통합기술수용이론을 이용한 금융소비자들의 인공지능 서비스 수용의도 연구," 한국품질경영학회, 제50권, 제1호, 2022, pp. 43-61.
  4. 김영환, 최수일, "지각된 서비스 품질, 유용성, 용이성이 IPTV 사용자 만족 및 지속적 사용의도에 미치는 영향," 한국콘텐츠학회, 제9권, 제10호, 2009, pp. 314-327.
  5. 김예솔란, 이세진, "개인화 수준이 소비자의 인식과 수용의도에 미치는 영향: 모바일 쿠폰을 중심으로," 광고학연구, 제27권, 제7호, 2016, pp. 31-57.
  6. 김지현, 문명재, "정부신뢰와 정부역량인식이 4차 산업기술 위험인식에 미치는 영향: 디지털 리터러시의 조절효과를 중심으로," 한국지역정보화학회지, 제24권, 제3호, 2021, pp. 43-72.
  7. 양정애, "챗GPT이용 경험 및 인식조사," 한국언론진흥재단 Media Issue, 제9권, 제3호, 2023, pp. 1-16.
  8. 이채은, "챗GPT 특성, 지각된 유용성, 지속이용의도 간의 구조관계 분석: 호텔.외식경영학 전공 대학생들을 중심으로," 호텔경영학연구, 제32권 제5호, 2023, pp. 61-76.
  9. 윤기영, "챗GPT의 한계와 가능성," ifs POST, News Insight, 2023.
  10. 장창기, 성욱준, "인공지능 기반 공공서비스 정책수용 의도에 관한 연구: 개인의 인식과 디지털 리터러시 수준이 미치는 영향을 중심으로," 정보화정책, 제29권, 제1호, 2022, pp. 60-83.
  11. 황서이, 남영자, "인공지능에 대한 지식, 감정, 수용의도 관계에서 위험인식의 매개 및 조절효과 분석," 한국콘텐츠학회논문지, 제20권, 제8호, 2020, pp. 350-358.
  12. 황현정, 황용석, "AI 리터러시 개념화와 하위차원별 세부 역량 도출에 관한 연구," 사이버커뮤니케이션학보, 제40권, 제2호, 2023, pp. 89-148.
  13. 한국일보, retrieved March 28, 2023, Available: https://m.hankookilbo.com/News/Read/A2023052814140005992.
  14. Bhattacherjee, A., "Understanding Information Systems Continuance: An Expectation-Confirmation Model," MIS Quarterly, Vol. 25, No, 3, 2001, pp. 351-370.
  15. Bollen, K. A., "Wiley Series in Probability and Mathematical Statistics. Applied Probability and Statistics Section. Structural Equations with Latent Variables," Oxford, England: John Wiley & Sons, 1989.
  16. Business Today, Samsung Employee Accidentally Leaked Company Secrets Via ChatGPT, 2023.
  17. Chellappa, R. K., and Sin, R. G., "Personalization Versus Privacy: An Empirical Examination of the Online Consumer's Dilemma," Information Technology and Management, Vol. 6, No. 2, 2005, pp. 181-202.
  18. Choudhury, A., and Shamszare, H., "Investigating the Impact of User Trust on the Adoption and Use of ChatGPT: Survey Analysis," Journal of Medical Internet Research, Vol. 25, e47184, 2023, pp. 1-11.
  19. Featherman, M. S., and Pavlou, P. A., "Predicting e-Services Adoption: a Perceived Risk Facets Perspective," International Journal of Human Computer Studies, Vol. 59, No. 4, 2003, pp. 451-474.
  20. Guleria, A., Krishan, K., Sharma, V., and Kanchan, T., "ChatGPT: Ethical Concerns and Challenges in Academics and Research," The Journal of Infection in Developing Countries, Vol. 17, No. 9, 2023, pp. 1292-1299.
  21. Jayashankar, P., Nilakanta, S., Johnston, W. J., Gill, P., and Burres, R., "IoT Adoption in Agriculture: the Role of Trust, Perceived Value and Risk," Journal of Business & Industrial Marketing, Vol. 33, No. 6, 2018, pp. 804-821.
  22. Jayakumar, S., Sounderajah, V., Normahani, P., Harling, L., Markar, S. R., Ashrafian, H., and Darzi, A., "Quality Assessment Standards in Artificial Intelligence Diagnostic Accuracy Systematic Reviews: a Meta-Research Study," NPJ Digital Medicine, Vol. 5, No. 1, 2022, pp. 1-13.
  23. Kalla, D., and Smith, N., "Study and Analysis of Chat GPT and its Impact on Different Fields of Study," International Journal of Innovative Science and Research Technology, Vol. 8, No. 3, 2023, pp. 872-883.
  24. Laurn, P., and Lin, H. H., "Toward an Understanding of the Behavioral Intention to Use Mobile Banking," Computers in Human Behavior, Vol. 21, Issue 6, 2005, pp. 873-891.
  25. Lee, M. K. Verma, R., and Aleda Roth, A., "Understanding Customer Value in Technology-Enabled Services: A Numerical Taxonomy based on Usage and Utility," Service Science, Vol. 7, No. 3, 2015, pp. 227-248.
  26. Lin, X., Shao, B., and Wang, X., "Employees' Perceptions of Chatbots in B2B Marketing: Affordances vs. Disaffordances," Industrial Marketing Management, Vol. 101, No. 1, 2022, pp. 45ᐨ56.
  27. Long, D., and Magerko, B., "What is AI Literacy? Competencies and Design Considerations," Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, pp. 1-16.
  28. Lutz, C., "Digital Inequalities in the Age of Artificial Intelligence and Big Data," Human Behavior and Emerging Technologies, Vol. 1, Issue 2, 2019, pp. 69-175.
  29. Menon, D., and Shilpa, K., "Chatting with ChatGPT: Analyzing the Factors Influencing Users' Intention to Use the Open AI's ChatGPT Using the UTAUT Model," Heliyon, Vol. 9, No. 11, 2023, pp. 1-19.
  30. Mishra, A., Baker-Eveleth, L., Gala, P., and Stachofsky, J., "Factors Influencing Actual Usage of Fitness Tracking Devices: Empirical Evidence from the UTAUT Model," Health Marketing Quarterly, Vol. 40, No. 1, 2023, pp. 19-38.
  31. Reinartz, W. and Kumar, B., "On the Profitability of Long-Life Customers in a Noncontractual Setting: An Empirical Investigation and Implications for Marketing," Journal of Marketing, Vol. 64, No. 4, 2000, pp. 17-35.
  32. Sallam, M., "ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns," Healthcare, Vol. 11, No. 6, 2023, pp. 887.
  33. Shim, H. J., "The Paradox of Artificial Intelligence (AI) and Privacy: Focusing on AI Voice Assistants," KISDI Premium Report, 2018.
  34. Tan, X., Qin, L., Kim, Y., and Hsu, J., "Impact of Privacy Concern in Social Networking Web Sites," Internet Research, Vol. 22, No. 2, 2012, pp. 211-233.
  35. Tussyadiah, I., "A Review of Research into Automation in Tourism: Launching the Annals of Tourism Research Curated Collection on Artificial Intelligence and Robotics in Tourism," Annals of Tourism Research, Vol. 81, 2020, 102883.
  36. Tzavlopoulos, Ι., Gotzamani, K., Andronikidis, A., and Vassiliadis, C., "Determining the Impact of e-Commerce Quality on Customers' Perceived Risk, Satisfaction, Value and Loyalty," International Journal of Quality and Service Sciences, Vol. 11, No. 4, 2019, pp. 576-587.
  37. Wu, X., Duan, R., and Ni, J., "Unveiling Security, Privacy, and Ethical Concerns of ChatGPT," Journal of Information and Intelligence, Vol. 2, Issue 2, 2024, pp. 102-115.
  38. Wu, J. H. and Wang, S. C., "What Drives Mobile Commerce?: An Empirical Evaluation of the Revised Technology Acceptance Model," Information & Management, Vol. 42, No. 5, 2005, pp. 719-729.
  39. Yi, J., Yuan, G., and Yoo, C., "The Effect of the Perceived Risk on the Adoption of the Sharing Economy in the Tourism Industry: The Case of Airbnb," Information Processing & Management, Vol. 57, No. 1, 2020, pp. 1-11.
  40. Zeithaml, V. A., "Consumer Perceptions of Price, Quality and Value: A Means-End Model and Synthesis of Evidence," Journal of Marketing, Vol, 52, No. 3, 1988, pp. 2-22.