Korean Journal of Acupuncture

Society for Meridian and Acupoint (경락경혈학회)
권호 표지
DOI QR코드

DOI QR Code

Usability and Educational Effectiveness of AI-based Patient Chatbot for Clinical Skills Training in Korean Medicine

한의학 임상실습교육을 위한 인공지능 기반 환자 챗봇의 사용성과 교육적 효과성

  • Yejin Han (Department of Korean Medical Education, College of Korean Medicine, Wonkwang University)
  • 한예진 (원광대학교 한의과대학 한의학교육실)
  • Received : 2024.02.05
  • Accepted : 2024.02.27
  • Published : 2024.03.27
Download PDF
⟨ Previous Next ⟩

Abstract

Objectives : This study developed an AI-based patient chatbot and examined the usability and educational effectiveness of the chatbot in the context of Korean medicine education. Methods : The patient chatbot was developed using the AI chatbot builder 'Danbee', and a total of five experts were surveyed and interviewed to determine the usability, effectiveness, advantages, disadvantages, and improvement points of the chatbot. Results : The patient chatbot was found to have high usability and educational effectiveness. The advantages of the patient chatbot were 1) it provided students with practical experience in performing clinical skills, 2) it provided instructors with assessment materials while reducing their teaching burden, and 3) it could be effectively used for horizontal and vertical integration education. The disadvantages and improvements of the patient chatbot were 1) improving the accuracy of intention inference, 2) providing students with specific instructions for problem-solving activities, and 3) providing assessment results and feedback about students' activities. Conclusions : This study is significant in that it proposes a new training method to overcome the limitations of the existing doctor-patient simulation. It is hoped that this study will stimulate further research on the improvement of students' clinical skills using artificial intelligence.

Keywords

References

  1. Yoon TY, Lee JK, Oh IH. Changes in the clerkship in Korean medical schools: the prospect of a student internship. Korean Medical Education Review. 2013 ; 15(2) ; 75-81. https://doi.org/10.17496/kmer.2013.15.2.075 
  2. Kang YS, Chae YB, Ko HY, Kim HH, Kim HS, Hong JS, et al. A study on the improvement of the national examination system for Korean medicine doctors. Institute of Korean Medicine Education & Evaluation. RE02-1802-03. 
  3. Jo HJ, Roh JD, Sung HK, Park JS. A survey on students' perception of clinical performance examination (CPX) in college of Korean medicine using student standardized patients. Journal of Society of Preventive Korean Medicine. 2020 ; 24(3) : 1-13. https://doi.org/10.25153/spkom.2020.24.3.001 
  4. Cho EB, Jung HJ, Leem JT. Peer role-play in a college of Korean medicine to improve senior students' competencies in patient care and communication: a case analysis and proposal for a model. The Journal of Korean Medicine. 2022 ; 43(3) : 49-64. https://doi.org/10.13048/jkm.22030 
  5. Park HK. Medical education using standardized patients. Hanyang Medical Reviews. 2012 ; 32(1) : 35-44. http://dx.doi.org/10.7599/hmr.2012.32.1.35 
  6. Smutny P, Schreiberova P. Chatbots for learning: a review of educational chatbots for the Facebook messenger. Computers & Education. 2020 ; 151 : 103862. https://doi.org/10.1016/j.compedu.2020.103862 
  7. Tanana MJ, Soma CS, Srikumar V, Atkins DC, Imel ZE. Development and evaluation of clientbot: patient-like conversational agent to train basic counseling skills. Journal of Medical Internet Research. 2019 ; 21(7) : e12529. https://doi.org/10.2196/12529 
  8. Kleinsmith A, Rivera-Gutierrez D, Finney G, Cendan J, Lok B. Understanding empathy training with virtual patients. Computers in human behavior. 2015 ; 52 : 151-8. https://doi.org/10.1016/j.chb.2015.05.033 
  9. Chang CC, Yan CF, Tseng JS. Perceived convenience in an extended technology acceptance model: mobile technology and english learning for college students. Australasian Journal of Educational Technology. 2012 ; 28(5) : 809-26. https://doi.org/10.14742/AJET.818 
  10. Braun V, Clarke V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006 ; 3 : 77-101. https://doi.org/10.1191/1478088706qp063oa 
  11. Suarez A, Adanero A, Diaz-Flores Garcia V, Freire Y, Algar J. Using a virtual patient via an artificial intelligence chatbot to develop dental students' diagnostic skills. Int J Environ Res Public Health. 2022 ; 19(14) : 8735. https://doi.org/10.3390/ijerph19148735 
  12. Kononowicz AA, Woodham LA, Edelbring S, Stathakarou N, Davies D, Saxena N, et al. Virtual patient simulations in health professions education: systematic review and meta-analysis by the digital health education collaboration. J Med Internet Res. 2019 ; 21(7) : e14676. https://doi.org/10.2196/14676 
  13. Plackett R, Kassianos AP, Mylan S, Kambouri M, Raine R, Sheringham J. The effectiveness of using virtual patient educational tools to improve medical students' clinical reasoning skills: a systematic review. BMC Med Educ. 2022 ; 22(1) : 365. https://doi.org/10.1186/s12909-022-03410-x