Journal of Korean Biological Nursing Science

Korean society of Biological Nursing Science (한국기초간호학회)
권호 표지
DOI QR코드

DOI QR Code

Evaluation of the applicability of ChatGPT in biological nursing science education

ChatGPT의 기초간호학교육 활용 가능성 평가

  • Sunmi Kim (College of Nursing, Woosuk University) ;
  • Jihun Kim (Department of Nursing, Jeonbuk National University Hospital) ;
  • Myung Jin Choi (Department of Nursing, Presbyterian Medical Center) ;
  • Seok Hee Jeong (College of Nursing.Research Institute of Nursing Science, Jeonbuk National University)
  • Received : 2023.07.11
  • Accepted : 2023.08.14
  • Published : 2023.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Purpose: The purpose of this study was to evaluate the applicability of ChatGPT in biological nursing science education. Methods: This study was conducted by entering questions about the field of biological nursing science into ChatGPT versions GPT-3.5 and GPT-4 and evaluating the answers. Three questions each related to microbiology and pharmacology were entered, and the generated content was analyzed to determine its applicability to the field of biological nursing science. The questions were of a level that could be presented to nursing students as written test questions. Results: The answers generated in English had 100.0% accuracy in both GPT-3.5 and GPT-4. For the sentences generated in Korean, the accuracy rate of GPT-3.5 was 62.7%, and that of GPT-4 was 100.0%. The total number of Korean sentences in GPT-3.5 was 51, while the total number of Korean sentences in GPT-4 was 68. Likewise, the total number of English sentences in GPT-3.5 was 70, while the total number of English sentences in GPT-4 was 75. This showed that even for the same Korean or English question, GPT-4 tended to be more detailed than GPT-3.5. Conclusion: This study confirmed the advantages of ChatGPT as a tool to improve understanding of various complex concepts in the field of biological nursing science. However, as the answers were based on data collected up to 2021, a guideline reflecting the most up-to-date information is needed. Further research is needed to develop a reliable and valid scale to evaluate ChatGPT's responses.

Keywords

References

  1. Presidential Committee on The Fourth Industrial Revolution. A study on the future education framework and future school suitable for the era of the 4th industrial revolution [Internet]. Sejong: Presidential Committee on The Fourth Industrial Revolution; 2018 [cited 2023 Apr 03]. Available from: https://www.pa.go.kr/portal/info/periodicalRegist/periodicalRegistDetail.do?book_num=1651#
  2. Kim JS. Special report, 'Chat GPT' craze shakes the AI market [Internet]. Seoul: Electronic Times Internet; 2023 [cited 2023 Apr 03]. Available from: https://www.etnews.com/20230130000092
  3. Jagranjosh. What is ChatGPT: definition, how to use it [Internet]. Noida: Jagranjosh; 2023 [cited 2023 Apr 03]. Available from: https://www.jagranjosh.com/general-knowledge/what-is-chat-gpt-1676870553-1
  4. Bernard M. What is GPT-3 and why is it revolutionizing artificial intelligence? [Internet]. JerseyCity: Forbe; 2020 [cited 2023 Apr 03]. Available from: https://www.forbes.com/sites/bernardmarr/2020/10/05/what-is-gpt-3-and-why-is-it-revolutionizing-artificial-intelligence/?sh=6debb355481a
  5. OpenAI. Introducing ChatGPT [Internet]. San Francisco: OpenAI; 2023 [cited 2023 Apr 03]. Available from: https://openai.com/blog/chatgpt
  6. Kim TW. Can ChatGPT be a tool for innovation?: ChatGPT use cases and prospects [Internet]. Seoul: National Information Society Agency; 2023 [cited 2023 May 03]. Available from: https://www.nia.or.kr/site/nia_kor/ex/bbs/View.do?cbIdx=82618&bcIdx=25163&parentSeq=25163
  7. Fawad A. GPT-1 to GPT-4: Each of OpenAI's GPT models explained and compared [Internet]. Quebec: Makeuseof; 2023 [cited 2023 May 8]. Available from: https://www.makeuseof.com/gpt-models-explained-and-compared/
  8. OpenAI. GPT-4 Technical Report. ArXiv [Preprint]. 2023 [cited 2023 May 03]. Available from: https://doi.org/10.48550/arXiv.2303.08774
  9. King MR. A conversation on artificial intelligence, chatbots, and plagiarism in higher education. Cellular and Molecular Bioengineering. 2023;16(1):1-2. https://doi.org/10.1007/s12195-022-00754-8
  10. Ban BH. ChatGPT: Singularity finally reached. 1st ed. Paju: Life & Power Press; 2023.
  11. Jang SM. ChatGPT has changed the future of writing education - Focusing on the response of writing education in the era of artificial intelligence. Writing Research. 2023;56:07-34. https://doi.org/10.31565/korrow.2023.56.001
  12. Kim TJ, Im YI, Chung SB, Choi DH, Kim CH. "I gave the assignment to ChatGPT and got an A"... University emergency ahead of school opening [Internet]. Seoul: Chosunilbo; 2023 [cited 2023 Apr 03]. Available from: https://www.chosun.com/national/education/2023/02/10/2PMQM6YIMZAAZKQI7ZJNM26IUM/
  13. Kim HB. Exclusive, Seoul national university, semiconductor design lecture using 'ChatGPT' from the 2nd semester [Internet]. Seoul: Joongangilbo; 2023 [cited 2023 Apr 03]. Available from: https://www.joongang.co.kr/article/25151364#home
  14. Shin DK, Jung HK, Lee YS. Exploring the potential of using ChatGPT as a content-based English learning and teaching tool. Journal of the Korea English Education Society. 2023;22(1):171-192.
  15. Lee KS, Jeong JS, Choe M, Kim JH, An GJ, Kim JH, et al. Development of standard syllabuses for 4 subjects (structure and function of human body, pathogenic microbiology, pathophysiology, mechanisms and effects of drug) of bionursing. Journal of Korean Biological Nursing Science. 2013;15(1):33-42. https://doi.org/10.7586/jkbns.2013.15.1.33
  16. OpenAI. ChatGPT [Internet]. San Francisco: OpenAI; 2023 [cited 2023 Apr 03]. Available from: https://chat.openai.com/chat
  17. OpenAI. ChatGPT 4.0 [Internet]. San Francisco: OpenAI; 2023 [cited 2023 Apr 03]. Available from: https://openai.com/gpt-4
  18. Steven VN. GPT-3.5 vs GPT-4: Is ChatGPT plus worth its subscription fee? [Internet]. San Francisco: ZDNET; 2023 [cited 2023 Apr 03]. Available from: https://www.zdnet.com/article/gpt-3-5-vs-gpt-4-is-chatgpt-plus-worth-its-subscription-fee/
  19. Kunerth V. ChatGPT-3.5 is all well and good, but ChatGPT-4, at $20 a month via ChatGPT Plus, is a good deal smarter and more accurate [Internet]. Mountain View: Linkedin; 2023 [cited 2023 Jun 03]. Available from: https://www.linkedin.com/pulse/chatgpt-35-vs-chatgpt-4-comparison-latest-gpt-based-chatbot-kunerth
  20. Hong EY, Kwon YR, Kim SH, Kim YJ, Kim JS, Ryu DJ, et al. Essential nursing microbiology. 6th ed. Seoul: Hyunmoon Publishing; 2021.
  21. Elsevier. Guide for Authors - Declaration of generative AI in scientific writing [Internet]. Amsterdam: Elsevier; 2023 [cited 2023 Apr 03]. Available from: https://www.elsevier.com/journals/nurse-education-in-practice/1471-5953/guide-for-authors
  22. National Information Society Agency. The emergence of ChatGPT and legal system issues. Seoul: National Information Society Agency (NIA); 2023 [cited 2023 May 03]. Available from: https://www.nia.or.kr/site/nia_kor/ex/bbs/View.do?cbIdx=82618&bcIdx=25371&parentSeq=25371
  23. Lee HG. Korea university, the first Korean university to establish guidelines for using ChatGPT [Internet]. Seoul: University Intelligence; 2023 [cited 2023 May 13]. Available from: https://www.unipress.co.kr/news/articleView.html?idxno=8088
  24. Korea pharmaceutical information center. Drug search [Internet]. Seoul: Korea pharmaceutical information center; 2000 [cited 2023 May 12]. Available from: https://www.health.kr/main.asp
  25. van Dis EA, Bollen J, Zuidema W, van Rooij R, Bockting CL. ChatGPT: five priorities for research. Nature. 2023;614(7947):224-226. https://doi.org/10.1038/d41586-023-00288-7
  26. Im JH. Business report written with 'ChatGPT' and its implications [Internet]. Seoul: IBK Economic Research Institute (Weekly IBK Economic Brief); 2023 [cited 2023 Apr 18]. Available from: http://research.ibk.co.kr/research/board/economy-news/details/251694?url=L2JvYXJkL2Vjb25vbXktbmV3cy9saXN0
  27. Thorp HH. ChatGPT is fun, but not an author. Science. 2023;379(6630):313. https://doi.org/10.1126/science.adg7879
  28. Flanagin A, Bibbins-Domingo K, Berkwits M, Christiansen SL. Nonhuman "Authors" and implications for the integrity of scientific publication and medical knowledge. JAMA. 2023;329(8):637-639. https://doi.org/10.1001/jama.2023.1344
  29. Sun GH, Hoelscher SH. The ChatGPT storm and what faculty can do. Nurse Educator. 2023;48(3):119-124. https://doi.org/10.1097/NNE.0000000000001390
  30. Kim SM. 'AI that catches AI' is also developed one after another [Internet]. Seoul: Chosunilbo; 2023 [cited 2023 Jun 7]. Available from: https://www.chosun.com/economy/economy_general/2023/05/24/MMPJJ4YX5BCXTCBSSSC5O32FUU/
  31. Lund BD, Wang T. Chatting about ChatGPT: how may AI and GPT impact academia and libraries? Library Hi Tech News. 2023;40(3):26-29. https://doi.org/10.1108/LHTN-01-2023-0009
  32. Ruksakulpiwat S, Kumar A, Ajibade A. Using ChatGPT in medical research: current status and future directions. Journal of Multidisciplinary Healthcare. 2023;16:1513-1520. https://doi.org/10.2147/JMDH.S413470
  33. Mohammad B, Supti T, Alzubaidi M, Shah H, Alam T, Shah Z, et al. The pros and cons of using ChatGPT in medical education: a scoping review. Studies in Health Technology and Informatics. 2023;305:644-647. https://doi.org/10.3233/SHTI230580
  34. O'Connor S. Open artificial intelligence platforms in nursing education: tools for academic progress or abuse? Nurse Education in Practice. 2022;66:103537. https://doi.org/10.1016/j.nepr.2022.103537
  35. O'Connor S. Corrigendum to "Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse?" [Nurse Education in Practice. 66 (2023) 103537]. Nurse Education in Practice. 2023;67:103572. https://doi.org/10.1016/j.nepr.2023.103572
  36. Lee SW. Yonsei university's 'ChatGPT ghostwriting suspicion' task 0 points processed... "Writing assignments, turning to note-taking" [Internet]. Seoul: Dongailbo; 2023 [cited 2023 Jun 7]. Available from: https://rocket.orbi.kr/00062548409
  37. Choi MS, Choi WY, Lee MS. International school students in Korea, ghostwriting assignments with ChatGPT... 'All 0 points' [Internet]. Seoul: Dongailbo; 2023 [cited 2023 Jun 7]. Available from: https://www.donga.com/news/Society/article/all/20230209/117801590/1
  38. Kim JY. Korea university, the first 'ChatGPT guidelines'... "Interviews, questionnaires, etc" [Internet]. Seoul: Seoul Shinmun; 2023 [cited 2023 Jun 7]. Available from: https://www.seoul.co.kr/news/newsView.php?id=20230317010008
  39. Ben D. ChatGPT error... Leak other users' conversation history [Internet]. BBC News Korea; 2023 [cited 2023 May 13]. Available from: https://www.bbc.com/korean/articles/cje57559n90o
  40. Kim MJ, Kang NM, Kim SW, Rhyu SW, Chang HJ, Hong SK, et al. Development of an evaluation checklist for internet health/disease information. Journal of Korean Society of Medical Informatics. 2006;12(4):283-292. https://doi.org/10.4258/jksmi.2006.12.4.283