Journal of Korean society of Dental Hygiene (한국치위생학회지)

Korean Society of Dental Hygiene (한국치위생학회)
권호 표지
DOI QR코드

DOI QR Code

Development of an interprofessional education evaluation tool

전문직 간 교육 평가 도구 개발

  • Hye-Won Choi (Department of Dental Hygiene, Graduate School of Health Science, Eulji University) ;
  • Hee-Jung Lim (Department of Dental Hygiene, Graduate School of Health Science, Eulji University) ;
  • Myung-Chul Kim (Department of Physical Therapy, Graduate School of Health Science, Eulji University) ;
  • Do-Seon Lim (Department of Dental Hygiene, Graduate School of Health Science, Eulji University) ;
  • Young-Sun Hwang (Department of Dental Hygiene, Graduate School of Health Science, Eulji University) ;
  • Im-Hee Jung (Department of Dental Hygiene, Graduate School of Health Science, Eulji University)
  • 최혜원 (을지대학교 보건복지대학원 치위생학과) ;
  • 임희정 (을지대학교 보건복지대학원 치위생학과) ;
  • 김명철 (을지대학교 보건복지대학원 물리치료학과) ;
  • 임도선 (을지대학교 보건복지대학원 치위생학과) ;
  • 황영선 (을지대학교 보건복지대학원 치위생학과) ;
  • 정임희 (을지대학교 보건복지대학원 치위생학과)
  • Received : 2023.07.14
  • Accepted : 2023.08.06
  • Published : 2023.08.30
Download PDF
⟨ Previous Next ⟩

Abstract

Objectives: In this study, we aimed to develop a systematic tool that can evaluate the effects of interprofessional education (IPE) by applying four core competencies (values/ethics for interprofessional practice, roles/responsibilities, interprofessional communication, and teams and teamwork) and an educational evaluation model to evaluate the learning, behavior of learners, and results step by step. Methods: Previous studies on IPE evaluation tools were analyzed, and an evaluation tool (draft) was developed by modifying questions suitable for evaluation according to the Kirkpatrick model's stages and core competencies. The evaluation tool was completed by conducting a Delphi survey twice with 4-6 experts. To analyze the Delphi survey, the content validity index (CVI) was calculated, and the reliability coefficient (Cronbach's alpha coefficient) was used to measure reliability. Results: 29 questions on pre-education, consisting of learning and behavior stages, and 54 questions on post-education, consisting of reaction, learning, behavior, and results stages, were developed. The CVI and Cronbach's alpha coefficient values were >0.8 and >0.6, respectively. Conclusions: The IPE evaluation tool developed in this study is expected to contribute to the evaluation of the educational level of IPE and the identification of points for improvement when applied to various educational settings.

Keywords

References

  1. Lee, HK, Kim IS, Kim GS, Kim JH, Lee TW, Lee KH, et al. Nursing and other health-related students. J Korean Acad Soc Nurs Educ 2019;25(3):312-20. https://doi.org/10.5977/jkasne.2019.25.3.312 
  2. Hammick M, Freeth D, Koppel I, Reeves S, Barr H. A best evidence systematic review of Interprofessional education. Medical Teacher 2007;29(8):735-51. https://doi.org/10.1080/01421590701682576 
  3. World Health Organization. WHO patient safety curriculum guide: multi-professional edition 2011. Swiss: World Health Organization; 2011:25-7. 
  4. D'amour D, Oandasan I. Interprofessionality as the field of interprofessional practice and interprofessional education: an emerging concept. J Interprof Care 2005;19(1):8-20. https://doi.org/10.1080/13561820500081604 
  5. Yoon SY. A literature review of association between periodontal disease and systemic disease[Master's thesis]. Gwangju: Chonnam National University, 2017. 
  6. Grant C, Lesley B, John G. The University of British Columbia model of interprofessional education. J Interprof Care 2010;24(1):9-18. https://doi.org/10.3109/13561820903294549 
  7. Maria JK, Nico HJC, Vanessa RYH, Miranda GHL. Perceptions of interprofessional collaboration in education of dentists and dental hygienists and the impact on dental practice in the Netherlands: a qualitative study. Eur J Dent Educ 2020;24(1):145-53. https://doi.org/10.1111/eje.12478 
  8. Oh SA. A study on the practical examples of interprofessional education of health and medical welfare field[Master's thesis]. Gwangju: Chosun University, 2021 
  9. Interprofessional Education Collaborative Expert Panel. Core competencies for interprefessional collaborative practice: report of an expert panel. Washington D.C.: Interprofessional Education Collaborative. 2011:15-26. 
  10. Edelbring S, Dahlgren MA, Edstrom DW. Characteristics of two questionnaires used to assess interprofessional learning: psycho metrics and expert panel evaluations. BMC medical education 2018;18(1):40. https://doi.org/10.1186/s12909-018-1153-y 
  11. Parsell G, Bligh J. The development of a questionnaire to assess the readiness of health care students for interprofessional learning (RIPLS). Medical Education 1999;33(2):95-100. https://doi.org/10.1046/j.1365-2923.1999.00298.x 
  12. Mann K, McFetridge-Durdle J, Breau L, Clovis J, Martin-Misener R, Matheson T, et al. Development of a scale to measure health professions students' self-efficacy beliefs in interprofessional learning. J Interprof Care 2012;26(2):92-9. https://doi.org/10.3109/13561820.2011.640759 
  13. Norris J, Carpenter JG, Eaton J, Guo JW, Lassche M, Pett MA, et al. The development and validation of the interprofessional attitudes scale: assessing the interprofessional attitudes of students in the health professions. Acad Med 2015;90(10):1394-400. https://doi.org/10.1097/ACM.0000000000000764 
  14. Gillan C, Lovrics E, Halpern E, Wiljer D, Harnett N. The evaluation of learner outcomes in interprofessional continuing education: a literature review and an analysis of survey instruments. Medical Teacher 2011;33(9):461-70. https://doi.org/10.3109/0142159X.2011.587915 
  15. Kirkpatrick D, Kirkpatrick J. Evaluating training programs: The four levels. 3rd ed. Oakland: Berrett-Koehler Publishers; 2006:27-71. 
  16. Kirkpatrick DL. Seven keys to unlock the four levels of evaluation. Performance Improvement 2006;45(7):5-8. https://doi.org/10.1002/pfi.2006.4930450702 
  17. Peter D. How to Succeed at Interprofessional Education. Hoboken: Wiley-Blackwell. 2019:105-34. 
  18. Park HY, Cho JY, Chu SH. Interprofessional education programs for nursing students: a systematic review. J Korean Acad Soc Nurs Educ 2018;24(3):235-49. https://doi.org/10.5977/jkasne.2018.24.3.235 
  19. Oh MN. A study on the reaction evaluation of job analysis-based curriculum: focusing on the NCS-based curriculum of community colleges[Master's thesis]. Seoul: Dongduk Women's University, 2015. 
  20. Lee JY. A research on relationships among physical therapy environmental services, patient satisfaction and revisit intentions in a military hospital[Master's thesis]. Chuncheon: Hallym University, 2019. 
  21. Lynn MR. Determination and quantification of content validity. Nurs Res 1986;35(6):382-5. https://doi.org/10.1097/00006199-198611000-00017 
  22. Knapp TR. Coefficient alpha: conceptualizations and anomalies. Res Nurs Health 1991;14(6):457-60. https://doi.org/10.1002/nur.4770140610 
  23. Applin H, Williams B, Day R, Buro K. A comparison of competencies between problem-based learning and non-problem based graduate nurses. Nurse Educ Today 2011;31(2):129-34. https://doi.org/10.1016/j.nedt.2010.05.003 
  24. Morris MC, Gallagher TK, Ridgway PF. Tools used to assess medical students competence in procedural skills at the end of a primary medical degree: a systematic review. Med Educ Online 2012;17(1):1-9. https://doi.org/10.3402/meo.v17i0.18398 
  25. Rogers GD, Thistlethwaite JE, Anderson ES, Abrandt DM, Grymonpre RE, Moran M, et al. International consensus statement on the assessment of interprofessional learning outcomes. Med Teach 2017;39(4):347-59. https://doi.org/10.1080/0142159X.2017.1270441 
  26. An JH. A case study on multi-source assessment of teaching: its possibility and limitation. The Journal of Curriculum Studies 2007;25(4):179-205. https://doi.org/10.15708/kscs.25.4.200712.008 
  27. Jung EJ, Sung SSL, Woo SM. HRD practitioners' recognition of the Kirkpatrick evaluation model: focused on strengths, limits, and improvements. KJHRDQ 2016;18(3):115-43. https://doi.org/10.18211/kjhrdq.2016.18.3.005 
  28. Kim SJ, Kang HK. Problem based learning evaluation and evaluation agents-focused on tutor, peer and self evaluation. KAIS 2013;14(8):3732-8. https://doi.org/10.5762/KAIS.2013.14.8.3732 
  29. Topping K. Peer assessment between students in colleges and universities. Rev Educ Res 1998;68(3):249-76. https://doi.org/10.2307/1170598 
  30. Sung TJ. Validity and reliability. 2nd ed. Seoul: hakjisa; 2002:83-129. 
  31. Polit DF. Measurement and the measurement of change. 2nd ed. New York: Wolters Kluwer; 2016:108-68. 
  32. Lee EH, Kang EH, Kang HJ. Evaluation of studies on the measurement properties of self-reported instruments. Asian Nurs Res 2020;14(5):267-76. https://doi.org/10.1016/j.anr.2020.11.004 
  33. Finch E, Lethlean J, Rose T, Fleming J, Theodoros D, Cameron A, et al. How does feedback from patients impact upon healthcare student clinical skill development and learning? a systematic review. Medical Teacher 2018;40(3):244-52. https://doi.org/10.1080/0142159X.2017.1401218