Analysis of Trends in Self-assessment of Performance of Clinical Skills in Nursing Students after OSCE

구조화된 객관적 임상시험(OSCE) 실시 후 간호학생들의 임상수행능력에 대한 자기평가경향 분석

  • Han, Mi-Hyun (Department of Nursing, Hyejeon College) ;
  • Park, Seok-Gun (Department of Nuclear Medicine, Dankook University College of Medicine)
  • Received : 2011.01.24
  • Accepted : 2011.03.01
  • Published : 2011.05.31

Abstract

Purpose: The self-assessment ability of students is important in acquiring clinical skills. The study explored the self-assessment behavior of nursing students after OSCE (Objective Structured Clinical Examination). Methods: The participants were 90 nursing students. They assessed their performance just after an OSCE (assessment 1). They were given OSCE checklists and re-assessed their performance level (assessment 2). Assessments 1, 2, and an assessment by professor were compared and analyzed. Results: Students assessed themselves higher than professor. But, when students were divided into three groups according to score level, different behaviors were evident between the groups. The high-score group assessed themselves lower than the professor, while the mid-and low-score groups assessed themselves higher than the professor. Students' self-assessment more closely approximated the professor's assessment when they were given checklists. The correlation between assessments 1 and 2 was stronger in high-score group and weak in low-score group. Conclusion: The study results indicate that students tend to assess their skills higher than the professor, but their scores were more in line with the professor when they were provided with checklists, and students' self-assessment behavior differed in the different score groups, suggesting a need for customized feedback and a concern for students with low scores.

Keywords

References

  1. Antonelli, M. A. S. (1997). Accuracy of second-year medical students' self-assessment of clinical skills. Academic Medicine, 72, S63-S65. https://doi.org/10.1097/00001888-199710001-00022
  2. Cheung, N. Y., & Song, Y. S. (2006). Clinical application of objective structured clinical examination (OSCE) for novice nurses. Journal of Korean Academy of Fundamentals of Nursing, 13, 334-342.
  3. Coutts, L., & Rogers, J. (1999). Predictors of student selfassessment accuracy during a clinical performance exam: Comparisons between over-estimators and under- estimators of SP-evaluated performance. Academic Medicine, 74, S128-S130. https://doi.org/10.1097/00001888-199910000-00062
  4. Das, M., Mpofu, D., Dunn, E., & Lanphear, J. H. (1998). Self and tutor evaluations in problem-based learning tutorials: is there a relationship? Medical Education, 32, 411-418. https://doi.org/10.1046/j.1365-2923.1998.00217.x
  5. Edwards, A., Tzelepis, A., Klingbeil, C., Melgar, T., Speece, M., Schubiner, H. (1996). Fifteen years of a videotape review program for internal medicine and medicine-pediatrics residents. Academic Medicine, 71, 744-748. https://doi.org/10.1097/00001888-199607000-00006
  6. Gordon, M. J. (1991). A review of the validity and accuracy of self-assessments in health professions training. Academic Medicine, 66, 762-769. https://doi.org/10.1097/00001888-199112000-00012
  7. Han, M. H. (2008). Educational effect of OSCE module developing activity by nursing students. Journal of Korean Academy of Fundamentals of Nursing, 15, 14-21.
  8. Han, M. H., & Park, S. G. (2009). Differences between scores assessed by examiners and examinees on objectives structured clinical examination. Korean Journal of Medical Education, 21, 279-285. https://doi.org/10.3946/kjme.2009.21.3.279
  9. Hodges, B., Regehr, G., & Martin, D. (2001). Difficulties in recognizing one's own incompetence: Novice physicians who are unskilled and unaware of it. Academic Medicine, 76, S87-S89. https://doi.org/10.1097/00001888-200110001-00029
  10. Huh, J. W., Han J. J., & Im, H. J. (2008). Medical students' goals, methods and opinions on self-directed learning and analysis of self-assessment. Korean Journal of Medical Education, 20, 123-132. https://doi.org/10.3946/kjme.2008.20.2.123
  11. Im, S. J., Yune, S. J., Kang, S. Y., Lee, S. Y., Kim, H. K., & Jeong, H. J. (2007). The effect of direct feedback in teaching endotracheal intubation. Korean Journal of Medical Education, 19, 325-333. https://doi.org/10.3946/kjme.2007.19.4.325
  12. Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77, 1121-1134.
  13. Linn, B. S., Arostegui, M., & Zeppa, R. (1975). Performance rating scale for peer and self assessment. British Journal of Medical Education. 9, 98-101.
  14. Martin, D., Regehr, G., Hodges, B., & McNaughton, N. (1998). Using videotaped benchmarks to improve the self-assessment ability of family practice residents. Academic Medicine, 73, 1201-1206. https://doi.org/10.1097/00001888-199811000-00020
  15. Mattheos, N., Nattestad, A., Falk-Nilsson, E., & Attstrom, R. (2004). The interactive examination: assessing students' self-assessment ability. Medical Education, 38, 378-389. https://doi.org/10.1046/j.1365-2923.2004.01788.x
  16. Morton, J. B., & Macbeth, W. A. A. G. (1977). Correlations between staff, peer and self assessments of fourth-year students in surgery. Medical Education, 11, 167-170. https://doi.org/10.1111/j.1365-2923.1977.tb00586.x
  17. Sclabassi, S. E., & Woelfel, S. K. (1984). Development of self-assessment skills in medical students. Medical Education, 18, 226-231. https://doi.org/10.1111/j.1365-2923.1984.tb01015.x
  18. Shin, J. S., Lee, S. A., & Park, H. K. (2005). Standardized patients' accuracy in recording checklist items during clinical performance examinations. Korean Journal of Medical Education, 17, 197-203. https://doi.org/10.3946/kjme.2005.17.2.197
  19. Stuart, M. R., Goldstein, H. S., & Snope, F. C. (1980). Self-evaluation by residents in family medicine. The Journal of Family Practice, 10, 639-642.
  20. Sullivan, M. E., Hitchcock, M. A., & Dunnington, G. L. (1999). Peer and self assessment during problem-based tutorials. The American Journal of Surgery, 177, 266-269. https://doi.org/10.1016/S0002-9610(99)00006-9
  21. Violato, C., & Lockyer, J. (2006). Self and peer assessment of pediatricians, psychiatrists and medicine specialists: implications for self-directed learning. Advances in Health Sciences Education, 11, 235-244. https://doi.org/10.1007/s10459-005-5639-0
  22. Vivekananda-Schmidt, P., Lewis, M., Hassell, A. B., Coady, D., Walker, D., Kay, L., et al. (2007). Validation of mast: an instrument to measure medical students' self-assessed confidence in musculoskeletal examination skills. Medical Education, 41, 402-410. https://doi.org/10.1111/j.1365-2929.2007.02712.x
  23. Woolliscroft, J. O., Tenhaken, J., Smith, J., & Calhoun, J. G. (1993). Medical students' clinical self-assessments: comparisons with external measures of performance and the students' self-assessments of overall performance and effort. Academic Medicine, 68, 285-294. https://doi.org/10.1097/00001888-199304000-00016
  24. Yoo, M. S., & Yoo, I. Y. (2003). Effect of OSCE method on performance of clinical skills of students in fundamentals of nursing course. Journal of Korean Academy of Nursing, 33, 228-235.