Journal of Korean Academy of Nursing (대한간호학회지)

Korean Society of Nursing Science (한국간호과학회)
권호 표지

Validity and Reliability of a Clinical Performance Examination using Standardized Patients

호흡기계 표준화 환자를 이용한 간호대 학생의 임상수행능력평가 타당도와 신뢰도 검증

  • Published : 2008.02.29
Download PDF
⟨ Previous Next ⟩

Abstract

Purpose: The purpose of this study was to test the validity of a modified clinical performance examination (CPX) for preclinical students in nursing. Method: 70 nursing students in their second semester of the junior year at C University participated in CPX. Scenarios and checklists were developed by our research team from September to October 2005. Six stations were organized. Evaluation included physical examination of a patient with lung cancer, education on usage of a metered dosage inhaler, and lobectomy postoperative care. Students were randomly assigned to a station. Result: There was a difference in the CPX scores according to stations. The agreement of scoring between trained faculty members and SPs was more than moderate (r=.647). The correlation between the CPX score and the average grade in the previous semester and between the CPX score and the average grade of a paper and pen test of the pulmonary system of adults was low (r=.276; r=.048). Conclusion: Traditional CPX is generally recommended, however, modified CPX is appropriate for preclinical students in the current Korean Nursing school setting if there are additional scoring systems to balance the testing level at each station.

Keywords

References

  1. Amona, H., Sano, T., Gotoh, K., Kakuta, S., Suganuma, T., Kimura, Y., et al. (2004). Strategies for training standardized patient instructors for a competency exam. J Dent Educ, 68, 1104-1111
  2. Bickley, L. (1999). Bate's guide to physical examination & history taking (7th ed.). Philadelphia: Lippincott
  3. Burch, V. C., Nash, R. C., Zabow, T., Gibbs, T., Aubin, L., Jacobs, B., et al. (2005). A structured assessment of newly qualified medical graduates. Med Educ, 39, 723-731 https://doi.org/10.1111/j.1365-2929.2005.02192.x
  4. De Champlain, A. F., Margolis, M. J., King, A., & Klass, D. J. (1997). Standardized patients'accuracy in recording examinees'behaviors using checklists. Acad Med, 72(10 Suppl 1), S85-S87 https://doi.org/10.1097/00001888-199710001-00029
  5. Jung, K. H., Choi, E. H., Bae, J. D., Na, D. Y., Son, I. K., Ko, C. W., et al. (2005). Comparison of professional standardized and amateur standardized patients in OSCE. Korean J Med Educ, 17(1), 97-105 https://doi.org/10.3946/kjme.2005.17.1.97
  6. Kim, B. S., Lee, Y. M., Ahn, D. S., & Park, J. Y. (2001). Evaluation of introduction to clinical medicine by objective structured clinical examination. Korean J Med Educ, 13, 289-298
  7. Klein, S. P., & Stecher, B. M. (1998). Analytic versus holistic scoring of science performance tasks. App Meas Educ, 11, 121-137 https://doi.org/10.1207/s15324818ame1102_1
  8. Lee, Y. M., Hwang, K., Baik, S. H., Hong, M. H., Choi, Y. S., & Kim, S. H. (2001). An experience of OSCE for introducing clinical performance assessment to Korean medical licensure examination. Korean J Med Educ, 13(1), 47-57
  9. Lee, M. S., & Kim, S. (1999). Clinical performance evaluation in nursing. Korean J Nurs Query, 8(1), 39-59
  10. Miller, G. E. (1990). The assessment of clinical skills/competence/ performance. Acad Med, 65(9 Suppl), S63-S67 https://doi.org/10.1097/00001888-199002000-00001
  11. Mukohara, K., Kitamura, K., Wakabayashi, H., Abe, K., Sato, J., & Ban, N. (2005). Evaluation of a communication skills seminar for students in a Japanese medical school: a non-randomized controlled study. BMC Med Educ, 4, 24-29
  12. Nam, M. H. (1995). A validity study of performance assessment: a comparison between science hands-on assessment, experimental report assessment, computer simulation assessment. J Educ Eval, 8, 115-143
  13. Oh, H., Jun, S., Kim, E., Hur, M., Song, Y., Yi, G., et al. (2006). Application of OSCE in clinical nursing education: development and testing validity of checklist. Annu Bull Bum-Suk Acad Scholarsh Found, 10, 237-249
  14. Park, H., Kim, D., Kim, D. A., Choi, H., & Kim, K. (1998). An OSCE assessment of fourth-year students as a comprehensive evaluation of medical skills before graduation. Korean J Med Educ, 6(1), 23-35
  15. Park, H., Lee, J., Hwang, H., Lee J., Choi, Y., Kim, H., et al. (2003). The agreement of checklist recordings between faculties and standardized patients in an objective structured clinical examination (OSCE). Korean J Med Educ, 15, 141-150 https://doi.org/10.3946/kjme.2003.15.2.141
  16. Park, H., Han, J., Park, M., & Oh, J. (2004). Comparison of results from objective structured clinical examinations for medical students performed before and after clinical clerkship. Korean J Med Educ, 16(1), 63-71 https://doi.org/10.3946/kjme.2004.16.1.63
  17. Reznick, R. K., Sydney, S., Baumber, J., Cohen, R., Rothman, A., Blackmore, D., et al. (1993). Guideline for estimating the real cost of an objective structured clinical examination. Acad Med, 68, 513-517 https://doi.org/10.1097/00001888-199307000-00001
  18. Roberts, J., & Brown, B. (1990). Testing the OSCE: a reliable measurement of clinical nurisng skills. Can J Nurs Res, 22(1), 51-59
  19. Stillman, P. L., Regan, M. B., Swanson, D. B., Case, S., McCahan, J., Feinblatt, J., et al. (1990). An assessment of clinical skills of fourth year students at four new england medical schools. Acad Med, 65, 320-326 https://doi.org/10.1097/00001888-199005000-00013
  20. Suh, B. Y., Lee, D. J., Kwun, K. B., & Kang, P. S. (1998). Trial on objective structured clinical examination. Korean J Med Educ, 10, 363-381
  21. Tamblyn, R. M., Klass, D. K., Schanbl, G. K., Kopelow, M. L. (1990). Factors associated with the acuracy of standardized patient presentation. Acad Med, 65(9 Suppl), S55-S56 https://doi.org/10.1097/00001888-199009000-00042
  22. Vu, N. V., Barrows, H. S., March, M. L., Verhulst, S. J., Colliver, J. A., & Travis, T. (1992). Six years of comprehensive, clinical, performance-based assessment using standardized patients at the Southern Illinois University School of Medicine. Acad Med, 67(1), 42-50 https://doi.org/10.1097/00001888-199201000-00009
  23. Yoo, M. (2001). The effectiveness of standardized patient managed instruction for a fundamental nursing course. J Korean Acad Soc Nurs Educ, 7(1), 94-109
  24. Yoo, M. S., & Yoo, I. Y. (2003). Effects of OSCE method on performance of clinical skills of students in fundamentals of nursing course. J Korean Acad Nurs, 33, 228-235 https://doi.org/10.4040/jkan.2003.33.2.228