• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.12 no.1
• /
• pp.318-326
• /
• 2011

The purpose of this study is to investigate whether standardized patient(SP) can be used as a reliable examiner in Objective Structured Clinical Examination(OSCE). 4 SPs and 4 faculties who have more than 2 years experience of OSCE scoring were selected. For 1 assignment 2 members of faculty and 2 SPs were designated as raters. SPs were educated for assessing 2 technical skills, male Foley catheter insertion and wound dressing, for 8 hours (4 hours / day, each topic). The definition, method, cautions and complications for each of procedural skills were covered in the education. Theoretical lectures, video learning, faculty demonstration and practical training on mannequins were employed. The 8 raters were standardized for an hour with simulated OSCE scoring using previous videos on the day before the OSCE. Each assessment was composed of 14 checklists and 1 global rate. The allotted time for each assignment was 5minutes and for evaluation time 2 minutes per student. The evaluation from the faculty and SPs were compared and analyzed with the GENOVA program. The overall generalizability coefficient (G coefficient) was 0.839 from two cases of OASTS. The reliability of the raters was high, 0.946. The inter-rater agreement between faculty group and SP group was 0.949 for checklist and 0.908 for global rating. Therefore SPs can play a role of raters in OSCE for procedural skills, if they are given the appropriate training.

• Korean Medical Education Review
• /
• v.15 no.2
• /
• pp.87-92
• /
• 2013

The purpose of this study was to assess third-year medical students' competency for development or revision of the undergraduate curriculum and assessments. One hundred and twenty-seven third-year medical students at the Pusan National University were included in the study. After third- and fourth-year students took a common written examination, clinical performance examination (CPX), and objective structured clinical examination (OSCE) with common items as a summative assessment, the third-year students' competency was compared with 132 forth-year students' results. The correlation of the written examination and CPX/OSCE was analysed, and the summative results were compared with the grade point average (GPA) through the second year, CPX/ OSCE in the second year, and GPA in the clerkship. On the written examination, the third-year students' mean score was lower than the fourth-year students' by over 11 points, whereas the gap in the CPX/OSCE was 4 points and there was no difference in the OSCE. There was a moderate correlation between the written examination and the CPX/OSCE scores (R=0.371, p<0.01). The written examination was highly correlated with GPA through the second year, which mainly evaluated medical knowledge (R=0.771, p<0.01). A relatively high correlation was observed between CPX/OSCE scores and GPA in the clerkship (R=0.641, p<0.01). The summative CPX/ OSCE scores showed a moderate correlation with formative CPX/OSCE scores in the second year (R=0.464, p< 0.01). The third-year students' score was quite low on the written examination and slightly low on the CPX/OSCE compared to that of the fourth-year students. The written examination and CPX/OSCE cannot replace each other and should be combined with other methods of evaluation to measure competency. Early OSCE and workplacebased assessment should be useful in the early assessment of clinical skills competency.

• The Journal of Korean Obstetrics and Gynecology
• /
• v.35 no.2
• /
• pp.16-27
• /
• 2022

Objectives: The purpose of this study is to analyze educational effect of ultrasound examination training with ultrasonic phantom in the department of Korean Medicine Obstetrics and Gynecology. Methods: All 4^th grade students in 2021 and 2022 of school of Korean Medicine, Dong-Shin University must be trained in the department of Korean Medicine Obstetrics and Gynecology according to ultrasound examination training guideline including Objective Structured Clinical Examination (OSCE). After completing ultrasound examination training, we distributed questionnaires to them about a confidence before OSCE and after OSCE, difficulty in using ultrasound, ultrasound reading, difficulty with probe manipulation and computer operation, ultrasound understanding, clinical usefulness. And then, we analyzed the related factors including descriptive statistics, frequency analysis, student's t-test and paired t-test by SPSS 12.0. Results: Confidence in using ultrasound showed differences among students by gender and year, but it was not statistically significant. The difficulty of ultrasound use and ultrasound reading was at a moderate level, and the gender difference was not significant, and the difference between the practical students by year was statistically significant. The difficulty of the operation of the ultrasonic probe was at a normal level, and the difference between the students in practice by gender and year was not statistically significant. Although they answered that they had a very good understanding of the use of ultrasound, there was a gender difference and it was statistically significant, and practical students by year was not statistically significant. They answered that the effect on clinical use was very sufficient, but it was not statistically significant. The appropriateness of the practice time was evaluated at a moderate level. Conclusions: The use and educational effect of ultrasound examination using ultrasonic phantom in the department of Korean Medicine Obstetrics and Gynecology clinical practice education was very effective.

• The Journal of Korean Obstetrics and Gynecology
• /
• v.33 no.1
• /
• pp.116-127
• /
• 2020

Objectives: The purpose of this study is to analyze csatisfaction with clinica1 training in the department of Korean Medicine Obstetrics and Gynecology and the related factors. Methods: All the students on the graduating class of school of Korean Medicine, Dong-Shin University must be trained for 1 year in the department of Korean Medicine Obstetrics and Gynecology according to clinical training guideline including Objective Structured Clinical Examination (OSCE). After completing clinical training, we distributed questionaries to them about a reflex of the object of study, usefulness, difficulty, satisfaction and preference. And then, we analyzed the related factors including descriptive statistics, frequency analysis and correlation analysis by SPSS 12.0. Results: In general, a reflex of the aim of study (7.31±1.59), satisfaction with contents (7.44±1.58), and difficulty (6.13±1.34) were evaluated restectively. There is no statistically significant difference with sex. There is a statistically significant positive correlation between a reflex of the aim of study and satisfaction with contents. The primary preferences of clinical practice were Clinic Training, Ward Training, PBL (Problem Based Learning), OSCE. In OSCE, a reflex of the aim of study (7.04±1.83) and usefulness (7.02±1.97) were highly evaluated. There is no statistically significant difference with sex. The primary preferences for clinical OSCE practice were breast examination, genital examination, ultrasound scan, and pap smear. Facilities and equipment (6.84±2.01), contents of clinical training (7.29±1.83), the handout (7.20±1.98) and time scheduling (7.29±1.90) were evaluated respectively in general composition of clinical training. Conclusions: Clinical training program in the department of Korean Medicine Obstetrics and Gynecology can be highly estimated from the viewpoint of satisfaction with clinical training and the related factors.

• Journal of Korean Academy of Fundamentals of Nursing
• /
• v.15 no.1
• /
• pp.14-21
• /
• 2008

Purpose: Objective Structured Clinical Examination(OSCE) has been used for clinical skill evaluation. This study was done investigate whether there are positive impact educational effects if nursing students are invited to develop OSCE modules. Method: The participants were 63 second-year students in one nursing college. Students were divided into 3 groups; the OSCE module development group(Exp1), traditional study group(Exp2), and control group(Cnt). Students were allocated according to clinical skill test scores to make the 3 groups equal. Exp1 developed OSCE modules, and Exp2 studied using traditional methods. Clinical skill tests and surveys were done to measure self-directed readiness, problem-solving ability, and self-efficacy before and after experimental treatments. Results: Clinical skill test scores increased significantly in all three groups, but Exp1 and Exp2 showed a higher clinical skill test score increment than Cnt. Self-directed readiness scores increased significantly in Exp1, but not in Exp2 and Cnt. Problem-solving ability scores increased significantly in Exp1 compared to Cont. Conclusion: Development of OSCE modules has positive educational effects for participating students in terms of clinical skill tests, self-directed readiness, and problem-solving ability.

• Journal of the korean academy of Pediatric Dentistry
• /
• v.40 no.4
• /
• pp.253-259
• /
• 2013

This study aimed to evaluate the courses of pediatric dentistry based on correlation analysis between scores of objective structured clinical examination (OSCE) and related subjects for 79 fourth-year students. The score of theory were related to preclinical (r = 0.449, p = 0.000) and clerkship (r = 0.437, p = 0.000) each, but the scores of clerkship were not related to OSCE. To make the students skillful for clerkship, more professor's firsthand teaching on treating patients and adequate numbers of clinical professors are required. Patients who come to the university dental hospital prefer to be treated by professors rather than students. In these circumstances, educational conditions should be arranged by ensuring the number of professors for teaching students to improve their clinical competence through direct instruction and feedback to students. In addition, pragmatic improvement plans, which allow continuous education and evaluation about basic techniques to be examined in the clinical practice course, should be compromised with the more concrete evaluation of the curriculum in order to evaluate theoretical knowledge and technical trainings to be well exercised and deepened in the practical clinical field.

• The Journal of Korean Medicine
• /
• v.34 no.3
• /
• pp.37-53
• /
• 2013

Objectives: This study aimed to evaluate the 1st class and 2nd class's satisfaction with clinical skills training in the Korean medical curriculum. A questionnaire was given to clinical clerkship students of Pusan National University School of Korean Medicine. Methods: These items covered overall satisfaction with training, learning support environment, curriculum interconnection, training and guidance, and self-assessment. Results: Most 1st class and 2nd class respondents were satisfied with their learning support environment. However, satisfaction with curriculum interconnection was lower. Conclusions: The results of this study demonstrate that students have a high level of satisfaction with clinical skills training. It might be concluded that clinical skills training has been effectively implemented into the Korean medical education.

• Korean Journal of Clinical Pharmacy
• /
• v.27 no.3
• /
• pp.119-126
• /
• 2017

Background: As the demands of pharmacist's role and quality performance have increased, the verification of pharmacist's ability has been required. In this study, we aimed to select appropriate items for assessment of pharmacist's knowledge, attitude and performance. Methods: Based on the pharmacist job analysis, we selected duties and tasks in consideration of applying pharmacy practical examination through brainstorming of internal researchers and group discussion with experts. Survey was conducted to evaluate the tasks according to the criteria detailed below: Realistic, Understandable, Measurable, Behavioral and Achievable (RUMBA). The subjects included professors at colleges of pharmacy and instructors of institutional or community pharmacy settings. Results: Nine duties including 41 tasks were drawn for the survey through primary internal researchers. Of the 90 respondents, 95.6% were professors or preceptors who was engaged in practical training, and 62.2% had more than five years of practical experience. As a result of survey and discussion with expert panel, selected seven duties were selected as followings: 'Patient (customer) reception', 'Drug preparation and distribution', 'Patient care', 'Administration', 'Patient counseling', 'Non-prescription medication counseling', and 'Provision of drug information'. The final 20 tasks from seven duties were chosen to assess skills that a pharmacist should be able to perform. Conclusion: This is the first study to select the items that can be included in pharmacist practical examination in the future, based on the RUMBA criteria. As a next step, it is necessary to study how to implement these items.

• Journal of Korean Academy of Fundamentals of Nursing
• /
• v.18 no.2
• /
• pp.210-216
• /
• 2011

Purpose: The self-assessment ability of students is important in acquiring clinical skills. The study explored the self-assessment behavior of nursing students after OSCE (Objective Structured Clinical Examination). Methods: The participants were 90 nursing students. They assessed their performance just after an OSCE (assessment 1). They were given OSCE checklists and re-assessed their performance level (assessment 2). Assessments 1, 2, and an assessment by professor were compared and analyzed. Results: Students assessed themselves higher than professor. But, when students were divided into three groups according to score level, different behaviors were evident between the groups. The high-score group assessed themselves lower than the professor, while the mid-and low-score groups assessed themselves higher than the professor. Students' self-assessment more closely approximated the professor's assessment when they were given checklists. The correlation between assessments 1 and 2 was stronger in high-score group and weak in low-score group. Conclusion: The study results indicate that students tend to assess their skills higher than the professor, but their scores were more in line with the professor when they were provided with checklists, and students' self-assessment behavior differed in the different score groups, suggesting a need for customized feedback and a concern for students with low scores.

• Archives of Plastic Surgery
• /
• v.43 no.5
• /
• pp.451-456
• /
• 2016

Background Comprehensive aesthetic surgery training continues to be a challenge for residency programs. Our residency program developed a rhinoplasty-based objective structured clinical examination (OSCE) based upon validated methods as part of the residency education curriculum. We report our experience with the rhinoplasty-based OSCE and offer guidance to its incorporation within residency programs. Methods The encounter involved resident evaluation and operative planning for a standardized patient desiring a rhinoplasty procedure. Validated OSCE methods currently used at our medical school were implemented. Residents were evaluated on appropriate history taking, physical examination, and explanation to the patient of treatment options. Examination results were evaluated using analysis of variance (statistical significance P<0.05). Results Twelve residents completed the rhinoplasty OSCE. Medical knowledge assessment showed increasing performance with clinical year, 50% versus 84% for postgraduate year 3 and 6, respectively (P<0.005). Systems-based practice scores showed that all residents incorrectly submitted forms for billing and operative scheduling. All residents confirmed that the OSCE realistically represents an actual patient encounter. All faculty confirmed the utility of evaluating resident performance during the OSCE as a useful assessment tool for determining the Next Accreditation System Milestone level. Conclusions Aesthetic surgery training for residents will require innovative methods for education. Our examination showed a program-educational weakness in billing/coding, an area that will be improved upon by topic-specific lectures. A thoroughly developed OSCE can provide a realistic educational opportunity to improve residents' performance on the nonoperative aspects of rhinoplasty and should be considered as an adjunct to resident education.