• Korean Medical Education Review
• /
• v.23 no.1
• /
• pp.56-67
• /
• 2021

Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.

• Journal of Digital Convergence
• /
• v.19 no.12
• /
• pp.51-62
• /
• 2021

This study developed the factors capable of systematic/comprehensive evaluation of the task performance in order to strengthen the performance management of the professional career personnel invitation program (PCPIP). To this end, a performance evaluation framework was developed by analyzing existing project evaluation studies based on boundary theory and Kirkpatrick's four-level evaluation model. Afterwords, through two Delphi surveys, evaluation factors that can measure performance in terms of individual and invitation institutions of PCP were derived and validated. With this procedure, five evaluation factors were finally selected: adaptability, connectivity, clarity, compatibility, and expandability. This study has implications suggesting a performance evaluation factors capable of hybrid quantitative/qualitative evaluation for the performance management of PCPIP operated by National Research Foundation of Korea Research since 1994.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.10
• /
• pp.185-192
• /
• 2012

Call Center requires an ability of agents a lot more than face-to-face contact due to being achieved communication by non face-to face channel for contact with customers. In order to improve the ability of agents, Call Center carries out various educational training according to their work experience and function and with the accomplishment of educational training, Call Center is going to fulfill to develop its quality of counseling and productivity. On the other hand, due to investment of a lot of time and budget to educational training, it is needed to grasp and manage about its effectiveness that how helpful the training is for performance of work-site operations through evaluation of educational training. Having Seen researches about evaluation of educational training until these days, most researches have mainstream to measure satisfaction and a level of learning or degree that how the learning transfers to actions. It is found that a research about an entire evaluation model should be required. This study aims to investigate effectiveness of Call Center educational training from the level of recognition by reflecting Kirkpatrick's the four levels of learning evaluation. By the four levels, reaction, learning, behavior and results, the study found out a connection with standards of evaluation about each levels. In addition, by using structural equation modeling, it was examined goodness of fit about the entire model. Furthermore, by an alternative model, considering a direct relation between a factor of reaction and behavior, it was compared and examined goodness of fit of overall model of the study model and the alternative one.

• Journal of Practical Engineering Education
• /
• v.12 no.1
• /
• pp.101-108
• /
• 2020

KOREATECH has operated a Co-op program called 'Industry Professional Practice (IPP)' that allows students to work full-time in relevant industries for at least four months since 2012, and also developed a systematic performance evaluation model on the basis of Kirkpatrick's four-stage assessment model. This study aims to share KOREATECH's Levels 3 and 4 evaluation results which are clearly what practitioners and academic investigators of cooperative education want to know the most. For this purpose, a questionnaire survey was conducted for KOREATECH graduates and their superiors to examine influence of IPP experiences on employment and job performance. A total of 730 alumni who graduated within last 5 years participated in the survey, with 213 (29.2%) having IPP experiences, and 162 superiors rated their subordinates on seven performance criteria. The analysis results were mixed. On the one hand, employment rate of IPP participants was 89.7%, compared to 86.8% of alumni without field experiences. Participants of the IPP program were more satisfied with their salary and felt less unfair about their career and promotion opportunities than alumni without field experiences. On the other, superiors rated their subordinates without IPP experiences slightly more positively than IPP participants in terms of job performance. These contrasting results are judged to show strengths and weaknesses of the IPP program at the same time. The limitations of the study and future research directions are discussed at the last part.