• 의학교육논단
• /
• 제23권1호
• /
• pp.56-67
• /
• 2021

Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.

• 기술혁신연구
• /
• 제31권3호
• /
• pp.171-199
• /
• 2023

본 연구는 K연구원의 상향식 R&D과제기획 차원의 신규 연구기획과제 선정평가를 위한 평가도구 개발에 목적을 두고 진행하였다. 이를 위해 CIPP모형과 연구기획평가를 위한 선정평가 및 평가지표에 관한 선행연구를 중심으로 R&D과제기획 선정평가 항목과 문항을 개발 한 후, 2회에 걸친 델파이 조사를 실시하였다. 개발된 평가도구는 13명의 전문가를 대상으로 설문조사를 실시하여 내용타당도, 합의도 및 수렴도를 검증하였다. 최종 선정된 R&D과제기획 선정평가 도구는 8개 항목에 총 21개 문항으로, 상황평가 5 문항, 투입평가 2문항, 과정평가 8문항, 산출평가 6문항으로 구성되었다. 개발된 평가 도구는 상향식 기획 과정상의 문제점을 해소하고 연구자들의 기획역량을 제고하는 데 기여할 것이다. 또한, 선정평가 시 평가에 대한 일관성과 효율성 제고에 기여할 것이다.

• 한국항공운항학회지
• /
• 제24권3호
• /
• pp.69-79
• /
• 2016

This study examines the awareness of the curriculum of the cabin service major students at 2 year colleges through the CIPP (Context, Input, Process, Product) evaluation model and an empirical analysis on how their awareness affects Service Orientation and Service Hospitality. It was proven that the CIPP evaluation model has a positive effect on the satisfaction of their department, and also has a meaningful effect on Service Hospitality and Service Orientation statistically. However, the satisfaction of their department itself is not associated with the increase of Service Orientation and Service Hospitality so it negatively affected them. Moreover, both the Service Management program(Process) and Service Attitude(Product) have a meaningful effect on Service Hospitality, and Service Hospitality also has a meaningful effect on Service Orientation. So it resulted in a casual relationship among them. As a result, it is desperately necessary to promote an educational environment that will increase the satisfaction of the department and help students to become flight attendants. It is also necessary to increase awareness of the Service Management program(Process) and Service Attitude(Product).

• 수산해양교육연구
• /
• 제25권2호
• /
• pp.538-551
• /
• 2013

The purpose of this study is to evaluate policy formation stage of Meister high schools. The study analyzed the differences in the recognition of teachers, students, parents, and vocational education specialists about policy evaluation for policy formation stage of Meister high schools. The conclusions based on the results of the study are as follows: First, in context area the recognition of students showed relatively low level. It reflects that the principle of democracy is needed to the policy formation stage of Meister high schools. The participation of stake holders in the policy formation stage is essential. Second, in input area teachers recognized that the financial resources were sufficient. Vocational education specialists recognized that human resources, such as excellent teachers and Meister teachers, needed to recruited adequately. Third, many policies and institutions need to be established for Meister high schools. The Meister high schools should be selected based on the principle of equity. In the selection process vocational education specialists should be included for the principle of professionalism.

• 영어어문교육
• /
• 제12권4호
• /
• pp.253-276
• /
• 2006

The purpose of this study is to compare and analyze the aspects of task-based materials in high school English textbooks for first year students in Korea. Based on the theoretical backgrounds for designing communicative tasks and the basic contents of the 7th national curriculum for English, a total of six different qualitative evaluation categories of task-based materials are constructed. The six categories include input data, settings, activity types, language skills, activity themes, and communicative functions. The results of the data analysis showed that the regulations of the 7th national English curriculum, which were aimed at improving the students' communicative abilities, were properly reflected in the materials of task-based activities of all textbooks. On the other hand, a few problems were found in some textbooks: too many individual tasks; being out of proportion in presenting task types and themes; non-systematic introduction of language skills, etc. To conclude, a few suggestions are made to provide some meaningful considerations for the text material developers in order to produce better textbooks in the future: task goals and rationale that encourage the learner's positive motivation; authenticity of input data based on the real-world context; a collaborative learning environment that enhances communicative interaction; a proportional representation of the various activity types including creative problem-solving procedures; systematic introduction of integrated language skills, etc.

• 비교교육연구
• /
• 제28권3호
• /
• pp.103-133
• /
• 2018

지능정보사회로 대변되는 4차 산업혁명은 전 세계 각국의 교육체제와 교육과정 운영 전반에 걸친 대변화를 요구하고 있으며, 무엇보다도 우수인재 양성과 이들의 창의역량 함양을 교육혁신의 최우선 의제로서 적극적으로 강조하고 있다. 이러한 교육환경 변화와 시대적 상황에 적극적으로 대응하기 위하여 카자흐스탄은 국가 수준 차원의 다양한 교육개혁 방안을 제도적으로 구안하여 실행하고 있다. 국가발전과 경제성장을 견인할 수 있는 영재학교 운영이 대표적인 교육정책 사례에 해당한다. 카자흐스탄 정부는 2013년 4월에 수도 아스타나에 영재학교를 설립하여 '국제표준 고교교육과정(International Baccalaureate Diploma Programme, 이하 IBDP)'을 공식적으로 도입하였다. 본 연구는 해외 선행연구결과와 정책보고서 등을 참조하여 카자흐스탄 영재학교의 현행 국제표준 고교교육과정(IBDP)의 도입과 실행 및 교육효과에 대한 체계적인 종합 분석을 통해 향후 일반계 고교에 IBDP의 운영가능성과 잠재적 한계점을 예비적으로 탐색해보는 데 초점이 있다. 연구목적을 달성하기 위해 준거중심평가체계(CIPP evaluation model: context/input/process/product) 분석을 실행하였으며, 실제 교육에 참여한 교사, 강사, 학생 대상의 설문조사와 면담조사를 실시하였다. 분석 결과, IBDP 교육 참여자의 전반적인 교육효과는 평균 3.64점으로 나타났으나 높은 수준의 교과내용을 제대로 이수할 수 있도록 학교생활 일과 편성 관리의 체계성 함양, 다양한 교과목 개설, IBDP 전문 교사 확대 충원 등이 선행되어야 하는 것으로 나타났다.

• 인터넷정보학회논문지
• /
• 제16권6호
• /
• pp.79-88
• /
• 2015

The web search engines are exposed to the issue of uncertainty because of ambiguous queries, being input for retrieving the accurate results. Ambiguous queries constitute a significant fraction of such instances and pose real challenges to web search engines. Moreover, web search has created an interest for the researchers to deal with search by considering context in terms of location perspective. Our proposed disambiguation approach is designed to improve user experience by using context in terms of location relevance with the document relevance. The aim is that providing the user a comprehensive location perspective of a topic is informative than retrieving a result that only contains temporal or context information. The capacity to use this information in a location manner can be, from a user perspective, potentially useful for several tasks, including user query understanding or clustering based on location. In order to carry out the approach, we developed a Java based prototype to derive the contextual information from the web results based on the queries from the well-known datasets. Among those results, queries are further classified in order to perform search in a broad way. After the result provision to users and the selection made by them, feedback is recorded implicitly to improve the web search based on contextual information. The experiment results demonstrate the outstanding performance of our approach in terms of precision 75%, accuracy 73%; recall 81% and f-measure 78% when compared with generic temporal evaluation approach and furthermore achieved precision 86%, accuracy 71%; recall 67% and f-measure 75% when compared with web document clustering approach.

• Nuclear Engineering and Technology
• /
• 제45권2호
• /
• pp.151-164
• /
• 2013

A key input for the assessment of Human Error Probabilities (HEPs) with Human Reliability Analysis (HRA) methods is the evaluation of the factors influencing the human performance (often referred to as Performance Shaping Factors, PSFs). In general, the definition of these factors and the supporting guidance are such that their evaluation involves significant subjectivity. This affects the repeatability of HRA results as well as the collection of HRA data for model construction and verification. In this context, the present paper considers the TAsk COMplexity (TACOM) measure, developed by one of the authors to quantify the complexity of procedure-guided tasks (by the operating crew of nuclear power plants in emergency situations), and evaluates its use to represent (objectively and quantitatively) task complexity issues relevant to HRA methods. In particular, TACOM scores are calculated for five Human Failure Events (HFEs) for which empirical evidence on the HEPs (albeit with large uncertainty) and influencing factors are available - from the International HRA Empirical Study. The empirical evaluation has shown promising results. The TACOM score increases as the empirical HEP of the selected HFEs increases. Except for one case, TACOM scores are well distinguished if related to different difficulty categories (e.g., "easy" vs. "somewhat difficult"), while values corresponding to tasks within the same category are very close. Despite some important limitations related to the small number of HFEs investigated and the large uncertainty in their HEPs, this paper presents one of few attempts to empirically study the effect of a performance shaping factor on the human error probability. This type of study is important to enhance the empirical basis of HRA methods, to make sure that 1) the definitions of the PSFs cover the influences important for HRA (i.e., influencing the error probability), and 2) the quantitative relationships among PSFs and error probability are adequately represented.

• 디지털융복합연구
• /
• 제17권2호
• /
• pp.9-18
• /
• 2019

본 연구에서는 현재 시행 중인 사이버 범죄 예방 교육의 효과성을 확인하기 위해 예방 교육 수강자의 교육 만족도와 학습 전이에 영향을 미치는 요인이 무엇인지 알아보고자 한다. 교육 평가에서 활용되는 CIPP 모형을 바탕으로 상황 평가의 사회 요구 수준과 지식수준, 투입 평가의 주제의 최신성, 과정 평가의 상호작용이 수강자의 교육 만족도와 산출 평가의 학습전이에 영향을 미치는지 확인하기 위해 예방 교육 수강자를 대상으로 설문조사를 실시하였다. 연구 분석 결과, 상황 평가의 지식수준과 투입 평가의 주제의 최신성, 과정 평가의 상호작용이 교육 만족도와 유의미한 관계를 가진다는 것이 확인되었고, 상황 평가의 주제의 최신성과 투입 평가의 상호작용, 교육 만족도가 산출 평가의 학습 전이와 유의미한 관계를 가진다는 것이 확인되었다. 본 연구 결과를 바탕으로 향후 사이버 범죄 예방 교육 프로그램의 운영 계획 수립 시 수강자의 학습 전이를 높일 수 있는 개선 방향이 제시되었다.

• 의학교육논단
• /
• 제25권2호
• /
• pp.174-183
• /
• 2023

Educational evaluation involves data collection and the analysis of various education-related factors to make decisions that improve educational quality. Systematic educational evaluation is essential for enhancing the quality of education. This study reports a case of student-conducted process evaluation of a medical school's student support system and the procedure for devising improvement plans. Sixteen Inje University College of Medicine students participated in the Education Evaluation Committee (IUCM-EEC) to understand the educational improvement process as learners and actively achieve improvement. The Quality Improvement Committee of the Inje University College of Medicine (IUCM-QIC) decided to reform its student support system based on a previous educational evaluation in 2019. The evaluation of the student support system was conducted for 10 months in 2021 by the student subcommittee, under the guidance of the IUCM-EEC. The CIPP (context-input-process-product) evaluation model was used for a systematic evaluation. Accordingly, the subcommittee developed evaluation criteria and indicators, and analyzed relevant data collected from surveys and the previous literature. For further recommendations and revision ideas, the student subcommittee members interviewed faculty members from six other medical schools and also conducted a focus group interview with the dean and vice deans of IUCM. Finally, the student subcommittee submitted a report to the IUCM-QIC. Communication with various stakeholders is essential for a successful evaluation process. In this case, students, as key stakeholders in education, evaluated the student support system. Their active participation helped improve their understanding of the evaluation process.