• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.17 no.5
• /
• pp.1233-1238
• /
• 2013

The course evaluation is used in faculty evaluation model even the grade of course evaluation has a big gap in absolute value with the characteristics of subjects. It is important to obtain the reliability of course evaluation because the result of course evaluation is fed to instructor to assure the quality of instruction. The purpose of this paper are to analyze the relation of attendance rate and course evaluation to improve the reliability of course evaluation.

• Journal of Soil and Groundwater Environment
• /
• v.20 no.7
• /
• pp.13-22
• /
• 2015

In this study, we have developed the performance evaluation model for the optimal soil remediation technology selection. Performance evaluation model is composed in the evaluation of two steps. In the first stage, the candidate technologies are derived according to the conditions of drilling, type and concentration of pollutants, and the saturated/unsaturated of target site. In the second stage, each individual candidate technology is evaluated by performance evaluation model. The performance evaluation model has 5 groups of evaluation items and 12 evaluation items which have their own evaluation index and their own weights through the AHP approach surveying 40 experts. From the case study of actual design cases, the applicability of the performance evaluation model was confirmed.

• Journal of Korea Game Society
• /
• v.9 no.1
• /
• pp.63-74
• /
• 2009

This paper mainly focused on research developing online game characteristic evaluation system based on game characteristic evaluation model design. Online game characteristic evaluation system is a system that evaluates game online in real-time using evaluation elements defined by model design. Game characteristic evaluation system uses heuristic evaluation method, which is used to execute evaluation in four parts, technical element, manage element, social element, and competitive element. To verify objectivity and validity of game characteristic evaluation, assessment was performed by three groups of beginners, intermediates, and professionals to increase the trust. And game characteristic evaluation forum was hosted to collect opinion from diverse classes.

• Journal of the Korean Society for Aviation and Aeronautics
• /
• v.22 no.4
• /
• pp.8-14
• /
• 2014

The purpose of this research was to develop evaluation conformity to operate courses based on CIPP evaluation model dedicated to approval of training organizations. In order to achieve the goal, the researchers scrutinized related documents and precedent studies, initiated the draft for evaluation conformity to operate courses and secured validity for evaluation conformity initiated through Delphi Method survey. To secure validity for evaluation conformity, the researchers conducted two Delphi Method surveys of an expert panel of 22 professionals from relevant fields including officials from the Ministry of Land, Infrastructure and Transport, researchers from Korea Transportation Safety Authority, instructors from approved training organizations and officials from industries. Through the surveys, the researchers determined 4 evaluation areas, 13 evaluation items and 52 evaluation indexes as the evaluation conformity to operate courses for aircraft maintenance mechanics. On top of that, the researchers established evaluation system in the courses for aviation professionals (aircraft maintenance mechanics), and suggested a follow-up studies regarding managing the quality of education.

• Journal of Korean Society for Quality Management
• /
• v.50 no.4
• /
• pp.665-677
• /
• 2022

Purpose: The purpose of this study is to analyze the current status and investigate relevant indicators so that R&D performance evaluation suitable for government-funded research institutes can proceed. A suitable performance evaluation model was presented based on the surveyed indicators. Based on the presented performance evaluation model, the importance was analyzed to calculate the weight for each indicator of the performance evaluation model. Methods: The method applied in this study presented a performance evaluation model based on the organizational performance evaluation cases of advanced overseas countries. By using the AHP(Analytic Hierarchy Process) technique, the weight of each indicator of the performance evaluation model was studied. Results: As a result of examining the indicators necessary for the evaluation model, focusing on overseas cases, 13 evaluation items were derived. A weight was calculated for the importance of the study results. And the scientific/technical research results showed the highest excellence. Conclusion: Key indicators of performance evaluation suitable for government-funded research institutes were derived and presented through detailed modeling in three stages. A realistic model that can objectively evaluate the performance of government-funded research institutes was proposed using the AHP technique.

• International Journal of Knowledge Content Development & Technology
• /
• v.14 no.2
• /
• pp.99-139
• /
• 2024

In this study, the library ESG evaluation indicators specialized for libraries were developed, and based on which, a survey was conducted targeting the actual libraries to evaluate the ESG level of libraries. As a result of the study, first, among the ESG evaluation indicators, the indicators of the social field and the governance field are demonstrating high in which field of the library's ESG evaluation indicators will appear the highest. The social area's high score of 3.70 seems to be because the protection of users' rights, occupational safety, and contribution to society and the local community are very closely related to the original role of the library. Second, it may be seen that there is a difference between the questions in the corporate governance part, while the averages are the same. In the case of library's cooperation, it turned out that it was 3.94 in the necessity evaluation of the evaluation indicators, but it was lowered to 3.61 in the actual library situation evaluation. Meanwhile, in connection with the activities of the director of library and the board of directors, it may be seen that the index evaluation increased from 3.32 to 3.58 in the actual evaluation.

• Korean Medical Education Review
• /
• v.22 no.2
• /
• pp.131-142
• /
• 2020

A systematic educational program evaluation system for continuous quality improvement in undergraduate medical education is essential. Monitoring and evaluation (M&E) are two distinct but complementary processes referred to in an evaluation system that emphasizes formative purpose. Monitoring involves regular data collection for tracking process and results, while evaluation requires periodic judgment for improvement. We have recently completed implementing an educational evaluation using the M&E concept in a medical school. The evaluation system consists of two loops, one at the lesson/course level and the other at the phase/graduation level. We conducted evaluation activities in four stages: planning, monitoring, evaluation, and improvement. In the planning phase, we clarified the purpose of evaluation, formulated a plan to engage stakeholders, determined evaluation criteria and indicators, and developed an evaluation plan. Next, during the monitoring phase, we developed evaluation instruments and methods and then collected data. In the evaluation phase, we analyzed results and evaluated the criteria of the two loops. Finally, we reviewed the evaluation results with stakeholders to make improvements. We have recognized several problems including excessive burden, lack of expertise, insufficient consideration of stakeholders' evaluation questions, and inefficient data collection. We need to share the value of evaluation and build a system gradually.

• Knowledge Management Research
• /
• v.10 no.2
• /
• pp.65-84
• /
• 2009

The purpose of this study is to develop Meta Evaluation Indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process and evaluation outcome. And fifty two indicators for this meta evaluation were developed by experts who performed evaluations for Defense R&D Programs. The reliability of components and items was verified by Cronbach's ${\alpha}$ coefficient. It was over 0.6 in all areas. The validity of components and items was verified by Factor Analysis. Analytic Hierarchy Process method was used in assigning the evaluation weight. The survey of twenty two evaluators participated in Defense R&D Programs showed that the Consistency Ratio was under 0.1 in evaluation components and items. In this study, an objective and reasonable set of Defense R&D Meta Evaluation Indicators was developed to increase the responsibility of Defense R&D Programs and improve the quality of evaluation results.

• Journal of Yeungnam Medical Science
• /
• v.40 no.3
• /
• pp.233-240
• /
• 2023

The purpose of this study aims to analyze research trends related to 'evaluation' in Korean medical education through a systematic review. This study used a systematic review method, which is a research methodology for research trends and 'literature analysis.' Researchers searched the Korean journal literature published until the end of December 2020 in the Korean research database with keywords related to medicine and evaluation. Thus, 5,205 cases were identified. Based on these data, 143 papers were selected through a logical screening process, requiring 1 month to complete the data search and analysis process. In terms of publications, medical journals overwhelmingly outnumbered nonmedical journals until 2015; however, after 2016, the number of papers published in nonmedical journals increased, and the number of published papers was similar to that of medical journals. In terms of evaluation-related research, research on student and program evaluations has been very active compared to that on accreditation. As the number of evaluation studies has gradually decreased over the past 10 years, preparing a plan to revitalize them in Korean medical education is necessary. Considering that the role of evaluation in education has been emphasized in recent years, research on reestablishing the concept of evaluation; developing evaluation indicators; analyzing the status of student evaluation, program evaluation, and accreditation; and deriving measures to improve medical education through evaluation is required.

• Korean Journal of Childcare and Education
• /
• v.20 no.1
• /
• pp.91-111
• /
• 2024

Objective: The purpose of this study is to explore trends in institutional evaluation research in early childhood education through keyword network analysis. This aims to understand trends in academic discourse on institutional evaluation and gain implications for follow-up research and related policy directions. Methods: A total of 6,629 keywords were extracted from 572 dissertations and journal articles published from January 2006 to October 2023 for the purpose of analyzing and visualizing the frequency and centrality of keywords, as well as the structural properties of keyword networks. The analysis and visualization were conducted using the TEXTOM, UCINET6, and NetDraw programs. Results: First, the number of institutional evaluation studies increased steadily from 2006 to 2010 and then decreased, with a higher frequency of studies on daycare centers compared to kindergartens. Second, the most frequently occurring keyword in the analysis was 'daycare center,' and the highest connection strength was found in the term 'daycare-center-evaluation.' Third, network analysis revealed that key terms for institutional evaluation research included 'evaluation certification,' 'recognition,' 'evaluation indicators,' 'teacher,' 'daycare center,' and 'kindergarten.' In the ego network analysis for each institution, 'parent' emerged as a highly ranked keyword. Conclusion/Implications: This study confirmed the perspectives of previous studies by revealing the structure of core concepts in early childhood education institution evaluation research, and provided implications for follow-up and direction of institution evaluation