• Journal of Engineering Education Research
• /
• v.18 no.2
• /
• pp.27-32
• /
• 2015

The paper deals with the analysis for improving evaluation system of government-supported program in developing engineering college. I think that it is important to consider evaluation system of government-supported program and faculty in the aspect of policy responsibility and autonomy. I suggest three proposals. First, in the perspective of evaluation system of government-supported program, it is important to keep the balance between SCI-based evaluation and practical & University Industry Corporation (UIC) indicator or keep the balance between quantitative indicators and qualitative indicators. Second, in the perspective of evaluation system of faculty, UIC-friendly evaluation system should be expanded and institutionalized. Finally, the evaluation systems should be not only built, but also utilized for developing engineering college.

• Korean Medical Education Review
• /
• v.22 no.2
• /
• pp.131-142
• /
• 2020

A systematic educational program evaluation system for continuous quality improvement in undergraduate medical education is essential. Monitoring and evaluation (M&E) are two distinct but complementary processes referred to in an evaluation system that emphasizes formative purpose. Monitoring involves regular data collection for tracking process and results, while evaluation requires periodic judgment for improvement. We have recently completed implementing an educational evaluation using the M&E concept in a medical school. The evaluation system consists of two loops, one at the lesson/course level and the other at the phase/graduation level. We conducted evaluation activities in four stages: planning, monitoring, evaluation, and improvement. In the planning phase, we clarified the purpose of evaluation, formulated a plan to engage stakeholders, determined evaluation criteria and indicators, and developed an evaluation plan. Next, during the monitoring phase, we developed evaluation instruments and methods and then collected data. In the evaluation phase, we analyzed results and evaluated the criteria of the two loops. Finally, we reviewed the evaluation results with stakeholders to make improvements. We have recognized several problems including excessive burden, lack of expertise, insufficient consideration of stakeholders' evaluation questions, and inefficient data collection. We need to share the value of evaluation and build a system gradually.

• Journal of Engineering Education Research
• /
• v.16 no.3
• /
• pp.28-41
• /
• 2013

The purpose of this study was to develop the Meta-Evaluation Criteria which can comprehensively and systematically evaluate and improve the Accreditation Evaluation System for Engineering Education. This will provide useful implications for establishing value, direction, and improvement remedy for Engineering Educations Accreditation System of Korea. In order to achieve the purpose of this study, Meta-Evaluation Criteria was developed to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The research methodology used to study these subjects: literature review, interviews with experts, Delphi survey (three times), survey, analysis of narrative opinion and secondary source. The results and conclusions of this study can be summarized as follows: First, the final Meta-Evaluation Criteria were developed so as to comprehensively and systematically assess and analyze the Accreditation Evaluation System of Engineering Education. The criteria's validity and reliability were also identified. Specific details are as follows: In a draft plan of the Meta-Evaluation Criteria, Meta-Evaluation concept was defined as evaluation on the whole range of Accreditation Evaluation System of Engineering Education. Meta-Evaluation Criteria was designed to be based on a systematic approach and applies the phased approach to the lower component to reflect evaluation's characteristics. Then validity and reliability of the developed draft plan was verified by calculating Content Validity Ratio (CVR), Degree of Consensus, Degree of Convergence and Cronbach's alpha. The final developed Meta-Evaluation Criteria obtaining validity and reliability were composed of 5 evaluation areas (environment, input, performance, result, utilization), 15 evaluation items, 68 evaluation indicators.

• Journal of the Korean Society for Library and Information Science
• /
• v.45 no.1
• /
• pp.51-73
• /
• 2011

The purpose of this study is to improve the evaluation system of school libraries in Korea. Major issues to improve the evaluation system were identified through school library evaluations and an analysis of the existing evaluation system of the Committee on Library and Information Policy. The issues include evaluation organizations, purposes of evaluation, selection of objects, evaluation period length, systems of evaluation, and ways to receive results. Alternatives for improving the evaluation system were selected through surveys and professional consultation. Finally this study proposed a more effective evaluation system which emphasizes the self-regulation and responsibility of provincial education offices in Korea.

• Journal of Information Technology Applications and Management
• /
• v.26 no.5
• /
• pp.13-25
• /
• 2019

Recently, as evaluation of information security (IS) management become more diverse and complicated, the contents and procedure of the evidence to prepare for actual assessment are rapidly increasing. As a result, the actual assessment is a burden for both evaluation agencies and institutions receiving assessments. However, most of them reflect the evaluation system used by foreign government agencies, standard organizations, and commercial companies. It is necessary to consider the evaluation system suitable for the domestic environment instead of reflecting the overseas evaluation system as it is. The purpose of this study is as follows. First, we will present the problems of the existing information security assessment system and the improvement direction of the information security assessment system through analysis of existing information security assessment system. Second, it analyzes the technical guidance for information security testing and assessment and the evaluation of information security management in the Special Publication 800-115 'Technical Guide to Information Security Testing and Assessment' of the National Institute of Standards and Technology (NIST). Third, we will build a framework to implement the evidence collection system and present a system implementation method for the '6. Information System Security' of 'information security management actual condition evaluation index'. The implications of the framework development through this study are as follows. It can be expected that the security status of the enterprises will be improved by constructing the evidence collection system that can collect the collected evidence from the existing situation assessment. In addition, it is possible to systematically assess the actual status of information security through the establishment of the evidence collection system and to improve the efficiency of the evaluation. Therefore, the management system for evaluating the actual situation can reduce the work burden and improve the efficiency of evaluation.

• Journal of Korean Society of Rural Planning
• /
• v.12 no.2 s.31
• /
• pp.65-73
• /
• 2006

This study attempts to develop an interim evaluation system for the Integrated Rural Village Cluster Development Project(IRVCDP) which can secure its identity and sustainability, and induce its early settlement, and to derive plans for its steady progress. The evaluation system consists of three levels. The highest-order level is evaluation purposes, which describe IRVCDP's goals. They are expansion of income bases(EIB), improvement of living environments(ILE), strengthening of regional capabilities(SRC) and constructing effective project operation system(CEPOS). The second level is evaluation items, which each characterize the relevant evaluation purposes. The last level is evaluation indices, which observe achievement f3r evaluation purposes. 22 evaluation indices are selected to satisfy the purposes of this study through a brainstorming process and a survey on opinions of experts for those evaluation purposes and evaluation items which are derived from analyzing the IRVCDP's properties. The relative importance of the evaluation indices selected are determined through the AHP analysis. The most intriguing result from the AHP analysis is that strengthening of regional capabilities is found to be the most important one among evaluation purposes. It can be said that this result is parallel to a ultimate goal of the IRVCDP.

• Proceedings of the Korean Institute of Building Construction Conference
• /
• 2012.05a
• /
• pp.185-188
• /
• 2012

As a separate project unit, the domestic construction policy evaluation is independently evaluated and managed by different involvements, so that it has been difficult to have a consistent policy evaluation to be performed. In this paper, thus, it is aimed to give an overview of the evaluation system and issues of domestic construction policy and suggest strategies of a improved evaluation system by a comprehensive benchmarking of construction policy evaluation system of Japan. The implications of this paper will serve a basis of improvement of a better construction policy evaluation system in Korea.

• Proceedings of the Korean Institute of Building Construction Conference
• /
• 2023.05a
• /
• pp.379-380
• /
• 2023

The Post-Construction Evaluation and Management System has been operated over the past 20 years not only to analyze the performance of large-scale construction projects, and but also to provide useful reference data for future similar projects. Although the Post-Construction Evaluation and Management Center has been legally designated and operated since 2020, various problems have been occurring in the operation of the system. Accordingly, this study proposes strategies for facilitating Post-Construction Evaluation and Management System in terms of the following three aspects: (1) improving the implementation rate of post-construction evaluation; (2) improving the information management system related to post-construction evaluation; (3) improving the utilization of post-construction evaluation outcomes. Based on the results of this study, a specific action plan will be prepared, which is expected to contribute to the efficiency of construction project performance management in the future.

• Journal of Environmental Impact Assessment
• /
• v.2 no.2
• /
• pp.85-93
• /
• 1993

Aims of the EXCEPT project and tasks and characteristics of the EXCEPT system are presented based on an analysis of urban planning EIAs. The methodology of evaluation in EIAs, which had to be developed in order to program the system, is based on a model of evaluation processes. Evaluation principles, evaluation rates, an environmental model and a model of the projects being planned are presented. The evaluation concern re-unifies the different components of evaluation again.

• Journal of Korea Game Society
• /
• v.9 no.1
• /
• pp.63-74
• /
• 2009

This paper mainly focused on research developing online game characteristic evaluation system based on game characteristic evaluation model design. Online game characteristic evaluation system is a system that evaluates game online in real-time using evaluation elements defined by model design. Game characteristic evaluation system uses heuristic evaluation method, which is used to execute evaluation in four parts, technical element, manage element, social element, and competitive element. To verify objectivity and validity of game characteristic evaluation, assessment was performed by three groups of beginners, intermediates, and professionals to increase the trust. And game characteristic evaluation forum was hosted to collect opinion from diverse classes.