• Journal of the Korean Society for Library and Information Science
• /
• v.52 no.4
• /
• pp.163-178
• /
• 2018

The purpose of this study is to build outcomes evaluation system for measuring outcomes of programs provided by a public library. For the study, we constructed outcomes evaluation system(LibOutcomes system) that applied library outcome measurement framework based on the logic model and this system made librarians to measure outcome directly import data from the KOLAS and upload it. As a result, LibOutcomes system was useful for verifying outcomes as visual result. In addition, since the system was built a web-based system, it is possible to secure accessibility and ease of use. Finally, we suggested possibility to expand the system as a function of KOLAS in the future.

• Journal of Engineering Education Research
• /
• v.22 no.6
• /
• pp.74-88
• /
• 2019

In recent years, the design has formed and operated convergence education in conjunction with many other academic fields, and ABEEK also encourages the participation of convergence engineering programs. The purpose of this study is to require design and software convergence major to operate program that accord engineering education certification criteria to develop a program outcomes evaluation system and examine its validity. The program outcomes evaluation system was developed in accordance with development research methods and procedures. As a result, developed evaluation system program outcomes for convergence-based program outcomes: convergence ability, creative thinking ability, entrepreneur ability, and design ability. Finally, it revised and supplemented them through expert validity examine. Expert validity review included 9 experts in engineering, IT engineering, education technology, and design. The validity, usefulness, intelligibility, universality, and explanatory power of the evaluation system were reviewed. The results of this study are expected to provide practical tools for operating ABBEK of convergence programs between design and engineering.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.137-164
• /
• 2009

As a means to address the modes of developing institutional evaluation system aimed at improving performances of GRIs, this study looked into the influential relations where institutional evaluation system has an impact on receptivity of evaluation outcomes and performances of institutes optimize their performances. After making analysis, it was confirmed that the National Research Council for Economics, Humanities and Social Sciences' institutional evaluation system for GRIs had a positive (+) influence on performances of research institutes, and receptivity of evaluation outcomes is related to performances of research institutes. In addition, it was also confirmed that institutes with high performances, in general, have high level of receptivity of evaluation outcomes along with positive recognition of institutional evaluation system. However, weaknesses of the Council's institutional evaluation system for GRIs resulted in low level of receptivity amongst GRIs, and thus there is limitation on the government and the Council in the active utilization of evaluation outcomes. Finally, it addressed the limitations and areas for improvement in relation to research outcomes.

• Korean Journal of Social Welfare
• /
• v.59 no.3
• /
• pp.281-304
• /
• 2007

The purpose of this study is to verify the applicability of concept mapping in the process of planning of network outcomes in social welfare. Planning and evaluation of network outcomes involve many stakeholders. Recognizing the value and range of individuals' perspectives in the creation of a common framework is one of the biggest methodological challenges for planning of network outcomes. Concept mapping is a kind of methodology that creates a stakeholder-authored visual geography of ideas from a group. It uses both a quantitative and qualitative approach, including brainstorming, structuring the statement, specific analysis and data interpretation methods to produce maps that can then be used to guide planning and evaluation efforts on the issues that matter to the group. 13 network managers who work in the social welfare centers in Busan are core participants. The 50 statements on network outcomes from brainstorming session fell into six distinct clusters. After the interpretation session these clusters were rated according to the seven rating scales. This paper explores applicability of concept mapping in the process of planning of network outcomes in social welfare. Concept mapping helps stakeholders with different value and ideas about network outcomes to consensus on common conceptual framework. In addition, a multidimensional conceptualization of network outcomes was made. It will assist in designing future outcomes evaluation and guide the evaluators through a selection of key activities and outcomes.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.19 no.7
• /
• pp.183-191
• /
• 2018

This paper evaluates the achievement of program outcomes using course-embedded assessment for information security programs. In the case study concerning the development of course-embedded assessment used in this paper, we evaluate program outcomes using various evaluation tools including the course evaluation data. In addition, we consider the evaluation rubric and evaluation procedure for course-embedded program outcomes, set performance criteria, select the probe course with high contribution to the program outcomes according to curriculum flowchart, set course objectives for the probe course, and explain the rubric for each assessment tool to measure achievement level. Subsequently, we perform course-embedded program outcomes assessment, based on tests and projectevaluation tool for each program objectives, and present the achievement levels based analysis results. These results prove the effectiveness of the proposed course-embedded assessment for program outcomes.

• Journal of Engineering Education Research
• /
• v.23 no.6
• /
• pp.40-50
• /
• 2020

This paper proposes learning modules as a kind of integrated instruction model for soft skills program outcomes to enable CEA. Learning modules consist of course learning objectives(outcomes) described in detail, learning content(elements), learning activities(teaching learning methods), evaluation methods, evaluation rubrics so that they can be evaluated based on the performance criteria of the program learning outcomes. The unit of time for the learning module is 50 minutes. If this learning module is applied, it is expected that the soft skill program outcomes can be evaluated in the technical course. As a result of the expert feasibility study, the positive answers were much higher than the negative answers in most of the questions about the composition of the learning module or the method of managing the class.

• Journal of the Korea Society of Computer and Information
• /
• v.21 no.9
• /
• pp.149-156
• /
• 2016

This paper is concerned with education courses operating practices for basic computer literacy training. In this study, we propose an example for students to effectively measure and evaluate the achievement of defined ability in the performance measurement and analysis, learning objectives and learning outcomes set in operation throughout the course. Through research and development use case presents the tools for teaching method and effective and objective measurement of the related subjects. And based on the results, we propose the possibility of utilizing NCS-based course operation and education certification. In this study, the measurement process is based on the association with the objective of the development and operation, and measurement tools, measuring tools for measuring learning outcomes associated with the curriculum design methods for the measurement and evaluation of the case of the operation of the course units of learning outcomes and the method proposed.

• The Journal of the Korea Contents Association
• /
• v.21 no.3
• /
• pp.410-418
• /
• 2021

In a program that runs an engineering education certification, program outcomes refer to the knowledge, skills, and attitudes a student must have until graduation. In general, capstone design is used as a tool for evaluating program outcomes. This paper applies the intraclass correlation coefficient (ICC) to measure the raters' reliability in assessing program outcomes. Several raters evaluate program outcomes, and the result is used to obtain the raters' ICC. ICC measures the reliability of ratings or measurements for clusters - data that has been collected as groups or sorted into groups. If the ICC is close to 1, it means that the reliability among the raters is high. We evaluated the proposed method's usefulness through case analysis. As a method for assessing an evaluation tool's objectivity, multiple raters measure the same evaluation tool. As a result, we measured the ICC values for all POs, and analyzed the cause for the low measured POs. We applied this method to evaluate program outcomes of the Department of Computer Engineering in the past two years. As a result, we derived guidelines for improvement and program outcomes.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.26 no.3
• /
• pp.777-785
• /
• 2016

Engineering education accreditation addresses evaluation for program outcomes according to educational objectives and assessment process, which students are expected to obtain by the time of graduation in order to train international competitive engineers with continuous quality improvement in engineering programs. This paper shows a case study of a program outcomes assessment system including performance criteria, evaluation process, document system and continuous quality improvement process and an achievement evaluation by the assessment system for program outcomes in Information Security Program of Hoseo university.

• The Journal of Korean Academic Society of Nursing Education
• /
• v.23 no.2
• /
• pp.135-145
• /
• 2017

Purpose: The purpose of this study was to develop a program outcomes assessment system based on Course Embedded Assessment for nursing education. Methods: This study was conducted in accordance with the procedures of the developmental research method. Results: The major results are as follows. 1) The program outcomes were measured according to the Analytic Hierarchy Process. 2) The Course Embedded Assessment matrix was made according to program outcomes' weight, the curriculum-organizing principle, and achievement levels. 3) The Course Embedded Assessment rubric was developed in logical process, and consisted of a performance criterion, and rating scale. The content validity index of the Course Embedded Assessment rubric was 0.85. 4) An evaluation guideline and 12 documents were developed to facilitate the performance of the assessment system. 5) The average content validity index of the Course Embedded Assessment-based program outcomes assessment system was as high as 0.89. Conclusion: A Course Embedded Assessment-based program outcomes assessment system is more suitable for accreditation of nursing education than previous studies. Because this system evaluates the process of achievement as well as program outcomes, the results can also serve as immediate feedback to improve the educational process. Above all, this system facilitates that students check their achievements and strive to acquire core competencies in nursing.