• Journal of Korean Society for Quality Management
• /
• v.50 no.4
• /
• pp.665-677
• /
• 2022

Purpose: The purpose of this study is to analyze the current status and investigate relevant indicators so that R&D performance evaluation suitable for government-funded research institutes can proceed. A suitable performance evaluation model was presented based on the surveyed indicators. Based on the presented performance evaluation model, the importance was analyzed to calculate the weight for each indicator of the performance evaluation model. Methods: The method applied in this study presented a performance evaluation model based on the organizational performance evaluation cases of advanced overseas countries. By using the AHP(Analytic Hierarchy Process) technique, the weight of each indicator of the performance evaluation model was studied. Results: As a result of examining the indicators necessary for the evaluation model, focusing on overseas cases, 13 evaluation items were derived. A weight was calculated for the importance of the study results. And the scientific/technical research results showed the highest excellence. Conclusion: Key indicators of performance evaluation suitable for government-funded research institutes were derived and presented through detailed modeling in three stages. A realistic model that can objectively evaluate the performance of government-funded research institutes was proposed using the AHP technique.

• Phonetics and Speech Sciences
• /
• v.1 no.4
• /
• pp.47-59
• /
• 2009

The purpose of this paper is to propose an automatic evaluation technique for the prosodic aspect of an English sentence uttered by Korean speakers learning English. The underlying hypothesis is that the consistency of the manual prosody scoring is reflected in an imaginary space of prosody evaluation model constructed out of the three physical properties of the prosody considered in this paper, namely: the fundamental frequency (F0) contour, the intensity contour, and the segmental durations. The evaluation proceeds first by building a prosody evaluation model for the sentence. For the creation of the model, utterances from native speakers of English and Korean learners for the target sentence are manually scored by either native teachers of English or Korean phoneticians in terms of their prosody. Multiple native utterances from the manual scoring are selected as the "model" native utterances against which all the other Korean learners' utterances as well as the model utterances themselves can be semi-automatically evaluated by comparison in terms of the three prosodic aspects [7]. Each learner utterance, when compared to the multiple model native utterances, produces multiple coordinates in a three-dimensional space of prosody evaluation, each axis of which corresponds to the three prosodic aspects. The 3D coordinates from all the comparisons form a prosody evaluation model for the particular sentence and the associated manual scores can display regions of particular scores. The model can then be used as a predictive model against which other Korean utterances of the target sentence can be evaluated. The model from a Korean phonetician appears to support the hypothesis.

• Journal of Information Technology Applications and Management
• /
• v.9 no.3
• /
• pp.31-46
• /
• 2002

The objective of this paper is to develop an evaluation model for pilot informatization projects. There are relatively many researches on evaluation models for information systems. These previous researches, however, lack of comprehensive view of informatization Projects and pilot systems. We apply and test a hybrid evaluation model for to measure the success of pilot informatization projects. A user satisfaction model has been used and hypotheses are developed to find relationships of evaluation factors. The hypotheses have been tested with 51 user surveys. The result of this research can give an insight for the evaluation of pilot informatization projects.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.9 no.3
• /
• pp.129-144
• /
• 2013

Recognizing a limits on quantitative evaluation of cultural contents' and for its betterment, study aims developing a qualitative evaluation model. For this study, Reception Theory, Semiotics and Psychology were derived for epistemological dimension to contemplate culture contents' essential attribute. To be concrete, cultural contents was examined as experiential products, emotional products, rememberable products and texts. Also, codes of fun, emotion and culture were discussed as intrinsic attributes for cultural contents and how those attributes were expressed or composed in cultural contents was discussed as well. Evaluation items were extracted based on final discussion at the epistemic level, set up the final evaluation model by taking experts' advices on each items. With all those outcomes, qualitative evaluation model for cultural contents was developed. For the importance of each index in the model, priority was granted by weighting on each index. Lastly, evaluation scale was developed for each index. The culture contents' evaluation model developed in study is meaningful not only in drawing qualitative evaluation items of video(image) contents and developing the index and model for the first time, but also its possibility of wide use for other genres.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.28 no.4
• /
• pp.155-189
• /
• 2003

In this research, the comprehensive evaluation model of IS(information systems) for public sectors is theoretically constructed through reviewing and integrating previous IS evaluation-related research. This model is hypothesized to consist of five sectors(System Sector, User Sector, Organization and Management Sector, Resource Management Sector and Strategic Contribution Sector), ten evaluation items belonging to these five evaluation sectors, and sixty two evaluation indices for these ten evaluation items. The results of empirical analyses to test the validity of the research model show that the evaluation sectors turn out to be the same ones as proposed in the hypothetical model. The evaluation items(System Quality, Information Quality, Service Quality) in System Sector proves to be consistent with the hypothetical model. However, in case of User Sector, two evaluation items(Perceived Usefulness and User Satisfaction) which are included in the hypothetical model are found to be merged into one item(User Satisfaction). And, it is shown that four evaluation items such as the Efficiency of Internal Process, Customer Satisfaction, Organizational Innovation, and the Degree of Informatization competence improvement are included in Organization and Management Sector, differently from the research model in which the items, Organizational innovation and the Degree of Informatization competence improvement, are not divided. As a final result, sixty two evaluation indices that comprise all the evaluation items belonging to five sectors are found to be reduced to fifty seven ones through factor analyses, criterion-related validity tests and reliability analyses.

• Journal of Distribution Science
• /
• v.13 no.1
• /
• pp.57-70
• /
• 2015

Purpose - Open source software has high utilization in most of the server market. The utilization of open source software is a global trend. Particularly, Internet infrastructure and platform software open source software development has increased rapidly. Since 2003, the Korean government has published open source software promotion policies and a supply promotion policy. The dynamism of the open source software market, the lack of relevant expertise, and the market transformation due to reasons such as changes in the relevant technology occur slowly in relation to adoption. Therefore, this study proposes an assessment model of services provided in an open source software service company. In this study, the service level of open source software companies is classified into an enterprise-level assessment area, the service level assessment area, and service area. The assessment model is developed from an on-site driven evaluation index and proposed evaluation framework; the evaluation procedures and evaluation methods are used to achieve the research objective, involving an impartial evaluation model implemented after pilot testing and validation. Research Design, data, and methodology - This study adopted an iteration development model to accommodate various requirements, and presented and validated the assessment model to address the situation of the open source software service company. Phase 1 - Theoretical background and literature review Phase 2 - Research on an evaluation index based on the open source software service company Phase 3 - Index improvement through expert validation Phase 4 - Finalizing an evaluation model reflecting additional requirements Based on the open source software adoption case study and latest technology trends, we developed an open source software service concept definition and classification of public service activities for open source software service companies. We also presented open source software service company service level measures by developing a service level factor analysis assessment. The Behavior-Structure-Evolution Evaluation Model (BSEM) proposed in this study consisted of a rating methodology for calculating the level that can be granted through the assessment and evaluation of an enterprise-level data model. An open source software service company's service comprises the service area and service domain, while the technology acceptance model comprises the service area, technical domain, technical sub-domain, and open source software name. Finally, the evaluation index comprises the evaluation group, category, and items. Results - Utilization of an open source software service level evaluation model For the development of an open source software service level evaluation model, common service providers need to standardize the quality of the service, so that surveys and expert workshops performed in open source software service companies can establish the evaluation criteria according to their qualitative differences. Conclusion - Based on this evaluation model's systematic evaluation process and monitoring, an open source software service adoption company can acquire reliable information for open source software adoption. Inducing the growth of open source software service companies will facilitate the development of the open source software industry.

• Korean Medical Education Review
• /
• v.23 no.1
• /
• pp.56-67
• /
• 2021

Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.

• Journal of Soil and Groundwater Environment
• /
• v.20 no.7
• /
• pp.13-22
• /
• 2015

In this study, we have developed the performance evaluation model for the optimal soil remediation technology selection. Performance evaluation model is composed in the evaluation of two steps. In the first stage, the candidate technologies are derived according to the conditions of drilling, type and concentration of pollutants, and the saturated/unsaturated of target site. In the second stage, each individual candidate technology is evaluated by performance evaluation model. The performance evaluation model has 5 groups of evaluation items and 12 evaluation items which have their own evaluation index and their own weights through the AHP approach surveying 40 experts. From the case study of actual design cases, the applicability of the performance evaluation model was confirmed.

• Journal of Fisheries and Marine Sciences Education
• /
• v.26 no.5
• /
• pp.1108-1118
• /
• 2014

The purpose of this study was to spread the education of human creativity program and its possibility of consistency, and its application to school system by exploring the evaluation system that determines the valuable and useful decisions. This study was based on the evaluation system according to CIPP model regarding the program's general ideas and its role. The interest of the education of human creativity was increasing as well as its progress of program, and we searched 13 figures and 55 evaluation index according to increase the program's effectiveness and nation-wise situation of evaluation model. The conclusion of this study was that the human creativity program's evaluation was composed of six compartments. And the context evaluation was composed of three evaluation models and eleven index, and input evaluation was composed of three evaluation model and 15 index, while process evaluation is composed of three evaluation models and thirteen evaluation index. Lastly, output evaluation had four evaluation model and sixteen index.

• Journal of Fisheries and Marine Sciences Education
• /
• v.29 no.3
• /
• pp.941-951
• /
• 2017

The purpose of this study is to investigate the characteristics of the research paradigm and to explore the characteristics and limitations of the representative evaluation models belonging to each paradigm. The research paradigm is Positivism, Interpretivism, Critical Theory, and Postmodernism. The evaluation models that represent each paradigm include Objective-oriented evaluation model, Forth generation evaluation model, Empowerment evaluation model, Connoisseurship & Criticism model. The characteristics of each evaluation model reflects the characteristics of their own research paradigm.