• Journal of Korea Technology Innovation Society
• /
• v.12 no.4
• /
• pp.819-839
• /
• 2009

Proposed increases to the government's R&D budget should be discussed based on merits of meeting efficiency and effectiveness criteria. The evaluation of the national R&D budget and related programs are performed in two areas: a system of R&D budget coordination and allocation, and a system of R&D program performance. This paper mainly focuses on the operational areas of R&D budget evaluation system with a focus on their impact to efficiency and effectiveness. The core view point for a R&D budget evaluation system involves two directions: Firstly, to detail the relationships between the later stage (ex. post) activities such as, program survey, analysis, and program performance evaluation, with the budget evaluation. Secondly, to critically oversee all R&D coordination procedures with a different perspective. Budgeting is generally known as a serial process of policy making, planning and executing. It is highly desirable for the budget to be allocated to, and spent by, specific programs as planned, and that each plan be aligned with a specific policy. As such, a strong relevance between the program structure and budget code system is integral to successful execution. It should be performed using a decision making system which closely examines the link between policy and budget. It is also recommended that systematic relationships be maintained among budget coordination and allocation, performance evaluations of policy and program levels, and program survey and analysis system, and that their operational schedule should be reviewed comprehensively as a one integrated system. The National Science and Technology Council is expected to play a major and practical role as the center of policy planning and should be supported by the objective and unbiased system which covers overall process from policy making to program evaluation. Finally, increased utilization of contents, timely program survey and analysis, and accurate of activity scheduling of budget coordination and allocation, and diligent program performance evaluation all contribute towards a more efficient and effective overall evaluation system.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.35 no.2
• /
• pp.1-8
• /
• 2012

The primary goal of this study is to develop proper performance indicators for evaluating the results of industrial R&D program. We define R&D results include output, transfer, outcome, and impact in the performance of R&D program. Performance indicators are focused on the results of R&D commercialization, building the industrial foundations as performance proxy of R&D program of Ministry of Knowledge Economy. And we first try to design the coupled structure as logical model between R&D program goals and performance indicators. The coupled structure is represented with objectives of group unit of R&D program, implementation process, R&D practical stage, and the ultimate goal of R&D program.

• 한국벤처창업학회:학술대회논문집
• /
• 2009.08a
• /
• pp.5-24
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as 'Good'. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as 'Very Good'. The evaluation input component gained 73.1 points out of 100, so it was evaluated as 'Good'. The evaluation process component gained 74.8 points out of 100, so it was evaluated as 'Good'. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D Programs.

• Journal of Digital Convergence
• /
• v.11 no.4
• /
• pp.77-90
• /
• 2013

This study is to seek measures for streamlining the evaluation system by analyzing the examples of advanced countries. This study was conducted, based on the relevant government policy documents and previous research papers, in the manner of comparing and analyzing the issues and cases regarding the government evaluation system of public-funded R&D programs in selected countries. In Korea, a national R&D performance evaluation system was introduced by law in 2006. In United States, Obama government has enhanced government performance management by signed into law the GPRA Modernezation Act of 2010. The Japanese Government issued a newly revised Guideline on National R&D Evaluation in late 2012. European Union has also been constantly updating its evaluation system for Framework Programmes(FPs) begun since 1984. This study gets some insights from the recent development of R&D evaluation in the other countries. It is important for the government R&D evaluation system to be in line with national S&T policy and agency's mission. In micro views, specific evaluation approaches and methods by types of various R&D programs should be more illustratively developed. Additionally it is suggested to monitor recent trends and techniques on R&D evaluation by participating in activities to communicate and share their knowledge and experiences in international evaluation research networks.

• Korean Journal of Construction Engineering and Management
• /
• v.14 no.4
• /
• pp.118-129
• /
• 2013

Due to the recent surge in natural disasters, with rising social concerns, investment on research & development (R&D) project in natural disaster mitigation area is continuously increasing. However, current R&D performance management system of natural disaster mitigation area does not properly reflect characteristics and social ripple effects of R&D projects. It is indicated that mainly due to the current performance index consists of easy-quantification factors and the performance evaluation system adopts simple aggregation method. Therefore, the purpose of this study is to develop new performance evaluation system considering characteristics and social ripple effects of natural disaster mitigation R&D projects. To this ends, this study derived 3-dimensional performance measurement index through literature review and natural disaster mitigation R&D projects analysis. Finally, based on the derived performance measurement index, this study suggested new and effective performance evaluation system for natural disaster mitigation R&D projects.

• Journal of Technology Innovation
• /
• v.15 no.1
• /
• pp.87-113
• /
• 2007

For the realization of the national self-defense, the trend of the defense R&D projects becomes global and diverse with the increase of their budget. Thus, for the effective execution of the budget and the successful performance of the projects, the importance of selection, management and evaluation of the R&D projects is emphasized. This study suggests the applicability of a meta-evaluation model for the realization of the successful defense R&D project evaluation system. This study focused on the development of the meta-evaluation model design which can be applicable to the national defense R&D projects. Using the proposed meta-evaluation model, we propose a technique to enhance the fairness and the reliability of the national defense R&D projects evaluation system.

• Journal of Soil and Groundwater Environment
• /
• v.20 no.7
• /
• pp.13-22
• /
• 2015

In this study, we have developed the performance evaluation model for the optimal soil remediation technology selection. Performance evaluation model is composed in the evaluation of two steps. In the first stage, the candidate technologies are derived according to the conditions of drilling, type and concentration of pollutants, and the saturated/unsaturated of target site. In the second stage, each individual candidate technology is evaluated by performance evaluation model. The performance evaluation model has 5 groups of evaluation items and 12 evaluation items which have their own evaluation index and their own weights through the AHP approach surveying 40 experts. From the case study of actual design cases, the applicability of the performance evaluation model was confirmed.

• Journal of the Society of Disaster Information
• /
• v.10 no.2
• /
• pp.208-218
• /
• 2014

The growth of disaster/accident damage costs and related industries has increased the necessity of scientific and objective performance analysis for fire suppression and disaster management R&D projects. Most of R&D performance are both academic and public performance according to fire suppression and disaster management R&D projects during the period of 2004 to 2011. This research identified characteristics of performance types by research project teams and research development stages. The research outcome shows the usefulness of relevant performance objective settings by project teams, the evaluation of scientific technology fields, and proper research teams in research team selection process, considering research outcome characteristics by both research teams and research development stages. In addition, this research reveals the applicability of research outcomes to research performance management. This research suggests further studies for evaluation process and methods for including fire suppression and disaster management characteristics to the evaluation process.

• Journal of Technology Innovation
• /
• v.21 no.1
• /
• pp.229-252
• /
• 2013

The aim for this study is to suggest a practical model to measure the financial values of the achievements from corporate research and development(R&D) projects. Performance indicators for R&D projects were identified from the extensive literature reviews and the evaluation methods to convert them into financial values were proposed to overcome the problems of excessive predictions and subjective expert assessments in existing methods. The proposed model was applied to R&D projects of an IT company in Korea for its validity test. The model is expected to be a turning point in economic evaluation of corporate R&D projects in general due to its practical and reasonable scheme.

• Journal of Korea Technology Innovation Society
• /
• v.14 no.4
• /
• pp.937-964
• /
• 2011

The research question of this work comes from that there have been disputes for the governance and roles of the Rural Development Agency (RDA), despite of rather excellence performances of Agricultural R&D program supported by RDA. For this reason, I meta-evaluated the internal evaluation system of Agricultural R&D program in RDA, in terms of the four meta-evaluation components such as evaluation paradigm, evaluation resources, evaluation execution and evaluation utilization. The result shows that the most serious problem is rather lower level of evaluation. Object, one of the evaluation paradigms in the R&D evaluation system of the RDA. So, this work suggested the policy alternatives which may lead the R&D evaluation system of the RDA to be developed for the performance-oriented R&D management system.