• IE interfaces
• /
• v.22 no.3
• /
• pp.192-204
• /
• 2009

Based on the characteristics of 'Korean electric power industry R&D programs', this study proposes a new performance evaluation framework where electric power industry related R&D projects are scrutinized. The abovementioned R&D programs have their own goals and especially they emphasize the effectiveness as well as the efficiency of each subordinate R&D project. Hence, in this framework, a performance evaluation procedure is established and then a mathematical model is developed according to the procedure. The model calculates performance evaluation indices for a set of R&D projects integrating the effectiveness with the efficiency of each R&D project. In a case study with an empirical dataset, statistical significance is tested on the integrated performance evaluation indices of R&D projects regarding organizational types and program categories considered.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.12 no.1
• /
• pp.70-79
• /
• 2009

Currently, the investment on Research and Development(R&D) for defense core technology is continuously increasing to maintain advanced country's R&D level. In accordance with this trend, the national defense R&D investment management system is being more strengthening, and importance of performance evaluation is being emphasized more and more. However, the existing indicators of performance evaluation for defense core technology R&D is limited in efficient management because of the qualitative evaluation items and subjective allocation of points. In this paper, we developed a novel indicator for defense core technology R&D performance evaluation through domestic and foreign related literature and inquiry, brainstorming, and analysis techniques by Stepwise Multiple linear Regression(SMR) and Analytic Hierarchy Process(AHP). And we verified effectiveness of proposed indicators of performance evaluation by comparing with the existing evaluation indicators. Our proposed indicators for performance evaluation will create superiority performance on defense R&D fields.

• Journal of Korea Technology Innovation Society
• /
• v.13 no.1
• /
• pp.44-67
• /
• 2010

Because of the difficulties on budget estimation of National R&D projects, it is expected that the errors of decision making can be reduced if the information on project performance and its evaluation result is provided to the decision stakeholders in a timely manner, as a reference. In reality, however, the result of project evaluation is not utilized in its own purpose. One reason is that the information on evaluation result and budget is not shared at the right time. The other is that the interconnection between systems to support those information is not realized yet. Therefore, the current status of National R&D projects is analyzed in terms of before and after the reign of current government. In particular, this paper is focused on the improvement through the procedural and systematic approaches and attempted to suggest the enhanced process for the seamless interconnection between National R&D performance evaluation and budget information.

• IE interfaces
• /
• v.23 no.1
• /
• pp.78-88
• /
• 2010

In this paper we develop a model for the performance evaluation of defense R&D test development projects based on analytic hierarchy process. First, evaluation indicators are collected through the related literature survey and a delphi inquiry method. Second, stepwise multiple linear regression is used for developing a hierarchical structure for analytic hierarchy process in the evaluation model, which can make the selected evaluation indicators of the hierarchical structure independent. Also we verify the effectiveness of proposed indicators of the performance evaluation by comparing with the existing evaluation indicators. The developed indicators for the performance evaluation is more reasonable and practical than the previous indicators on defense R&D test development projects.

• Journal of Technology Innovation
• /
• v.22 no.4
• /
• pp.165-198
• /
• 2014

The national R&D performance evaluation system in Korea has been influenced by 'New Public Management' since the 1980s. The 1997 IMF crisis in Korea has necessitated the overhaul of S&T policy strategies in Korea. Reflecting this, effective distribution and utilization of S&T investment and resources has emerged as a crucial policy agenda, while expansionary investment in S&T maintained. During the period of 1999-2005, the R&D evaluation has been more focused on the input side and execution processes than on the results of R&D. Evaluation results were to be reflected in the budgeting of national R&D, but there were some disputes over how to make use of evaluation results between the budgeting ministry and the evaluation agency partly because they were two separate entities. After the advent of the new government(1998-2003) which advocated 'science and technology-oriented society', the national R&D evaluation system has evolved through a new legislation, the Performance Assessment Act, and the establishment of Science & Technology Innovation Agency to build up the unique framework for national R&D evaluation differentiated from the assessment system for general government investment programs. Most recently, due to 'Comprehensive Improvement Plan' in 2013, various components of national R&D evaluation seem to move on a new evolutionary track. For example, different types of evaluation are being developed and tried in accordance with differing evaluation goals, and the individual ministries and the research councils has got more enhanced autonomy and responsibility regarding R&D evaluation. So-called 'tailored' evaluation methods, taking into consideration the characteristics of programs and institutes / organizations to be evaluated, are now being tried. Competences of evaluation experts and agencies has also to be improved and strengthened.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.22 no.1
• /
• pp.106-123
• /
• 2019

Demand for performance analysis is increasing for efficient use of limited budgets such as improving investment efficiency and strategic budget allocation in accordance with the continuous increase demand of R&D budget for developing advanced weapon systems in the future battlefields. In accordance with the Act on the Performance Evaluation and Performance Management of the National R&D Projects established in March 2006, the performance analysis has been conducted for the systematic management and utilization of the R&D project performance. It was recognized as a project to achieve self-defense through strengthening the weapons system development capability, however, efficiency evaluation of Defense R&D projects was not much emphasized. Research on the efficiency analysis of defense R&D projects has been conducted in recent years, but most studies focused on corporate efficiency and productivity of defense companies. In this study, we analyzed the three-stage performance of defence R&D projects based on the logical model using the data envelope analysis(DEA) model. We also analyzed performance analysis from various perspectives through R&D type, technology classification and performance model. This study is expected to help defense department improve defense R&D projects and make decision.

• Journal of Korea Technology Innovation Society
• /
• v.1 no.1
• /
• pp.117-124
• /
• 1998

Corporations are pursuing maximum returns from their R&D investment. They are also interested in sound measures to quantify returns. In fact, they use various measures and criteria for measuring returns from the R&D investment. But the fundamental problem is that there is no generic and widely acceptable measures and criteria. To make things more complicated, measures are very powerful and influential to the people in the corporations. Herbert Simon already indicated that people do many things but people usually do their best for the only tasks which are measured. Many researchers, like Chester(1995), are interested in R&D productivity measures and risks because what the company measures really influence R&D people and output. This article present design concepts of the R&D project selection and evaluation system in POSCO(Pohang Iron & Steel Company). This is an output extract from the 6-month joint activities with POSRI(POSCO Research Institute) researchers and POSCO R&D personnel. Process changes, new organizations and new selection and evaluation criteria are developed to improve R&D performance and to enhance technology management of the POSCO. This article covers new selection and evaluation criteria only. We would like to share our experience about how we redesign the selection and evaluation of R&D projects. We also bring insights how we seamlessly integrate 4 different project selection and evaluation steps as a whole. We hope that this case will give you a clue to improve your R&D management.

• STI Policy Review
• /
• v.4 no.2
• /
• pp.41-54
• /
• 2013

R&D is inherently an uncertain endeavor, yet now more than ever those performing R&D with public funding are called upon to clarify the utility of their research. Calls for public accountability are mounting with the increase in constraints on government budgets due to the recent worldwide economic recession, in response to which both policymakers and researchers pay much more attention to rigorously assessing publicly funded R&D. A key issue complicating R&D evaluation in these circumstances is how to adequately account for the nature and degree of risk involved in a given R&D program or project. This study deliberates on certain issues involving the measurement of ex-ante risk in public R&D evaluation: (i) information asymmetry between R&D sponsors and performers, (ii) ambiguity in the measurement of returns in both prospective and retrospective evaluation, and (iii) the dilemma between measurement error and omitted variable bias for empirical estimation of R&D performance. The study then presents an analysis of hypothetical evaluation results that apply risk-relevant weights to the annual evaluation outcomes of South Korea's national R&D programs funded during 2006~2012. In this counterfactual re-evaluation of public R&D program performance, high-risk R&D programs turn out to receive higher evaluation than non-high-risk programs. The current study suggests that R&D evaluation ignoring ex-ante risk is not only conceptually invalid since R&D activities are intrinsically uncertain endeavors, but unfair as R&D performers are asked to be accountable for the results that were in fact out of their reach.

• The Journal of Society for e-Business Studies
• /
• v.17 no.2
• /
• pp.165-187
• /
• 2012

Improvements on the incumbent R&D project management structure and performance evaluation criteria in the telecommunication and broadcasting area have been called for. There have been attempts to develop alternative R&D project performance evaluation criteria. In an attempt to develop an alternative measure, this study integrates two different perspectives on R&D projects and various criteria currently being used by many foreign and domestic institutes. As a result, we have developed an alternative R&D project performance evaluation instrument. Then, we have applied the instrument to Korean cases in order to validate it. The new R&D project performance evaluation criteria can contribute to an improvement on the management of R&D projects in the telecommunication and broadcasting area.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.15 no.7
• /
• pp.4148-4156
• /
• 2014

The aim of this paper was to suggest a national R&D performance measurement index from a new perspective. Government is trying to transit the R&D paradigm from 'catch-up' into 'lead- forward'. The problem of the existing performance evaluation was first identified, and the performance evaluation method of domestic & overseas research center & government was then reviewed. In particular, this study first referred to the creation & innovation indices, and focused on the national innovation and R&D ecosystem. Next, D'Aveni's Hypercompetition theory was applied to suggest a new performance measurement index, and AHP analysis interviewed from the domestic R&D performance evaluation experts was performed. This study contributes to the new national R&D performance index for the creative economy.