• Journal of Korea Technology Innovation Society
• /
• v.13 no.1
• /
• pp.44-67
• /
• 2010

Because of the difficulties on budget estimation of National R&D projects, it is expected that the errors of decision making can be reduced if the information on project performance and its evaluation result is provided to the decision stakeholders in a timely manner, as a reference. In reality, however, the result of project evaluation is not utilized in its own purpose. One reason is that the information on evaluation result and budget is not shared at the right time. The other is that the interconnection between systems to support those information is not realized yet. Therefore, the current status of National R&D projects is analyzed in terms of before and after the reign of current government. In particular, this paper is focused on the improvement through the procedural and systematic approaches and attempted to suggest the enhanced process for the seamless interconnection between National R&D performance evaluation and budget information.

• International conference on construction engineering and project management
• /
• 2013.01a
• /
• pp.608-615
• /
• 2013

The major countries including Korea extend the national investment on R&D and implement the business performance diffusion policy as the knowledge based competition age arrives recently. The necessity for risk management and systematic management system for R&D achievement have been appeared to prevent the failure as the R&D scale becomes larger as it was said. For this matter, the organization such as NASA and DoD in USA defines the Technology Readiness Level (TRL) as a quantitative accomplishment management index and utilize the Technology Readiness Assessment (TRA) system as a criterion. Such tool is evaluated as very effective in the R&D project purposed the practicalization. It is expected that the disadvantage of evaluation system which is oriented to the academic accomplishment in its contents of current research and to contribute greatly to the practicalization of outcomes when such technology readiness level concept is applied to Korean national construction and transportation R&D project. Accordingly, this study analyzed the concept of TRL·TRA, the characteristics and current evaluation management system of Korean national construction and transportation R&D project and suggested the construction and transportation R&D project TRL·TRA performance model to accomplish the practicalization purpose.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.32 no.2
• /
• pp.163-175
• /
• 2007

[ $ulcorner$ ]Cost-Effectiveness Analysis$\lrcorner$ has been wifely used to evaluate economic efficiency of R&D projects, but most of cost-effectiveness evaluation systems have some problems such as systematic method for setting and evaluating cost factors, estimation of single effect on each R&D project, and estimation of cross effects among R&D projects. To solve these problems, we have designed a new evaluation indicator called a $ulcorner$Cost-Cross Effect Integration Indicator$lrcorner$ including cross effects developed in this research. The major research findings are summarized as follows : (1) $ulcorner$Coist Estimation Model$lrcorner$, which estimates the cost factors divided into two classes of assembly product and system product and then integrates the total cost values, has been designed. (2) A new method for estimating parameters of cross effects among R&D projects has been developed. (3) $ulcorner$Cross Effects Estimation Model$lrcorner$ to estimate multi-effects and cross effects by completion time among several projects has been designed. (4) $ulcorner$Integration Estimation Indicator$lrcorner$ for setting priority on a project group has been extracted by combination of total cost value and total effect value.

• Journal of Korean Institute of Industrial Engineers
• /
• v.43 no.2
• /
• pp.100-111
• /
• 2017

Evaluating the performance of R&D Activity is complicated because it is hard to quantify the R&D results unlike the traditional manufacturing or service industries. Recently, to overcome this, process-focused evaluation methods applying the philosophy of quality into R&D environment have been introduced. However, these quality activities are mainly conducted without feedback system after the evaluation work is done. The aim of this study is to present a R&D quality diagnosis framework to obtain the improvement opportunities from R&D process perspective. The research is designed as follows : First, R&D standard process and R&D quality elements are derived from a literature review. Second, the diagnosis objects are obtained by investigating the R&D quality elements at each R&D steps. Third, a two-dimensional diagnosis model, which enables the objective measurement of the 'system compatibility' and 'accomplish level', is presented. The proposed method can provide an effective way to find opportunities for efficient quality improvement of R&D process.

• Journal of Korea Technology Innovation Society
• /
• v.11 no.4
• /
• pp.613-638
• /
• 2008

The Korean government established 'the Act on Performance Evaluation and Management for National Research & Development (R&D) Programs' in 2005, and one year later constructed a master plan, 'A Basic Plan for the Management and Utilization of R&D performance' that focused on better diffusing the public R&D outcomes. In this study we propose a model of performance monitoring, evaluation, and management system for national R&D, which is based on a systematic approach and the logic model that has been prevalently used in planning and evaluating the public programs, to meet the purpose of the law and the master plan as well as to facilitate the diffusion of national R&D outcomes focused mainly on the industrial application technology. Furthermore, in order to use the model for the several applications, the model's specific measures which includes the quantitative methodologies such as analytic hierarchy process (AHP) and data envelopment analysis (DEA) are suggested in accordance with the existing system of the evaluation institution in Korea.

• Korean Journal of Construction Engineering and Management
• /
• v.14 no.4
• /
• pp.118-129
• /
• 2013

Due to the recent surge in natural disasters, with rising social concerns, investment on research & development (R&D) project in natural disaster mitigation area is continuously increasing. However, current R&D performance management system of natural disaster mitigation area does not properly reflect characteristics and social ripple effects of R&D projects. It is indicated that mainly due to the current performance index consists of easy-quantification factors and the performance evaluation system adopts simple aggregation method. Therefore, the purpose of this study is to develop new performance evaluation system considering characteristics and social ripple effects of natural disaster mitigation R&D projects. To this ends, this study derived 3-dimensional performance measurement index through literature review and natural disaster mitigation R&D projects analysis. Finally, based on the derived performance measurement index, this study suggested new and effective performance evaluation system for natural disaster mitigation R&D projects.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.41 no.4
• /
• pp.101-110
• /
• 2018

This study aims to objectively measure the efficiency of nanotechnology R&D programs by systematically evaluating the inputs and outputs of nanotechnology R&D activities and to find implications for improving the efficiency of nanotechnology R&D programs. Data on input factors such as R&D investment, R&D manpower, R&D period, and output factors such as paper, patent, and commercialization for R&D projects which started from 2008 or afterwards and ended by 2011 are gathered through National Science and Technology Knowledge Information Service, which are used for efficiency evaluation. In this study, we analyzed R&D efficiency in detailed technology units in depth. The process taken in this study is as follows. First, the basic statistics of input and output factors to compare and analyze R&D investment, R&D manpower, R&D period, paper, patent, and commercialization status by technology unit are analyzed. Next, DEA models are utilized to derive the overall efficiency, pure technology efficiency, and scale efficiency by conducting the efficiency evaluation for each technology unit, from which implications for strategic budget allocation are derived. In addition, partial efficiency evaluation is conducted to identify advantages and disadvantages of each technology unit. In turn, cluster analysis is performed to identify similar technology units, from which implications for efficiency improvement are derived.

• Journal of Technology Innovation
• /
• v.13 no.3
• /
• pp.175-196
• /
• 2005

This Paper examines analytic studies of the evaluation system used for evaluating government-supported R&D Institutes (GSRIs), and designs a new model for analyzing the evaluation system's effectiveness. The analytic models in existing studies use the meta evaluation and balanced scorecard (BSC) models. However, theses studies focused on the structure and elements of the evaluation system for examples, the appropriateness of the elements within the evaluation system and the balance of the evaluation index. Accordingly, the effectiveness of the GSRI evaluation system, that is, the evaluation's influence on GSRI performance improvement was not analyzed. This study uses the institution theory and contingency theory perspectives as related to government organization management to develop an analytical model of GSRI evaluation system effectiveness. The new model proposes an analytical approach for improving the effectiveness of the GSRI evaluation system in an institutionalized environment.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.32 no.2
• /
• pp.29-37
• /
• 2009

National R&D programs play an important role in the development of a country in this age of the knowledge economy. Since many numbers of R&D programs compete for limited resources such as national R&D budget, the R&D program evaluation problem is a challenging decision-making problem faced by decision makers that deal with R&D management. In this sense, DEA(Data Envelopment Analysis) has been regarded as one of the most widely accepted methods to measure the relative efficiency of productivity of R&D programs. DEA is a methodology to measure and to evaluate the relative efficiency of a homogeneous set of decision-making units(DMUs) in a process which uses multiple inputs to produce multiple outputs. However, the sample of the R&D programs could consist of two or more naturally occurring subsets, thus exhibiting clear signs of heterogeneity such as different objectives. In such situations, the fairness of DEA is limited, for the nature of the relative efficiency of a DMU is likely to be influenced by its membership in a particular subset of the sample. In this study, we propose a methodology AI-DEA(attainment index DEA) allowing for reflecting decision maker's subjective judgement on difference among different subsets of R&D programs which have heterogeneous objectives. This methodology combines AHP and Delphi in order to decide the attainmnet index of each DMU for each outputs, and apply them to DEA model. We illustrate the proposed approach with a pilot evaluation of 13 programs involving 6 different subsets of Korean National R&D programs and compares the results of the original DEA model and AI-DEA model.

• Journal of the Korean Institute of Gas
• /
• v.21 no.6
• /
• pp.81-87
• /
• 2017

SOFC(Solid Oxide Fuel Cell) is one of the high-temperature fuel cells, SOFC system and Stack has a high temperature operating Characteristics. These Characteristics cause a lot of trouble in the design of the system and selection materials, securing durability, and securing safety performance. Therefore, For Commercialization and Supply of SOFC, the development of safety performance assessment techniques and evaluation systems should go together. In this study, we analyzed the evaluation items of SOFC Safety performance standards and risk factors of the stack for design of stack safety performance evaluation system. Based on the analyzed data, the evaluation item was deducted for design of stack safety performance evaluation system. Through the results of this study, we expect to facilitate the supply of SOFC and contribute to a safe use environment.