• Journal of Technology Innovation
• /
• v.10 no.1
• /
• pp.201-217
• /
• 2002

Researchers, institutes, and government involved in research & development (R&D) are faced with the problem of performing R&D project evaluations. As a real-word case of evaluation, we elicited and reproduced the evaluation process of the national nuclear R&D projects, using a specific case study of Korea. In the methodology, the analytic hierarchy process (AHP) is employed to evaluate and rank the selected nuclear R&D projects which have a wide range of evaluation objectives and characteristics. As a result, we obtained relative ranking for research projects and importance of evaluation criteria. The method and implications can be easily understood and applied by practitioners since it follows naturally the standard practice of evaluating and relative comparisons of performance using evaluation procedures. By applying particular R&D project output to the procedures, project evaluators can compare and prioritize evaluation objectives.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.10 no.3
• /
• pp.79-89
• /
• 2007

This study suggests the applicability of an AHP(Analytic Hierarchy Process) to improve the validity and fairness of evaluation index to assess the defense core-technology R&D projects. This study focused on the design of the proposal and performance evaluation index to structure them into a hierarchy using AHP which can be applicable to take the opinion of the defense R&D experts. Using the refined evaluation index, we propose a technique to enhance the reliability of the defense R&D projects evaluation system.

• Journal of Korea Technology Innovation Society
• /
• v.9 no.3
• /
• pp.391-411
• /
• 2006

The purpose of this report is to suggest a new set of evaluation criteria which emphasizes the aspects of outputs and outcomes, and, therefore, reflects a portion of unique features of the KFDA's R&D programmes. Using the criteria, we demonstrate that the overall performance of KFDA's R&D programmes should be re-evaluated, and underscore that the characteristics and mission of a specific institute is also important in evaluating its performance. The results reveal that the overall performance of KFDA's R&D effort is more positive than what has been known. This difference essentially stems from the difference between the present that are universal but stiw and the suggested criteria that are based on missions of and results possibly achieved by the institute. In this regard the approach used in this case study could be taken into account in improving the evaluation system of government R&D programmes.

• Journal of Digital Convergence
• /
• v.15 no.5
• /
• pp.151-159
• /
• 2017

This paper proposes various policies for improving the process of performance analysis on R&D expenditure of the public funds in the Korean ICT industry. In order to do so, this paper figures out the present issues relating to performance indicators, methodologies for performance evaluation, release and comparison of evaluation results, follow-up study, integrated management system for performance analysis in ICT industry. In this paper, we suggest some new policies such as consulting an expert for improving performance indicators, maintaining the pre-determined performance indicators, introducing the qualitative performance indicators for measuring effectiveness, adopting the new methodologies reflecting R&D characteristics, introducing the new performance index for comparing annual performance, requiring follow-up study for major ICT R&D, introducing the independent and temporary organization for R&D performance analysis in ICT industry. In conclusion, these new policies will raise effectiveness and efficiency of the government R&D expenditure in ICT industry as well as strengthen the industry competitiveness.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.41 no.4
• /
• pp.101-110
• /
• 2018

This study aims to objectively measure the efficiency of nanotechnology R&D programs by systematically evaluating the inputs and outputs of nanotechnology R&D activities and to find implications for improving the efficiency of nanotechnology R&D programs. Data on input factors such as R&D investment, R&D manpower, R&D period, and output factors such as paper, patent, and commercialization for R&D projects which started from 2008 or afterwards and ended by 2011 are gathered through National Science and Technology Knowledge Information Service, which are used for efficiency evaluation. In this study, we analyzed R&D efficiency in detailed technology units in depth. The process taken in this study is as follows. First, the basic statistics of input and output factors to compare and analyze R&D investment, R&D manpower, R&D period, paper, patent, and commercialization status by technology unit are analyzed. Next, DEA models are utilized to derive the overall efficiency, pure technology efficiency, and scale efficiency by conducting the efficiency evaluation for each technology unit, from which implications for strategic budget allocation are derived. In addition, partial efficiency evaluation is conducted to identify advantages and disadvantages of each technology unit. In turn, cluster analysis is performed to identify similar technology units, from which implications for efficiency improvement are derived.

• Journal of Korean Society for Quality Management
• /
• v.50 no.4
• /
• pp.665-677
• /
• 2022

Purpose: The purpose of this study is to analyze the current status and investigate relevant indicators so that R&D performance evaluation suitable for government-funded research institutes can proceed. A suitable performance evaluation model was presented based on the surveyed indicators. Based on the presented performance evaluation model, the importance was analyzed to calculate the weight for each indicator of the performance evaluation model. Methods: The method applied in this study presented a performance evaluation model based on the organizational performance evaluation cases of advanced overseas countries. By using the AHP(Analytic Hierarchy Process) technique, the weight of each indicator of the performance evaluation model was studied. Results: As a result of examining the indicators necessary for the evaluation model, focusing on overseas cases, 13 evaluation items were derived. A weight was calculated for the importance of the study results. And the scientific/technical research results showed the highest excellence. Conclusion: Key indicators of performance evaluation suitable for government-funded research institutes were derived and presented through detailed modeling in three stages. A realistic model that can objectively evaluate the performance of government-funded research institutes was proposed using the AHP technique.

• Journal of Korean Institute of Industrial Engineers
• /
• v.41 no.5
• /
• pp.425-438
• /
• 2015

This study proposes a three-stage model of R&BD performance which captures commercialization outcomes as well as conventional R&D performance. The model is composed of three factors : inputs (R&D budgets and researchers), outputs (patents and papers), and outcomes (technical fees, products sales, and cost savings). Three stages are defined for each transformation process between the three factors : efficiency stage from input to output (stage 1), effectiveness stage from output to outcome (stage 2), and productivity stage from input to outcome (stage 3). The performance of each stage is measured by data envelopment analysis (DEA). DEA is a non-parametric efficiency measurement technique that has widely been used in R&D performance measurement. We measure the performance of 171 projects of 6 public R&BD programs managed by Seoul Business Agency using the proposed three-stage model. In order to provide a balanced and holistic view of R&BD performance, the R&BD performance map is also constructed based on performance of efficiency and productivity stages.

• KIPS Transactions on Computer and Communication Systems
• /
• v.7 no.7
• /
• pp.165-174
• /
• 2018

The purpose of this study is to verify the effects of R&D process maturity on product development performance and to verify whether R&D project performance mediating effect. The questionnaire was collected and analyzed to 131 persons related to the R&D work in 55 companies and public institutions performing R&D work. The results of this study are as follows, the effect of R&D process maturity on product development performance and mediating effect of R&D project performance were analyzed by simple and multiple regression analysis. Regression analysis was analyzed by SPSS statistical program. The higher the maturity level of the R&D process, the higher the product development performance and the R&D project performance, and the R&D project performance is partially mediated. It is concluded that it is important to establish and operate a systematic R&D process and to develop a project management methodology suitable for the characteristics of a company in order to improve product development performance. It is expected that if this study are utilized as practical R&D management methodology in corporate management, it will contribute to improvement of company product performance.

• Journal of Mechanical Science and Technology
• /
• v.20 no.3
• /
• pp.329-334
• /
• 2006

This paper presents the evaluation of LPG (Liquefied petroleum gas) regulators for home use. For the evaluation, several properties of the regulators were experimentally analyzed, such as the operation of safety device, the adjusting and lock-up pressure, the adjusting spring and the diaphragm, with respect to the used time of the regulators. Experimental results showed that the initial operation performances of regulators were degraded with increase of the service time and also showed that the degradation of the performance and material property could become serious after about six-year-use of the regulators.

• International conference on construction engineering and project management
• /
• 2013.01a
• /
• pp.608-615
• /
• 2013

The major countries including Korea extend the national investment on R&D and implement the business performance diffusion policy as the knowledge based competition age arrives recently. The necessity for risk management and systematic management system for R&D achievement have been appeared to prevent the failure as the R&D scale becomes larger as it was said. For this matter, the organization such as NASA and DoD in USA defines the Technology Readiness Level (TRL) as a quantitative accomplishment management index and utilize the Technology Readiness Assessment (TRA) system as a criterion. Such tool is evaluated as very effective in the R&D project purposed the practicalization. It is expected that the disadvantage of evaluation system which is oriented to the academic accomplishment in its contents of current research and to contribute greatly to the practicalization of outcomes when such technology readiness level concept is applied to Korean national construction and transportation R&D project. Accordingly, this study analyzed the concept of TRL·TRA, the characteristics and current evaluation management system of Korean national construction and transportation R&D project and suggested the construction and transportation R&D project TRL·TRA performance model to accomplish the practicalization purpose.