• Journal of Korea Technology Innovation Society
• /
• v.11 no.4
• /
• pp.613-638
• /
• 2008

The Korean government established 'the Act on Performance Evaluation and Management for National Research & Development (R&D) Programs' in 2005, and one year later constructed a master plan, 'A Basic Plan for the Management and Utilization of R&D performance' that focused on better diffusing the public R&D outcomes. In this study we propose a model of performance monitoring, evaluation, and management system for national R&D, which is based on a systematic approach and the logic model that has been prevalently used in planning and evaluating the public programs, to meet the purpose of the law and the master plan as well as to facilitate the diffusion of national R&D outcomes focused mainly on the industrial application technology. Furthermore, in order to use the model for the several applications, the model's specific measures which includes the quantitative methodologies such as analytic hierarchy process (AHP) and data envelopment analysis (DEA) are suggested in accordance with the existing system of the evaluation institution in Korea.

• Journal of Korea Technology Innovation Society
• /
• v.11 no.3
• /
• pp.376-399
• /
• 2008

Science and technology (S&T) is one of the most important elements in a nation's competitiveness. In an effort to strengthen their national competitiveness, all countries are focusing on upgrading the level of eir S&T. With these factors in mind, Korea has increased its support of national research and development (R&D). In recent years, this added support has resulted in an increased interest in the effectiveness of R&D. We have made continuous efforts to enhance the accountability and effectiveness of R&D by strengthening performance evaluation and considering R&D evaluation results during the budget review (appropriation) process. In order to change to a performance based system, we need to develop objective and scientific indicators to measure and evaluate the quality of the research performance of R&D programs. One of the primary research outcomes is publications. The impact factor of publications is widely used to evaluate overall journal quality and the quality of the papers published therein. However, the use of impact factors has been criticised because they can vary greatly when works from different subject areas are compared. In order to overcome this limitation, we have developed three kinds of qualitative indicators, which are functions of the impact factor. Two of these qualitative indicators, Modified Rank Normalized Impact Factor and Ordinal Rank Normalized Impact Factor, are based on order statistics (rank) for all journals from a specific specialty. The third qualitative indicator, Relative Field Impact Factor, uses the average impact factor of all journals within a subject category. We also suggest a quantitative indicator, Percentage of Contribution. In this study, we suggest 4 indicators and use them to evaluate the performance of outcomes from three R&D programs supported by the Ministry of Education, Science & Technology. We also perform a simulation study to verify the effectiveness of the proposed indicators. It can be shown that the proposed Ordinal Rank Normalized Impact Factor is the most reliable and effective indicator for comparing research performance across subject categories. However, we recommend using previous indicators in combination with the proposed indicators in this study for the research evaluation of R&D programs.

• Journal of Korea Technology Innovation Society
• /
• v.18 no.4
• /
• pp.539-560
• /
• 2015

Korea has enacted the Performance Evaluation law on the R&D Programs since 2006. This study categorizes program size, program history, sustainability, self-evaluation result as antecedents, and analyze the relationship between the antecedents and Meta-evaluation result, the change rate of appropriations. The result shows that program size, program history, self-evaluation result have significant effect to the Meta-evaluation result. And Meta-evaluation result has significant effect to the change rate of appropriations. This study has implication that the performance evaluation system shows significant effect to the appropriations.

• Korean Journal of Construction Engineering and Management
• /
• v.10 no.4
• /
• pp.119-128
• /
• 2009

The construction R&D(Research & Development) has various performance according to research charater. But present performance evaluation form evaluates project rather than charater of research. The important reasons that evaluats the performance are to try conclusions with evaluated objects in the short run, but to forecast the performance of future construction R&D and to get the better performance. Thus this study extracts the RPI(Research Performanc Index) with output as the conter, developes the estimation method and measures the quantitative performance. Applying the ANOVA(Analysis of Variance), it is proved that the performance according to research charater is various. And applying the Correspondence Analysis, it is analised the relationship with performance and research charater. The purposes of this study are to idetify the problem of uniform performance evaluation and to improve it.

• Asian Journal of Innovation and Policy
• /
• v.11 no.3
• /
• pp.342-362
• /
• 2022

The national R&D project is a major strategy for the development of science and technology in the country. This is promoted for the purpose of improving the welfare of the people, such as creating jobs and fostering small and medium-sized enterprises, through the results of science and technology research conducted with support from the national budget. Therefore, analysis of the performance evaluation and budgeting system of the current national R&D project is one of the essential parts of preparing a system improvement plan. This study derived improvement plans through a comparative analysis of national R&D project performance evaluation and budget systems in Korea and leading countries such as the United States and Japan. As a result, it was confirmed that it may be difficult to derive innovative research results due to the lack of sustainability and a short period of time to require quantitative performance. To overcome these difficulties, the need for system improvement as follows was suggested. First, it is necessary to enlarge and prolong national R&D projects. Second, a plan for securing sustainability is needed in consideration of the main characteristics of each research field. Finally, it is necessary to strengthen the linkage between organizations in charge of national R&D projects. And also, there is a need for a system that can continuously identify problems and improve the system. In addition, the constitutional amendment will be necessary to separate science and technology from economic development, which states that Article 127, Paragraph 1, "Science and technology should be subordinated to economic development," which is the science and technology article of the current constitution.

• 한국정보디스플레이학회:학술대회논문집
• /
• 2008.10a
• /
• pp.700-702
• /
• 2008

A new evaluation method which named 'Security Viewing Angle Factor (SVAF)' was suggested for VIC (Viewing-angle Image Control) technology to quantify a visual hiding performance of LCD. Currently, Contrast Ration (CR) is the general method to evaluate VIC technology. However, CR shows a significant difference when compared with the result of human visual system. Furthermore, a perceptional evaluation method and its conditions were established.

• Journal of the Korean Regional Science Association
• /
• v.32 no.4
• /
• pp.3-18
• /
• 2016

National research and development(R&D) project plays an important role in the economic growth of a country as well as a company. This article aim to examine the development of the performance evaluation framework for assessing the contribution of national research and development(R&D) program to productivity growth. The main idea of this paper begins with the employment of between-group analysis for evaluating the returns to R&D. The method of this study is based on the comparison of productivity growth between different groups with time series data, not cross-sectional approach with one period. In these regards, backward effect and forward effect are operationally defined as a measurement for contributions of R&D in this study. The results of analysis gives that the outcomes of between-group analysis shows the lower performance of R&D compared to the within-group analysis. while the difference was not especially evident with the case of operating profit variable, but sales variable.

• Journal of Internet Computing and Services
• /
• v.24 no.6
• /
• pp.31-39
• /
• 2023

The purpose of this study is to propose a scientific performance evaluation framework for measuring and managing the overall outcome of complex types of projects that are linked to public demand-based commercialization, such as information system projects and public procurement, in integrated national R&D projects. In the case of integrated national R&D projects that involve multiple research institutes to form a single final product, and in the case of demand-based demonstration and commercialization of the project results, the existing evaluation system that evaluates performance based on the short-term outputs of the detailed tasks comprising the R&D project has limitations in evaluating the mid- and long-term effects and practicality of the integrated research products. (Moreover, as the paradigm of national R&D projects is changing to a mission-oriented one that emphasizes efficiency, there is a need to change the performance evaluation of national R&D projects to focus on the effectiveness and practicality of the results.) In this study, we propose a performance evaluation framework from a structural perspective to evaluate the completeness of each national R&D project from a practical perspective, such as its effectiveness, beyond simple short-term output, by utilizing the Hourglass model. In particular, it presents an integrated performance evaluation framework that links the top-down and bottom-up approaches leading to Tool-System-Service-Effect according to the structure of R&D projects. By applying the proposed detailed evaluation indicators and performance evaluation frame to actual national R&D projects, the validity of the indicators and the effectiveness of the proposed performance evaluation frame were verified, and these results are expected to provide academic, policy, and industrial implications for the performance evaluation system of national R&D projects that emphasize efficiency in the future.

• Journal of Korean Society for Quality Management
• /
• v.30 no.2
• /
• pp.1-10
• /
• 2002

A performance evaluation model of an R&D module in the quality management system for M Company Is constructed using QFD. The company produces telecommunication devices and employs the performance evaluation model based on ISO 9000 family. However, the model has some problems, one of them is that all check items are regarded as equally important Customer requirements are gathered from internal customers and QFD is utilized to obtain weights for each check item.

• IE interfaces
• /
• v.24 no.4
• /
• pp.314-322
• /
• 2011

This study analyzes a relationship between Data Envelopment Analysis(DEA) efficiency scores and a normalization index in order to examine the validity of DEA models. A normalization index concerned in this study is 'sales per R&D project fund' which is regarded as a crucial R&D project performance evaluation index in practice. For this correlation analysis, three distinct DEA models are selected such as DEA basic model, DEA/AR-I revised model(i.e. DEA basic model with Acceptance Region Type I constraints) and Super-Efficiency(SE) model. Especially, SE model is adopted where efficient R&D projects(i.e. Decision Making Units, DMU's) with DEA efficiency score of unity from DEA basic model can be further differentiated in ranks. Considering the non-normality and outliers, two rank correlation coefficients such as Spearman's ${\rho}_s$ and Kendall's ${\tau}_B$ are investigated in addition to Pearson's ${\gamma}$. With an up-to-date empirical massive dataset of n = 482 R&D projects associated with R&D Loan Program of Korea Information Communication Promotion Fund in the year of 2011, statistically significant (+) correlations are verified between the normalization index and every model's DEA efficiency scores with all three correlation coefficients. Especially, the congruence verified in this empirical analysis can be a useful reference for enhancing the practitioner's acceptability onto DEA efficiency scores as a real-world R&D project performance evaluation index.