• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.21 no.4
• /
• pp.471-478
• /
• 2020

This study aimed to suggest implications for the future development of agricultural R&D through a priority analysis of excellent agricultural R&D performance considering productivity, marketability, and effects on region, which are important factors of agricultural R&D evaluation. The subjects of analysis were R&D of Rural Development Administration (RDA), which was selected as national R&D excellent Performance from 2006 to 2018, and the priority was analyzed using Analytic Hierarchy Process (AHP). The results are as follows. First, the relative importance of the criteria decreased in the order of marketability(0.423) > regional impact(0.360) > productivity(0.216). Second, as a result of analyzing the relative importance of the sub-criteria, the possibility of commercialization(0.515) was high in the category of marketability. The possibility of technology expansion(0.538) was high in the category of effects on region and the quality improvement(0.464) was high in the category of productivity. Third, the excellent agricultural R&D performance that had high relative importance was the technologies associated with improving the agricultural competitiveness of horticultural crops.

• Asia-Pacific Journal of Business Venturing and Entrepreneurship
• /
• v.4 no.4
• /
• pp.1-25
• /
• 2009

The Government is putting efforts to enhance efficiency and productivity of performances of National R&D Programs by enacting 'Law on Evaluation and Management of Performances of National R&D Program'. This study is the result of development of evaluation model and indices for analysis of efficiency through meta evaluation method for the specific evaluation among evaluation systems for National R&D Program that are being carried out at government-wide level. Meta evaluation model for analysis of efficiency of evaluation system for National R&D Program designed evaluation indices by categorizing compositional factors into 5 categories, namely, evaluation context factor, evaluation resources factor, evaluation process factor, evaluation result factor and evaluation utilization factor. Furthermore, the result of verification of reliability on evaluation composition factors and evaluation indices analyzed to select evaluation items displayed Cronbach' $\alpha$ coefficient of 0.933, thereby illustrating that there is no major problem in the evaluation index system. In addition, computation of weight for each evaluation composition factor and evaluation index was analyzed by using analytical hierarchy process (AHP) technique. The result of analysis displayed overall consistency index of less than 0.1 for the investigators, thereby enabling analysis that there is consistency in investigators.

• Journal of Industrial Convergence
• /
• v.20 no.2
• /
• pp.1-9
• /
• 2022

As the need for improvement of transparency and fairness in the selection of national R&D projects has been continuously raised, we analyzed the impact on the evaluation selection results by evaluation indexes for The land transportation technology commercialization support project and searched for ways to improve indexes using the analysis results. As for the research data, it were applied as selection results of new R&D projects and evaluation indexes in two fields(SME innovation and start-up) in 2021. Logistic regression analysis is used for the influence of each evaluation indexes on the evaluation result, and for the regression model, evaluation indexes with low influence are removed in advance through artificial neural network multiple perceptron analysis to improve the reliability of the analysis results. As a result of the analysis, in the field of SME innovation, the influence of the evaluation index on the workforce planning was the lowest and the influence of the appropriateness of commercialization promotion plan was the highest. In the start-up field, the influence of the evaluation indexes for technology development suitability, marketability, and suitability for carrying out the project were estimated to be similar to each other, and the influence of the technology evaluation index was found to be the lowest. The analysis results of this thesis suggest the need for continuous improvement of selection and evaluation indexes, and by using the analysis results to select a fair R&D institution according to the selection of appropriate indexes, it will be possible to contribute to deriving excellent research results and fostering excellent companies in the field of land transportation.

• Journal of Korea Technology Innovation Society
• /
• v.11 no.3
• /
• pp.376-399
• /
• 2008

Science and technology (S&T) is one of the most important elements in a nation's competitiveness. In an effort to strengthen their national competitiveness, all countries are focusing on upgrading the level of eir S&T. With these factors in mind, Korea has increased its support of national research and development (R&D). In recent years, this added support has resulted in an increased interest in the effectiveness of R&D. We have made continuous efforts to enhance the accountability and effectiveness of R&D by strengthening performance evaluation and considering R&D evaluation results during the budget review (appropriation) process. In order to change to a performance based system, we need to develop objective and scientific indicators to measure and evaluate the quality of the research performance of R&D programs. One of the primary research outcomes is publications. The impact factor of publications is widely used to evaluate overall journal quality and the quality of the papers published therein. However, the use of impact factors has been criticised because they can vary greatly when works from different subject areas are compared. In order to overcome this limitation, we have developed three kinds of qualitative indicators, which are functions of the impact factor. Two of these qualitative indicators, Modified Rank Normalized Impact Factor and Ordinal Rank Normalized Impact Factor, are based on order statistics (rank) for all journals from a specific specialty. The third qualitative indicator, Relative Field Impact Factor, uses the average impact factor of all journals within a subject category. We also suggest a quantitative indicator, Percentage of Contribution. In this study, we suggest 4 indicators and use them to evaluate the performance of outcomes from three R&D programs supported by the Ministry of Education, Science & Technology. We also perform a simulation study to verify the effectiveness of the proposed indicators. It can be shown that the proposed Ordinal Rank Normalized Impact Factor is the most reliable and effective indicator for comparing research performance across subject categories. However, we recommend using previous indicators in combination with the proposed indicators in this study for the research evaluation of R&D programs.

• Proceedings of the Korean Institute Of Construction Engineering and Management
• /
• 2007.11a
• /
• pp.255-260
• /
• 2007

The construction industry has been recognized as lagging behind other industries in the area of research and development (R&D) due primarily to the lack of R&D funds. To overcome this situation, the Korea Ministry of Construction and Transportation has a plan to expand its investments on the construction R&D up to 1.72 billion US dollars over the next 3 years. Despite this effort, it is still challenging to conduct the quantitative measurement on the efficiency of construction R&D projects, which can be utilized as the objective basis in the reasonable selection of a promising R&D team or in the consequential evaluation of a R&D performance. This study aims to conduct the efficiency analysis on the construction R&D projects to provide the basis for evaluating the performance of research and development. Toward this end, this study performs an efficiency analysis, which reflects all of the input and output data into/from the construction R&D by utilizing the Data Envelopment Analysis (DEA). The proposed methodology can be utilized to make a better decision on the priority of the R&D investments and present a sound basis to suggest the areas to be improved so as to reduce the inefficiency of R&D projects.

• Journal of Technology Innovation
• /
• v.31 no.3
• /
• pp.171-199
• /
• 2023

The purpose of this study was to develop an evaluation tool for selecting new projects for R&D project planning level of K Research Institute. For this purpose, items and questions for R&D project selection evaluation were developed based on the CIPP model and previous studies on selection evaluation and evaluation indicators for research project evaluation, and then two Delphi surveys were conducted. The developed evaluation tool was surveyed by 13 experts to verify contents validity ratio, convergence and consensus. The finally selected evaluation tool for R&D project planning consisted of 21 questions in 8 items, including 5 questions for context evaluation, 2 questions for input evaluation, 8 questions for process evaluation, and 6 questions for product evaluation. The evaluation tool developed will contribute to the solution of problems in the bottom-up planning process and to the improvement of the planning competence of the researchers. It will also contribute to improve the consistency and efficiency of evaluation during the selection process.

• Annual Conference of KIPS
• /
• 2011.11a
• /
• pp.209-212
• /
• 2011

국가의 미래지향적 정책을 위해서는 무엇보다도 이를 선도해나아갈 핵심인재의 확보가 매우 중요하다. 이러한 핵심인재 확보를 위해 각 부처에서는 지역 R&D 인력양성과 관련된 사업이 진행 중에 있다. 지역 R&D 인력양성사업의 전담기관은 시기와 목적에 따라 변경될 수 있으며, 변경될 때마다 사업목적과 수단이 부합하는지를 점검하기 위하여 사업성과를 객관적으로 분석 및 평가하고 그 결과를 새로운 사업계획 설계에 반영할 필요성이 제기되어 왔다. 그러나, 지역 R&D 인력양성사업은 전담기관 및 사업의 성격에 따라 성과분석 모형을 다르게 적용해 왔으며, 객관적 성과 분석 프레임워크가 부재하다. 따라서, 본 논문에서는 인력양성사업의 특성을 파악하여 객관적으로 분석 및 평가에 활용할 수 있는 성과 분석 모형을 설계하고자 한다.

• Journal of Korea Technology Innovation Society
• /
• v.11 no.2
• /
• pp.287-313
• /
• 2008

Even though the pre-feasibility study was introduced in 1998, it mainly has focused on transportation social overhead capital(SOC) such as road and railroad. Last year, however, the government newly launched R&D project area for the pre-feasibility study. This paper tries to analyze the pre-feasibility study methodology and system that applied to R&D facility, cluster, and sized R&D infrastructure projects. In depth study of economic, policy, and AHP analysis, this paper shows that the preliminary feasibility study have some caveats and suggests a way of improvement for making up for limitation. Main suggestions are as follows; First, to improve the fit in R&D sector analysis, using consistent method is important. Second, technology analysis is essential for R&D evaluation. Third, technology experts should take part in AHP analysis.

• The Journal of the Korea Contents Association
• /
• v.13 no.6
• /
• pp.401-411
• /
• 2013

Selection of profitable research and development (R&D) projects is one of the major factors affecting sustained growth of firms and countries. This paper analyze what influences the knowledge on the business model exerted on selection of a R&D project. A business model converts the technology value to the customer value, and comprehensively describes the target customers for commercializing a new technology, core values, behaviors within organizations, resources, and external partners. Thus, understanding a business model would make R&D project evaluators place the feasibility and profitability of the business above the merits of the proposed technology in evaluating the technology development. To verify this hypothesis, we had 78 R&D project evaluators acquire the knowledge on the business model and measured how their criteria for R&D project selection have changed using the AHP method. The results shows that feasibility and profitability are more important than the merit of proposed technology, especially capability of company and business development are more important than the levels of technology innovation.

• Journal of the Korea Institute of Building Construction
• /
• v.10 no.3
• /
• pp.71-81
• /
• 2010

In 1994, Korean construction research and development (R&D) projects received investments amounting to 1.2 billion KRW, an amount that rose to 164.8 billion KRW in 2007. Under the current system, construction researchers submit the application records of Construction Research and Development (R&D) in construction projects to the Korea Institute of Construction & Transportation Technology Evaluation and Planning. The performance of Construction R&D projects has thus been dependent on the subjective reporting of the results by the researchers themselves. For this reason, it is difficult to secure confidence in the records of Construction Research and Development. Therefore, this research suggested measures for revitalizing Construction Research and Development, analyzed approaches to cost-saving in Construction Research and Development, and analyzed economic effectiveness in the results of construction R&D.