• 기술혁신연구
• /
• 제15권1호
• /
• pp.87-113
• /
• 2007

For the realization of the national self-defense, the trend of the defense R&D projects becomes global and diverse with the increase of their budget. Thus, for the effective execution of the budget and the successful performance of the projects, the importance of selection, management and evaluation of the R&D projects is emphasized. This study suggests the applicability of a meta-evaluation model for the realization of the successful defense R&D project evaluation system. This study focused on the development of the meta-evaluation model design which can be applicable to the national defense R&D projects. Using the proposed meta-evaluation model, we propose a technique to enhance the fairness and the reliability of the national defense R&D projects evaluation system.

• 기술혁신학회지
• /
• 제12권4호
• /
• pp.819-839
• /
• 2009

R&D 규모의 확대는 평가의 효과성과 효율성 제고가 전제이다. R&D 예산 및 사업에 관한 시스템 평가는 예산의 조정 배분과 사업의 성과에 대한 평가로 구분된다. 이 논문은 예산의 조정 배분과 관련한 예산평가 시스템의 운영 측면에서 효율성 및 효과성을 제고하는 것에 중점을 둔 연구이다. 예산평가 시스템의 핵심 관점은 두 가지이다. 하나는 후행단계에서 이루어지는 사업에 대한 조사 분석과 평가의 관점을 예산평가에 보다 긴밀하게 연계시키는 것이며, 다른 하나는 이를 위해서 전반적인 종합조정의 시스템을 재조명하는 것이다. 예산은 정책 기획 집행으로 연결되는 과정이다. 사업을 매개체로 하여 정책에 부합하는 기획내용에 따라 예산을 활용하여 집행하는 것이 바람직한 것이다. 따라서 연구개발사업의 구조 체계와 예산항목(코드) 구조와의 연계 강화가 중요하다. 이것은 의사결정 시스템 차원에서 정책과 예산의 연계와 함께 이루어져야 한다. 또한 예산의 조정 배분, 정책과 사업의 성과평가, 연구개발사업 조사 분석 관련 시스템 상의 연계 강화와 운영일정에 대한 개선이 필요하다. 이를 위해서는 국가과학기술위원회(NSTC)의 기능이 정책기획 중심이 되어야 하며 정책부터 평가까지의 전과정상 객관성과 공정성이 확보될 수 있는 운영지원 체계로 개편되어야 한다. 조정 배분과 성과평가가 유기적으로 연계되는 평가 시스템이 되려면 이들의 집행일정과 조사 분석의 내용과 시기가 보다 효용성이 높아져야 한다.

• 한국벤처창업학회:학술대회논문집
• /
• 한국벤처창업학회 2009년도 통합학술대회
• /
• pp.5-24
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as 'Good'. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as 'Very Good'. The evaluation input component gained 73.1 points out of 100, so it was evaluated as 'Good'. The evaluation process component gained 74.8 points out of 100, so it was evaluated as 'Good'. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D Programs.

• 디지털융복합연구
• /
• 제11권4호
• /
• pp.77-90
• /
• 2013

이 연구의 목적은 주요국의 정부 연구개발 평가제도 개선을 위한 최근 경향을 살펴 봄으로써 우리나라의 R&D평가제도 선진화를 위한 시사점을 모색하기 위함이다. 이 연구는 우리나라의 연구개발평가제도의 현황과 과제를 살펴보고, R&D 투자 상위국의 최근 연구개발사업 평가제도와 비교 분석하는 방식으로 수행되었다. 우리나라는 2006년 국가연구개발 성과평가법이 제정됨에 따라 연구개발사업 평가제도가 도입 운영되고 있다. 미국은 오바마 정부가 들어서면서 종전의 정부성과관리법을 개정('GPRA 현대화법 2010')하여 중점성과목표 관리제도를 강화하였으며, 일본은 2012년 말 '국가연구개발평가에 관한 대강적 지침'을 개정하여 연구개발 프로그램 및 결과지표 개념을 도입하였다. EU에서는 1984년부터 시작된 R&D 프레임워크프로그램(FP)에 대한 평가체계를 지속적으로 개선해 나가고 있다. 주요국의 연구개발 평가와 관련된 최근 동향으로부터 다음과 같은 시사점을 찾을 수 있다. 현행 연구개발사업 평가가 국가 과학기술정책과 기관의 고유임무 성과평가와도 연계성을 가질 수 있는 평가체계로 발전시켜 나가는 것이 중요하다. 또한 국제적인 평가연구 네트워크에 지속적인 참여 확대와 교류 활동을 통해 R&D 평가에 관한 선진 기법들을 적극적으로 수집하고, 나아가 R&D 성과관리에 관한 역량강화 프로그램과 체계적인 평가전문가 인력육성 교육시스템도 필요하다.

• Journal of Information Science Theory and Practice
• /
• 제10권spc호
• /
• pp.96-111
• /
• 2022

With the rapid development of the Fourth Industrial Revolution and digital transformation, scientific and technological innovation measures are being devised to overcome Korea's low-growth, high-cost structure. Accordingly, by examining the R&D investment evaluation system of R&D PIE (R&D Platform for Investment and Evaluation), which has been promoted by the Korean government in response to the Fourth Industrial Revolution, from the perspective of R&D transformation, this study aims to explore a new path for a sustainable national science and technology innovation system following digital transformation. In particular, from the perspective of R&D PIE, a MLP (Multi-level Perspective), which had been conducted as an abstract theoretical study, was attempted with specific cases and analysis for each of the three layers: niche, landscape, and regime. In conclusion, R&D PIE was intended to elevate the abstract R&D investment evaluation system to a platform that leads innovation in the digital space of the Fourth Industrial Revolution. In addition, it was confirmed that the R&D PIE could be replaced or enhanced as a platform for innovation in response to the Fourth Industrial Revolution, thereby providing an alternative to job creation and an escape from economic crisis.

• Asian Journal of Innovation and Policy
• /
• 제9권3호
• /
• pp.281-307
• /
• 2020

A variety of approaches are being applied to improve the existing ex-ante evaluation by expert panels in publicly funded R&D. While the objective evaluation criteria are constantly being improved to screen and select the superior projects, alternative approaches such as random prioritization and logical modeling are also underway to overcome the conservative bias of reviewers and to secure disruptive innovation. This study intends to find critical implications for ex-ante evaluation of public R&D system from the comparison of Indonesia and Korea. For the comparative analysis, literature review and expert in-depth interviews are conducted on the national R&D system and the selection evaluation process. In Korea, the selection criteria of projects are legally promulgated for establishing an objective evaluation system, and at the program level, the major considerations in the planning process are specified by Presidential Decree. On the other hand, while Indonesia conducts R&D in 47 strategic fields largely by public research institutes (PRI) based on the non-competitive government contributions. This study draws out implications of institutionalizing the planning process at the level of program, and of increasing the ratio of contract-based competitive funding at the level of project in the national R&D portfolio.

• 한국정보시스템학회지:정보시스템연구
• /
• 제19권2호
• /
• pp.73-95
• /
• 2010

This study shows the scientific and systematic Evaluation Model using factor analysis and AHP methods for the success of defense Information System R&D projects. The evaluation model was divided into 7 evaluation factors such as Developing support, Developing infrastructure, Developing management and test & evaluation, Support factors for strength, Understanding & developing strategy, Developing technology & organization, and Developing performance. And those were composed of totally 24 low level Evaluation index. The Developed Evaluation Model in the paper could be contributed more to objectively and transparently company selection of defense Information System R&D and other defense R&D Projects in the future.

• 기술혁신학회지
• /
• 제14권4호
• /
• pp.937-964
• /
• 2011

이 연구는 농업 연구개발사업의 객관적인 성과와는 달리 농촌진흥청의 역할에 대한 논의가 끊이지 않고 있는 문제의식에서 출발하고 있다. 이에 따라 농업 연구개발사업의 핵심 주체인 농촌진흥청의 내부 연구개발 평가체계를 대상으로 평가기조, 평가자원, 평가수행, 평가활용이라는 4가지 관점에서 메타 평가를 수행하였다. 연구결과는 평가기조에 해당하는 평가대상의 설정이 최하위 수준인 세부 연구과제로 설정되어 있다는 점이 가장 큰 문제로 분석되었다. 따라서 이 연구는 우선적으로 평가목적과 평가대상 등의 평가기조를 과학기술정책 및 평가정책 등의 외부의 정책환경 변화와 조응할 수 있는 방향으로 전환함으로서 현행 농업 연구개발사업의 평가제도를 성과지향적으로 발전시키기 위한 정책대안을 논의하였다.

• 산업경영시스템학회지
• /
• 제32권3호
• /
• pp.59-70
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea by using meta evaluating indicators. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as 'Good'. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as 'Very Good'. The evaluation input component gained 73.1 points out of 100, so it was evaluated as 'Good'. The evaluation process component gained 74.8 points out of 100, so it was evaluated as 'Good'. And the evaluation outcome component gained 69.0 points out of 100, so it was evaluated as 'Good'. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adopting the result of experts who performed evaluations for defense R&D programs in recent years. The reliability of components and items was verified by Cronbach's a coefficient. It was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D programs. The ultimate objective of this study is to manage the programs effectively and improve the reliability and the objectiveness of the defense R&D programs.

• 기술혁신학회지
• /
• 제3권2호
• /
• pp.48-60
• /
• 2000

An effort has been made in this paper to measure the project manager's reaction to R&D project evaluation and present the useful information related to rebuilding an R&D evaluation system. Results of this study show that project manager's reaction is related to the selection of reasonable items for evaluation, the rater's expertise, the project manager's participation in evaluation process and so on. Accordingly, managers of the research institute have to set up the evaluation system after deeply considering these results.