• Asian Journal of Innovation and Policy
• /
• 제9권3호
• /
• pp.281-307
• /
• 2020

A variety of approaches are being applied to improve the existing ex-ante evaluation by expert panels in publicly funded R&D. While the objective evaluation criteria are constantly being improved to screen and select the superior projects, alternative approaches such as random prioritization and logical modeling are also underway to overcome the conservative bias of reviewers and to secure disruptive innovation. This study intends to find critical implications for ex-ante evaluation of public R&D system from the comparison of Indonesia and Korea. For the comparative analysis, literature review and expert in-depth interviews are conducted on the national R&D system and the selection evaluation process. In Korea, the selection criteria of projects are legally promulgated for establishing an objective evaluation system, and at the program level, the major considerations in the planning process are specified by Presidential Decree. On the other hand, while Indonesia conducts R&D in 47 strategic fields largely by public research institutes (PRI) based on the non-competitive government contributions. This study draws out implications of institutionalizing the planning process at the level of program, and of increasing the ratio of contract-based competitive funding at the level of project in the national R&D portfolio.

• 환경영향평가
• /
• 제15권1호
• /
• pp.13-22
• /
• 2006

The Korean government adopted the integrated stream water management policy recently with growing perception that natural disasters and pollution in Korea have been due not only to such human factors as urbanization and industrialization, but also to the policy of functionally separated management of irrigation, flood control and ecological management. Contrary to its good intention, research result shows that it is not realistic to expect that this new integrated policy in Korea will work well. In order to be an effective policy and program evaluation, this paper suggests that evaluation indicator on related programs and projects should be made through bottom-up process. For example, environmental benefit should be taken into account rather than just economic benefit, and cultural and social characteristics in the project region should be also considered seriously.

• 기술혁신학회지
• /
• 제12권4호
• /
• pp.819-839
• /
• 2009

R&D 규모의 확대는 평가의 효과성과 효율성 제고가 전제이다. R&D 예산 및 사업에 관한 시스템 평가는 예산의 조정 배분과 사업의 성과에 대한 평가로 구분된다. 이 논문은 예산의 조정 배분과 관련한 예산평가 시스템의 운영 측면에서 효율성 및 효과성을 제고하는 것에 중점을 둔 연구이다. 예산평가 시스템의 핵심 관점은 두 가지이다. 하나는 후행단계에서 이루어지는 사업에 대한 조사 분석과 평가의 관점을 예산평가에 보다 긴밀하게 연계시키는 것이며, 다른 하나는 이를 위해서 전반적인 종합조정의 시스템을 재조명하는 것이다. 예산은 정책 기획 집행으로 연결되는 과정이다. 사업을 매개체로 하여 정책에 부합하는 기획내용에 따라 예산을 활용하여 집행하는 것이 바람직한 것이다. 따라서 연구개발사업의 구조 체계와 예산항목(코드) 구조와의 연계 강화가 중요하다. 이것은 의사결정 시스템 차원에서 정책과 예산의 연계와 함께 이루어져야 한다. 또한 예산의 조정 배분, 정책과 사업의 성과평가, 연구개발사업 조사 분석 관련 시스템 상의 연계 강화와 운영일정에 대한 개선이 필요하다. 이를 위해서는 국가과학기술위원회(NSTC)의 기능이 정책기획 중심이 되어야 하며 정책부터 평가까지의 전과정상 객관성과 공정성이 확보될 수 있는 운영지원 체계로 개편되어야 한다. 조정 배분과 성과평가가 유기적으로 연계되는 평가 시스템이 되려면 이들의 집행일정과 조사 분석의 내용과 시기가 보다 효용성이 높아져야 한다.

• 한국산학기술학회논문지
• /
• 제12권1호
• /
• pp.255-262
• /
• 2011

정보통신분야의 발전은 해킹 등의 역기능을 발생에 따라 정보보호를 위한 암호모듈의 한 수요가 급증한다. 국내 암호모듈 평가 기준의 불명확성과 모듈 선정의 어려움은 모듈 및 제품 상호간의 운용 및 호환성 확보를 어렵게 한다. 본 연구는 국외 암호모듈 평가 프로그램인 CMVP(Cryptographic Module Verification Program)를 분석하여 국내 암호모듈 암호 모듈 검증 기준 및 평가 절차, 검증 정책 발전 방향을 제안한다. 본 연구는 국내 암호모듈 발전정책을 제안하여 암호모듈 국제 표준화, 국제 암호모듈 제도에 대한 공조를 기반을 제공한다.

• 보건행정학회지
• /
• 제13권4호
• /
• pp.1-27
• /
• 2003

The purpose of this study was to develop the evaluation indicator for the health promotion programs of the Community Health Centers and to test its validity. The modified logic model was used as the evaluation model based on the literature reviews. Using this model, four dimensions, eleven sub­dimensions, and forty­one individual indicators were developed. These evaluation indicators are superior in reflecting the distinctiveness of the community health promotion programs, and also flexible enough to accommodate diverse programs. These indicators also emphasize the role of process evaluation, and the diversity of outcomes. To test content validity, survey method of experts in the community health promotion field was conducted. Eleven in three expert groups(professionals, practitioners in Community Health Centers, and policy makers) generally agreed with the validity of evaluation indicators. To examine criteria and construct validity, these indicators were used to evaluate the health promotion programs conducted by the 18 Key Community Health Centers. The data came from the interview surveys of the main health promotion practitioner and 30 visitors from each center. The ranks of these eighteen Community Health Centers were computed from these data. There was no significant difference in ranking either by these indicators or by the existing indicators, which was developed by Technical Support and Evaluation Team for criteria validity. There was no statistically significant difference in ranking between input, process and outcome dimensions. Based on these study results, evaluation indicators developed in this study are valid to evaluate Community Health Center's health promotion program. It can be used both by the Community Health Center for internal evaluation, and by the stakeholders for external evaluation.

• 대한토목학회논문집
• /
• 제31권3D호
• /
• pp.469-476
• /
• 2011

본 연구는 다층모형(multilevel model)을 상수원관리지역 주민지원사업 정책평가에 활용하는데 있어 유효성 및 효과를 이해하는데 연구의 목적이 있다. 정책의 대상이 위계적인(hierarchical) 특성을 지니고 있는 경우 다층모형을 이용하여 정책평가를 하는 것이 정책의 효과를 평가하고 검증하는데 있어 적절하다. 또한 이 모형은 기존 평가결과의 재평가 등에 응용될 수 있다. 상수원관리지역의 주민지원사업을 대상으로 주민만족도와 경제적 도움정도를 정책효과변수로 하여 다층모형을 적용 하였다. 그 결과 정책효과변수에 기존 평가결과 및 중요한 사업으로 여겨지던 소득증대사업 등이 직접적인 영향을 미치지 못함을 통계적으로 확인할 수 있었다. 본 연구는 다음과 같은 세 가지의 정책적 함의를 지닌다. 첫째, 정책 및 사업평가에 있어 정책의 효과를 엄밀히 파악하기 위하여 위계적 구조를 고려할 수 있는 다층모형을 이용하여야 한다. 둘째, 기관평가의 순위 도출에 있어 다층모형을 이용하여 지표에 의한 성과지표와 보완적으로 이용해야 한다. 셋째, 위계적 구조의 하나로서 공간적 위계를 고려하여 정책평가를 시행하여야 한다.

• 공학교육연구
• /
• 제18권2호
• /
• pp.27-32
• /
• 2015

The paper deals with the analysis for improving evaluation system of government-supported program in developing engineering college. I think that it is important to consider evaluation system of government-supported program and faculty in the aspect of policy responsibility and autonomy. I suggest three proposals. First, in the perspective of evaluation system of government-supported program, it is important to keep the balance between SCI-based evaluation and practical & University Industry Corporation (UIC) indicator or keep the balance between quantitative indicators and qualitative indicators. Second, in the perspective of evaluation system of faculty, UIC-friendly evaluation system should be expanded and institutionalized. Finally, the evaluation systems should be not only built, but also utilized for developing engineering college.

• 한국환경보건학회지
• /
• 제48권2호
• /
• pp.123-129
• /
• 2022

Background: The Environmental Health Action Program was a national project carried out from 2012~2021. It was aimed at developing public technologies to protect people's health from various environmental hazards. Objectives: One of the final goals of the project was "creating health benefits worth more than 179.2 billion won by reducing the environmental burden of disease." This study aims to evaluate whether the program sufficiently achieved the planned benefits. Methods: In order to secure consistency in evaluation, we applied the same equation used in the goal-setting process. It is comprised of six parameters to estimate the benefit: 1. The amount of medical expenses for environmental diseases; 2. The attributable proportion of environmental risk factors' 3. The rate of reduction in medical expenses for environmental diseases; 4. R&D project contribution; 5. The proportion of successful policy reflection; and 6. The contributions of the project. The corresponding variables were estimated at the end of the project, and the health benefits of the project were recalculated using the newly estimated variables. Results: It was estimated that a total of 195 billion won in health benefits occurred or will occur from 2015 to 2026. The main contributors for achieving the target were an increase in medical expenses for environmental diseases, a high score in the R&D project contribution, and the proportion of successful policy reflection. Conclusions: Technically, the equation used in the project is about medical expenses for environmental diseases rather than about the environmental burden of disease. There are several benefits of using the environmental burden of disease in the evaluation of public health policies. In further studies, developing a policy evaluation framework using indicators such as population attributable fraction would be needed.

• 농촌계획
• /
• 제14권4호
• /
• pp.97-108
• /
• 2008

The present study construct a new technique that can evaluate diverse rural policies, which have been applied to the rural development programs at the village level. The method incorporates spatial econometrics models with a decomposition method that has little been utilized before. We applies the technique to evaluate the rural development programs that have been carried out by the Korea Forest Service and. Korea Rural Development Agency. The technique proved to be quite useful in that the technique efficiently separate the direct effect caused by the government policy from the effect explained by the endowment effect such as regional or area characteristics, and residual effect that cannot be identified by the models. The present study concludes with suggesting more quantitative methods need to be developed to evaluate diverse government policy programs, which enables us to discern correct policy effects.

• 보건행정학회지
• /
• 제13권3호
• /
• pp.35-51
• /
• 2003

This study purports to develop a quality assessment tool for the process of health promotion programs at public health centers(PHC). The draft of the assessment tool developed by the literature was distributed to 242 staffs who were in charge of the health promotion programs at PHCs for evaluating the feasibility of the tool on September and October 2002. The major results of the study were as follows; The quality assessment tool developed in the study consisted of four domains: strategic planning, program management, monitoring and evaluation, and resources and information. The strategic planning dealt with the function of the planning staff and committees, community data analysis, the feasibility of the program, and the approach methods for attaining the goal of the program. The program management included the items on the qualification and power of the program staff. The monitoring and evaluation included the items on the reporting and communication among program units, and feed back after monitoring. Finally, the resources and information dealt with community networking, clients' response, and consulting activity of the staff. The validity of the tools was tested and partly supported by both formative and criterion-related methods. The assessment tools developed in this study could be used by health promotion workers in the self-evaluation of the program quality. In conclusion, the quality assessment tool developed in the study will be a good safeguard for assuring the quality of the process of health promotion programs.