• Asian Journal of Innovation and Policy
• /
• v.9 no.3
• /
• pp.281-307
• /
• 2020

A variety of approaches are being applied to improve the existing ex-ante evaluation by expert panels in publicly funded R&D. While the objective evaluation criteria are constantly being improved to screen and select the superior projects, alternative approaches such as random prioritization and logical modeling are also underway to overcome the conservative bias of reviewers and to secure disruptive innovation. This study intends to find critical implications for ex-ante evaluation of public R&D system from the comparison of Indonesia and Korea. For the comparative analysis, literature review and expert in-depth interviews are conducted on the national R&D system and the selection evaluation process. In Korea, the selection criteria of projects are legally promulgated for establishing an objective evaluation system, and at the program level, the major considerations in the planning process are specified by Presidential Decree. On the other hand, while Indonesia conducts R&D in 47 strategic fields largely by public research institutes (PRI) based on the non-competitive government contributions. This study draws out implications of institutionalizing the planning process at the level of program, and of increasing the ratio of contract-based competitive funding at the level of project in the national R&D portfolio.

• Journal of Environmental Impact Assessment
• /
• v.15 no.1
• /
• pp.13-22
• /
• 2006

The Korean government adopted the integrated stream water management policy recently with growing perception that natural disasters and pollution in Korea have been due not only to such human factors as urbanization and industrialization, but also to the policy of functionally separated management of irrigation, flood control and ecological management. Contrary to its good intention, research result shows that it is not realistic to expect that this new integrated policy in Korea will work well. In order to be an effective policy and program evaluation, this paper suggests that evaluation indicator on related programs and projects should be made through bottom-up process. For example, environmental benefit should be taken into account rather than just economic benefit, and cultural and social characteristics in the project region should be also considered seriously.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.4
• /
• pp.819-839
• /
• 2009

Proposed increases to the government's R&D budget should be discussed based on merits of meeting efficiency and effectiveness criteria. The evaluation of the national R&D budget and related programs are performed in two areas: a system of R&D budget coordination and allocation, and a system of R&D program performance. This paper mainly focuses on the operational areas of R&D budget evaluation system with a focus on their impact to efficiency and effectiveness. The core view point for a R&D budget evaluation system involves two directions: Firstly, to detail the relationships between the later stage (ex. post) activities such as, program survey, analysis, and program performance evaluation, with the budget evaluation. Secondly, to critically oversee all R&D coordination procedures with a different perspective. Budgeting is generally known as a serial process of policy making, planning and executing. It is highly desirable for the budget to be allocated to, and spent by, specific programs as planned, and that each plan be aligned with a specific policy. As such, a strong relevance between the program structure and budget code system is integral to successful execution. It should be performed using a decision making system which closely examines the link between policy and budget. It is also recommended that systematic relationships be maintained among budget coordination and allocation, performance evaluations of policy and program levels, and program survey and analysis system, and that their operational schedule should be reviewed comprehensively as a one integrated system. The National Science and Technology Council is expected to play a major and practical role as the center of policy planning and should be supported by the objective and unbiased system which covers overall process from policy making to program evaluation. Finally, increased utilization of contents, timely program survey and analysis, and accurate of activity scheduling of budget coordination and allocation, and diligent program performance evaluation all contribute towards a more efficient and effective overall evaluation system.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.12 no.1
• /
• pp.255-262
• /
• 2011

The advancement of information and communication technology has caused a few dysfunction such as hacking. To keep an organization from a harmful hacking, demands for cryptographic modules have been increased. However, the evaluation criteria of cryptographic modules in Korea have been less firmly established. It is difficult for the consumers of cryptographic module to choose an appropriate cryptographic module, and to establish interoperability between applications and cryptographic modules. This study analyzes evaluation criteria, evaluation processes and evaluation policy of CMVP(Cryptographic Module Verification Program) in the advanced countries. The paper suggests a policy for Korea CMVP, in resulting a provision of foundations for international standard and cooperations for international cryptographic policies and systems.

• Health Policy and Management
• /
• v.13 no.4
• /
• pp.1-27
• /
• 2003

The purpose of this study was to develop the evaluation indicator for the health promotion programs of the Community Health Centers and to test its validity. The modified logic model was used as the evaluation model based on the literature reviews. Using this model, four dimensions, eleven sub­dimensions, and forty­one individual indicators were developed. These evaluation indicators are superior in reflecting the distinctiveness of the community health promotion programs, and also flexible enough to accommodate diverse programs. These indicators also emphasize the role of process evaluation, and the diversity of outcomes. To test content validity, survey method of experts in the community health promotion field was conducted. Eleven in three expert groups(professionals, practitioners in Community Health Centers, and policy makers) generally agreed with the validity of evaluation indicators. To examine criteria and construct validity, these indicators were used to evaluate the health promotion programs conducted by the 18 Key Community Health Centers. The data came from the interview surveys of the main health promotion practitioner and 30 visitors from each center. The ranks of these eighteen Community Health Centers were computed from these data. There was no significant difference in ranking either by these indicators or by the existing indicators, which was developed by Technical Support and Evaluation Team for criteria validity. There was no statistically significant difference in ranking between input, process and outcome dimensions. Based on these study results, evaluation indicators developed in this study are valid to evaluate Community Health Center's health promotion program. It can be used both by the Community Health Center for internal evaluation, and by the stakeholders for external evaluation.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.31 no.3D
• /
• pp.469-476
• /
• 2011

The purposes of research is to understand the need of and the effectiveness of multilevel model to evaluate community support program in watershed areas. If the properties of policy target have hierarchical characteristics, the multilevel analysis is an adequate method to evaluate and test the effectiveness of policy. Also, the technique of multilevel modeling is extended to testing the relevance between performance appraisal and policy effectiveness. The case study of watershed region's community support program was estimated using satisfaction and economic aid level of policy target. This research has three results. First, the multilevel analysis should be used in nested data structure to estimate the effect of policy intervention. Second, the indexes of multilevel modeling should be used complementally to that of the traditional index approach. Third, the spatial hierarchical structure should be considered as the hierarchical structure in policy evaluation.

• Journal of Engineering Education Research
• /
• v.18 no.2
• /
• pp.27-32
• /
• 2015

The paper deals with the analysis for improving evaluation system of government-supported program in developing engineering college. I think that it is important to consider evaluation system of government-supported program and faculty in the aspect of policy responsibility and autonomy. I suggest three proposals. First, in the perspective of evaluation system of government-supported program, it is important to keep the balance between SCI-based evaluation and practical & University Industry Corporation (UIC) indicator or keep the balance between quantitative indicators and qualitative indicators. Second, in the perspective of evaluation system of faculty, UIC-friendly evaluation system should be expanded and institutionalized. Finally, the evaluation systems should be not only built, but also utilized for developing engineering college.

• Journal of Environmental Health Sciences
• /
• v.48 no.2
• /
• pp.123-129
• /
• 2022

Background: The Environmental Health Action Program was a national project carried out from 2012~2021. It was aimed at developing public technologies to protect people's health from various environmental hazards. Objectives: One of the final goals of the project was "creating health benefits worth more than 179.2 billion won by reducing the environmental burden of disease." This study aims to evaluate whether the program sufficiently achieved the planned benefits. Methods: In order to secure consistency in evaluation, we applied the same equation used in the goal-setting process. It is comprised of six parameters to estimate the benefit: 1. The amount of medical expenses for environmental diseases; 2. The attributable proportion of environmental risk factors' 3. The rate of reduction in medical expenses for environmental diseases; 4. R&D project contribution; 5. The proportion of successful policy reflection; and 6. The contributions of the project. The corresponding variables were estimated at the end of the project, and the health benefits of the project were recalculated using the newly estimated variables. Results: It was estimated that a total of 195 billion won in health benefits occurred or will occur from 2015 to 2026. The main contributors for achieving the target were an increase in medical expenses for environmental diseases, a high score in the R&D project contribution, and the proportion of successful policy reflection. Conclusions: Technically, the equation used in the project is about medical expenses for environmental diseases rather than about the environmental burden of disease. There are several benefits of using the environmental burden of disease in the evaluation of public health policies. In further studies, developing a policy evaluation framework using indicators such as population attributable fraction would be needed.

• Journal of Korean Society of Rural Planning
• /
• v.14 no.4
• /
• pp.97-108
• /
• 2008

The present study construct a new technique that can evaluate diverse rural policies, which have been applied to the rural development programs at the village level. The method incorporates spatial econometrics models with a decomposition method that has little been utilized before. We applies the technique to evaluate the rural development programs that have been carried out by the Korea Forest Service and. Korea Rural Development Agency. The technique proved to be quite useful in that the technique efficiently separate the direct effect caused by the government policy from the effect explained by the endowment effect such as regional or area characteristics, and residual effect that cannot be identified by the models. The present study concludes with suggesting more quantitative methods need to be developed to evaluate diverse government policy programs, which enables us to discern correct policy effects.

• Health Policy and Management
• /
• v.13 no.3
• /
• pp.35-51
• /
• 2003

This study purports to develop a quality assessment tool for the process of health promotion programs at public health centers(PHC). The draft of the assessment tool developed by the literature was distributed to 242 staffs who were in charge of the health promotion programs at PHCs for evaluating the feasibility of the tool on September and October 2002. The major results of the study were as follows; The quality assessment tool developed in the study consisted of four domains: strategic planning, program management, monitoring and evaluation, and resources and information. The strategic planning dealt with the function of the planning staff and committees, community data analysis, the feasibility of the program, and the approach methods for attaining the goal of the program. The program management included the items on the qualification and power of the program staff. The monitoring and evaluation included the items on the reporting and communication among program units, and feed back after monitoring. Finally, the resources and information dealt with community networking, clients' response, and consulting activity of the staff. The validity of the tools was tested and partly supported by both formative and criterion-related methods. The assessment tools developed in this study could be used by health promotion workers in the self-evaluation of the program quality. In conclusion, the quality assessment tool developed in the study will be a good safeguard for assuring the quality of the process of health promotion programs.