• 기술혁신학회지
• /
• 제4권3호
• /
• pp.275-290
• /
• 2001

The frameworks for evaluation of national R&D programs reflect their various political and administrative cultures(Gibbons & Georghiou, 1987), and the structure of national R&D system. In this research the core research questions are : what is god evaluation\ulcorner What is being evaluated, by whom, by which criteria, for whom and what purpose\ulcorner In order to examine these general aims and answer these questions, in detail several objectives can be proposed on the process of this research. In this research, the national R&D programs will be considered in terms of the interface between evaluation and the wider policy-making process. The programs for case study are the Alvey program(UK), the Advanced Technology Program (US) and the Framework program(EU) . One of the characteristics of these programs is the well established evaluation systems they have. From the comparative analysis, we can withdraw some useful implication for Korean evaluation practice for national R&D programs. Evaluation system is social process and the way in which it is organized is critical to its outcome.

• 기술경영경제학회:학술대회논문집
• /
• 기술경영경제학회 1999년도 제16회 동계학술발표회 논문집
• /
• pp.216-239
• /
• 1999

Korean government has planned a large scale multidepartment-participated national R&D program to advance and improve her science and technology and the quality of life In the level of advanced(especially G-7) countries in the forthcoming 21st century. It is called as "Highly Advanced National projects" or "G7 projects", which was initiated in 1991 with 18 sub-programs to date. It has planned to be continued until 2001 with its total fund of 4, 591 billion Won, comprised of 2, 033 billion Won from the public sector and 2, 558 billion Won from the private sector. Evaluation activities, the country has carried out to date, for national R&D programs including HAN projects are focused mainly on the assessment of scientific and technological results to decide that a specific program should be continued, terminated, or modified. Thus, it is necessary for national R&D programs to be evaluated socioeconomically for the purpose of assessing the nationwide economic and social impact from the program. Socioeconomic evaluation would be told how and where the program contributed to the society, and what the socioeconomic impacts are resulted from the program. It would be useful for the means of (ⅰ) fulfillment of public accountability to legitimate the program and to reveal the expenditure of pubic fund, and (ⅱ) managemental and strategical learning to give information necessary to improve the making. program and policy decision making, The objectives of the study are to develop the methodology of modeling the socioeconomic evaluation, and build up the practical socioeconomic evaluation model of the HAN projects including scientific and technological effects. Since the HAN projects consists of 18 subprograms, it is difficult In evaluate all the subprograms simultaneously. Despite, each program is being performed under the category of HAN projects, so the common socioeconomic issues are existing, The followings are main results of the study. First, the hierarchical structure of the socioeconomic evaluation are constructed; Evaluation Perspective, Evaluation Bounds, and Evaluation Aspect. Second, based on the goals of the HAN projects, the evaluation perspectives are established as (ⅰ) the strengthening of industrial competitiveness, (ⅱ) the enhancement of national scientific and technological capability, (ⅲ) the improvement of quality of life. Third, the evaluation bounds for each evaluation objective are defined to specify the affected area. Finally, the evaluation aspects for each evaluation bounds are formulated containing essential elements describing the evaluation bounds.

• 신재생에너지
• /
• 제6권2호
• /
• pp.40-48
• /
• 2010

This study was carried out to evaluate the renewable energy dissemination programs in Korea, using peer-review. Especially, we used the peer review method which was suggested to evaluate the renewable energy program in U.S. by EERE, DOE. Before we implemented the peer review, we modified this method suitable for evaluating the renewable energy dissemination programs in Korea by getting advice from expertise in renewable energy policy. From this procedure, we have verified six evaluation criteria as Quality, Productivity, Accomplishments, Relevance and Management. We interviewed renewable energy policy expertise and corporation to evaluate the programs against these criteria. The result shows that overall programs were performed more than average. In addition, both the policy expertise and corporation perceived that "oan Guarantee Program" and "ompulsory Installation of Renewable Energy Facility in Public building" fulfilled its role to a great extent. However, the respondents pointed out that all of the programs need to be improved on its management.

• World Technopolis Review
• /
• 제3권3호
• /
• pp.153-164
• /
• 2014

It is recent that STEM (Science, Technology, Engineering and Mathematics) education emerged as a great concern of the U.S. policy makers in terms of securing national and regional competitiveness. However, few attempts to embrace STEM education as a source for sustainable regional growth have been made mainly due to methodological challenges. This paper investigates the role of STEM education in achieving sustainable economic growth. For the purpose of the paper, a U.S. federal workforce development program named Workforce Innovation in Regional Economic Development (WIRED) in Southeastern Virginia that was implemented between 2007 and 2010 is selected and evaluated qualitatively. By identifying three themes as a result of three-stage coding methods, the evaluation results call for particular attention of local policy makers and key stakeholders to STEM education as a source of sustainable long-term economic growth in regions.

• 한국도서관정보학회지
• /
• 제47권3호
• /
• pp.289-314
• /
• 2016

2006년 "독서문화진흥법"제정에 따라 제1차, 제2차 독서문화진흥기본계획(2014~2018)이 수립되는 등 국민 독서문화진흥을 위한 정책과 사업이 추진되고 있다. 그러나 독서문화진흥사업에 대한 성과를 점검하는 시스템의 부재로 인해 사업의 체계적인 추진이 미흡한 상황이다. 이러한 점을 고려해서 본 연구에서는 독서문화진흥사업에 대한 심층적이며 체계적인 평가를 시도하였다. 이를 위해 독서진흥사업 평가를 위한 평가체계를 개발하여 평가하였으며, 평가를 토대로 사업의 문제점을 파악하고 개선방안을 마련하여 국민의 독서문화 저변 확대를 위한 독서문화진흥 시책의 방향을 제시하였다.

• STI Policy Review
• /
• 제4권2호
• /
• pp.41-54
• /
• 2013

R&D is inherently an uncertain endeavor, yet now more than ever those performing R&D with public funding are called upon to clarify the utility of their research. Calls for public accountability are mounting with the increase in constraints on government budgets due to the recent worldwide economic recession, in response to which both policymakers and researchers pay much more attention to rigorously assessing publicly funded R&D. A key issue complicating R&D evaluation in these circumstances is how to adequately account for the nature and degree of risk involved in a given R&D program or project. This study deliberates on certain issues involving the measurement of ex-ante risk in public R&D evaluation: (i) information asymmetry between R&D sponsors and performers, (ii) ambiguity in the measurement of returns in both prospective and retrospective evaluation, and (iii) the dilemma between measurement error and omitted variable bias for empirical estimation of R&D performance. The study then presents an analysis of hypothetical evaluation results that apply risk-relevant weights to the annual evaluation outcomes of South Korea's national R&D programs funded during 2006~2012. In this counterfactual re-evaluation of public R&D program performance, high-risk R&D programs turn out to receive higher evaluation than non-high-risk programs. The current study suggests that R&D evaluation ignoring ex-ante risk is not only conceptually invalid since R&D activities are intrinsically uncertain endeavors, but unfair as R&D performers are asked to be accountable for the results that were in fact out of their reach.

• 한국의료질향상학회지
• /
• 제5권2호
• /
• pp.224-237
• /
• 1998

Background : This is an investigative study to analyse the importance of works perceived by Quality Improvement(QI) Coordinators and to evaluate their current work performances using the questionnaires developed by the investigator. Methods : The data were collected from 37 subjects over two weeks period from Oct. 1 to Oct. 17, 1998 and analysed by the descriptive statistics of SPSS program. The items of questionnaire are consisted of 13 work domains including 73 activities based on Quality Management(QM) Coordinator's job description of National Association for Healthcare Quality:data collection & analysis, communication, monitoring, evaluation, accreditation, tool development, policy development, program development, self development, education & trainning, system design, planning, and consultation & support. Results : 1) Of the performances in 13 work domains, the frequencies of the work performed were accreditation(89%), planning(88%), communication(83%), data collection & analysis(82%), monitoring(76%), policy development(72%), consultation & support (71%), education & trainning(70%), self development(68%), evaluation(63%), tool development(61%), program development(44%) and system design(43%) in order. 2) For the importances (1=not important, 5=very important), the policy development(4.46) scored highest then monitoring(4.42), planning(4.41), education & trainning(4.38), communication(4.35), evaluation(4.34) tool development (4.30), data collection & analysis(4.29), program development(4.22), consultation & support(4.22), accreditation(4.15), self development(4.05) and system design(3.98) in order. 3) There was a difference between the work performance and the perceived importance. The results showed the low performances in policy development, monitoring, education & trainning and evaluation which ranked high by the perceived importance and the high performances in accreditation, data collection & analysis, self development, communication and consultation & support which ranked middle to low by the perceived importance. 4) The reasons for low performances of QI Coordinators were the lack of clear assignment for the responsibility and allowed authority for work to QI Coordinators(30.8%), insufficient member of QI Coordinators(13.9%), lack of hospital director's interest(11.5%), low motivation of QI Coordinators (10.6%) and insufficient knowledge & experience of QI Coordinators (8.8%). Conclusion : Most works were perceived important by QI Coordinators, but there was a difference in the work performance. The works performed over 70% were related with accreditation, data collection & analysis, communication, planning and monitoring, on the other hand under 50% in performances were related with system design, program development, tool development and evaluation.

• Journal of Information Technology Applications and Management
• /
• 제13권3호
• /
• pp.145-179
• /
• 2006

The measurement of informatization program effectiveness continues to be a central concern of both academics and practitioners. However, most studies of it have been inclined too heavily toward testing validity and reliability of evaluation measure to strengthen the theoretical rigor. Drawbacks of this approach have been pointed out as being unsuitable for evaluating the effectiveness of informatization program due to lack of practical relevance. The paper comprises four sections to solve the problem. 1) Through literature review of theoretical conceptual models in IS effectiveness and the domestic and foreign cases on informatization program, we establish the evaluation framework which consists of evaluation phases, 6 evaluation areas, and 22 evaluation items, and developed evaluation measures of each items. 2) Different researchers have addressed different aspects of attribute of measure. With comparing them to each other, 3 mutually exclusive criteria on coincidence analysis(usability of measurement. reliability of measurement. and validity of content) are identified. 3) Data are gathered from respondents in informatizaiton program-related organizations such as policy agency, management agency, support agency, and recipient agency. 4) The degree of coincidence of each evaluation measure are analyzed by course of an coincidence analysis procedure, which includes the reliability test, arithmetical test, and criteria validity test. The academic implication of this study is that researchers can gain an insight into the coincidence analysis to approach the problem of deciding on an indicator of performance for informatization program. There is also practical implication for applying the potential means of improving the practical relevance of conducting evaluating the informatization program.

• 기술혁신연구
• /
• 제21권1호
• /
• pp.331-364
• /
• 2013

이 연구는 첨단화 융합화 복합화 경향이 특히 강한 정보통신 분야에서의 평가 신뢰성을 높이기 위해서는 평가의 전문성이 획기적으로 제고되어야 한다는 문제의식에서 출발하고 있다. 이를 위해 지식경제 기술혁신사업 중에서 정보통신 분야의 기반구축과 산업 진흥을 담당하는 정보통신산업진흥원의 평가 전문성을 평가자 선정, 평가자 전문성 발휘여건, 평가자의 이력관리라는 전 과정 평가관리의 분석틀을 활용하여 분석하였다. 분석 결과는 정보통신산업진흥원의 평가제도는 다른 기관에 비하여 평가자 선정과 평가자의 이력관리는 양호하나, 평가자의 전문성 발휘 여건은 상대적으로 개선과 보완이 필요한 것으로 나타났다. 이에 따라 각 분석요소에서의 평가 전문성 향상을 위한 정책대안을 단기와 장기로 분류하여 총 12가지로 논의하였다.

• 간호행정학회지
• /
• 제13권1호
• /
• pp.40-52
• /
• 2007

Purpose: The purpose of this paper was to investigate opinions and experiences of hospital CEOs' and QI managers toward the National Hospital Evaluation Program which was implemented in 2004 and to recommend various strategies to improve the program. Methods: We conducted a mail survey with CEOs and QI　managers' of 78 hospitals with 500 beds or more that participated the 2004 National Hospital Evaluation Program. Results: About 70.8% of the participating CEOs and 64.0% of the QI　managers felt that the objectives of the evaluation program weren't fully achieved. Most respondents said that the current program required a partial or an overall change. Evaluation Criteria was the most often cited area for a change. Many respondents pointed out the importance of including clinical quality indicators in the evaluation tool. Conclusions: To upgrade hospital services with better quality, it is most important to first reach consensus on objectives and approaches of the evaluation program among various players. For a consistent planning and implementation, it is urgent to set up a more systematic organization and financing mechanism. Also, evaluation approaches, including evaluation criteria, methods, patient satisfaction assessment, as well as ways to summarize and publicize each hospital's performance should be improved.