• Journal of Korea Technology Innovation Society
• /
• v.12 no.4
• /
• pp.819-839
• /
• 2009

Proposed increases to the government's R&D budget should be discussed based on merits of meeting efficiency and effectiveness criteria. The evaluation of the national R&D budget and related programs are performed in two areas: a system of R&D budget coordination and allocation, and a system of R&D program performance. This paper mainly focuses on the operational areas of R&D budget evaluation system with a focus on their impact to efficiency and effectiveness. The core view point for a R&D budget evaluation system involves two directions: Firstly, to detail the relationships between the later stage (ex. post) activities such as, program survey, analysis, and program performance evaluation, with the budget evaluation. Secondly, to critically oversee all R&D coordination procedures with a different perspective. Budgeting is generally known as a serial process of policy making, planning and executing. It is highly desirable for the budget to be allocated to, and spent by, specific programs as planned, and that each plan be aligned with a specific policy. As such, a strong relevance between the program structure and budget code system is integral to successful execution. It should be performed using a decision making system which closely examines the link between policy and budget. It is also recommended that systematic relationships be maintained among budget coordination and allocation, performance evaluations of policy and program levels, and program survey and analysis system, and that their operational schedule should be reviewed comprehensively as a one integrated system. The National Science and Technology Council is expected to play a major and practical role as the center of policy planning and should be supported by the objective and unbiased system which covers overall process from policy making to program evaluation. Finally, increased utilization of contents, timely program survey and analysis, and accurate of activity scheduling of budget coordination and allocation, and diligent program performance evaluation all contribute towards a more efficient and effective overall evaluation system.

• Journal of Applied Reliability
• /
• v.15 no.4
• /
• pp.222-232
• /
• 2015

Purpose : The purpose of this study is to analyse affecting factors of Test and Evaluation and to improve the institution of Test and Evaluation in the Domestic purchase program. Methods : The domestic acquisition program is currently small in terms of size, but it is gradually increasing every year. Still, the domestic purchase program has insufficient regulations and procedures compared to the other procurement methods including research & development. Various problems are likely to occur between test and evaluation group, and defense industries regarding the regulations during Test & Evaluation. Therefore, the regulations and methods need to be amended to upgrade the current domestic purchase program into an effective and flawless one. In this paper, six variables have been chosen by the help of experts working in Ministry of National Defense (MND), Joint Chiefs of Staff (JCS), Army Headquarters and DAPA. Results : The six variables are effectiveness of proposal evaluation, fairness of test and evaluation, sufficiency of operational capabilities, seasonal period of test and evaluation, fulfillment in Integrated Logistics Support (ILS) of the industries, and guaranteeing appropriate environment for related enterprises' participation. Conclusion : This paper can help defense industries to enhance their development capabilities, and to perform tests more fairly and effectively considering the key factors identified in this research.

• Journal of Korean Academy of Nursing Administration
• /
• v.13 no.1
• /
• pp.40-52
• /
• 2007

Purpose: The purpose of this paper was to investigate opinions and experiences of hospital CEOs' and QI managers toward the National Hospital Evaluation Program which was implemented in 2004 and to recommend various strategies to improve the program. Methods: We conducted a mail survey with CEOs and QI　managers' of 78 hospitals with 500 beds or more that participated the 2004 National Hospital Evaluation Program. Results: About 70.8% of the participating CEOs and 64.0% of the QI　managers felt that the objectives of the evaluation program weren't fully achieved. Most respondents said that the current program required a partial or an overall change. Evaluation Criteria was the most often cited area for a change. Many respondents pointed out the importance of including clinical quality indicators in the evaluation tool. Conclusions: To upgrade hospital services with better quality, it is most important to first reach consensus on objectives and approaches of the evaluation program among various players. For a consistent planning and implementation, it is urgent to set up a more systematic organization and financing mechanism. Also, evaluation approaches, including evaluation criteria, methods, patient satisfaction assessment, as well as ways to summarize and publicize each hospital's performance should be improved.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.6 no.2
• /
• pp.71-80
• /
• 2010

This thesis is purposed on developing security product co-evaluation statistics administrate program which is can administrate or analysis CC accreditation product using by DEVS modeling via portal site of member of CCRA. Via developing security product evaluation statistics administrate program, it can analysis the trend of all countries of the world in many ways, and noticed the ways of evaluation and accreditation of most countries via scheme analysis. Except this, it can analysis the situation of accreditation trend of any countries via data analysis of ICCC 2009. Also, For trend analysis to evaluation technique of CCRA member, it analyzed up to date technology and policy of the evaluation organization and the Certification Authority of most countries. And it peformed analysis the most trend of information security of evaluation authorization in CCRA member countries. In this program, It provide the function of trend statistics analysis which can statically analyzed the evaluation accreditation trends of most countries and automatical statistics by categorization ( by Product, Class and statistics in national) and report creation functions which can easily extraction and use the needed data. It has been updated the related informations until latest accredited product using by CC(Common Criteria) portal home page's data.

• Hwankyungkyoyuk
• /
• v.19 no.3
• /
• pp.183-199
• /
• 2006

The purpose of this study is to develop an in-service teacher training program for professional development in environmental education. In order to achieve the goal, the in- service teacher training program for professional development in environmental education development / implement team is formed to deal with the development and the implementation of the program. The team is composed of environmental education professionals and environmental education teachers. After the development of the program, 20 teachers were selected to implement the program. Then, through various researches such as interview, monitoring, and survey, the evaluation of the program was done. After the evaluation, the feedback on the program was collected in order to apply the final adjustments and changes to the developed training program for professional development in environmental education. The training program is designed to include the wide range of theories and real life cases. It focuses on certain topic, and is implemented through workshop type training method to increase the participation rate. The major motive of the participants was to develop their professionality in environmental education. Based on the analysis of the training program and the workshop, 69.1% of the program is focused on the environmental education/learning theory, and 71.4% is focused on the environmental education teaching method. The environmental education teaching method is focused on the real life teaching method that could be used in many schools. However, the parts on environmental education philosophy, psychology, and evaluation was not included as a part of the program. Also, the evaluation method of the students learning the environmental education was not introduced as a part of the program as well. It is due to the limited time frame of the training program, as well as its focus on the training method of environmental program. Based on the analysis of the evaluation results obtained through monitoring, the training program for professional development in environmental education is successful in terms of focusing the goal of the program around the environmental education/learning theory and environmental education teaching method, which was the motive of the participants. However, the effectiveness of the program differed from participants to participants based on their majors in environmental education, and it did not last long enough. The future training program for professional development in environmental education should consider the backgrounds of the program participants to have various programs prepared for various groups of people. We suggest that the results of this developed program will be applied to "environmental education teacher licence training" in the future.

• 대한공업교육학회지
• /
• v.45 no.2
• /
• pp.86-107
• /
• 2020

The purpose of this study is to increase the effectiveness and efficiency of invention education by presenting basic evaluation criteria that can be used when designing and preparing invention education programs in various educational institutions that operate invention education. The results of this study are as follows. First, the stage of the Invention Education Program was named '4P stage' as 4 stages of 'Planning, Preparation, Process, and Product'. Second, the areas of evaluation of the planning stage of the invention education program are 'goal setting, demand analysis' and curriculum design. The preparatory stage evaluation area is 'Developing an Invention Education Program, Securing Human Resources, Securing Physical Resources'. The evaluation area of the course level is 'program operation, program management, learner management'. The evaluation area of the calculation stage is 'education performance, achievement results, and education evaluation'. Invention education program evaluation criteria will play a role to enhance and manage the quality of invention education program. In addition, it is judged that this will be the basic data for developing evaluation criteria for the invention education program through the reconciliation process through reflux and the validation process of related experts at various invention education institutions.

• Journal of vocational education research
• /
• v.37 no.3
• /
• pp.1-23
• /
• 2018

The purpose of this study was to develop evaluation indicators which can help decision making in the quality control and improvement of the job capability strengthening program for the vocational high school depending on the situation, input, process and output of CIPP evaluation model. For this purpose, through the literature review and the research of expert opinions, the evaluation indicators for the job capability strengthening program in the vocational high school was designed. In addition, the Delphi research was conducted to 15 teachers in charge of job searching in specialized high schools and education related experts to validate it. The CVR value which indicates the value of validity was analyzed through the findings of the collected Delphi questionnaires and the degree of opinion consistency was analyzed through the degrees of agreement and convergence. Through the correction and complementation, the final evaluation criteria and evaluation indicators was decided. The evaluation criteria developed from the findings include 7 references such as requirement analysis, objective setting, implementation plan, implementation contents, program activities, program control & evaluation and program performance. Each Criteria has 41 evaluation indicators. It is expected that the finally decided evaluation indicators would be used by the people concerned with the job capability strengthening program at the vocational high schools and contribute to the quality improvement of the job capability strengthening program at the vocational high schools as well as its future directions.

• Korean Medical Education Review
• /
• v.23 no.1
• /
• pp.56-67
• /
• 2021

Educational program evaluation can improve the quality of the curriculum, instructional methods, and resources and provide useful data for making educational decisions and policies. Developing and implementing a program evaluation system is essential in competency-based medical education. The purpose of this study was to explore and establish an educational program evaluation system adapting an integrated program evaluation model to promote competency-based medical education. First, an Educational Evaluation Committee was organized, consisting of faculty, staff members, and students. The committee established an integrated program evaluation model, combining Stufflebeam's Context, Input, Process, and Product (CIPP) model of a process-oriented approach and Kirkpatrick's four-level model of an outcome-oriented approach. Kirkpatrick's model was applied to the product evaluation of the CIPP model. The committee then developed evaluation criteria, indicators, and data collection methods according to the components of the CIPP model and the four levels (reaction, learning, behavior, and results) of Kirkpatrick's model, and collected and analyzed data. Finally, the committee reported the results of evaluation to a Medical Education Quality Improvement Committee, and the results were used to improve the curriculum and student selection. To enhance the quality of education, identifying educational deficiencies and developing various elements of education in a balanced way through educational evaluation will be needed. Furthermore, it will be necessary to listen to opinions of various stakeholders, work with all members involved in education, and communicate with decision-makers in the process of educational evaluation.

• Korean Journal of Health Education and Promotion
• /
• v.27 no.4
• /
• pp.165-175
• /
• 2010

Objectives: The purpose of this study is to evaluate the program theory of a lifestyle intervention program for the prevention and treatment of metabolic syndrome. Methods: The program evaluated is a tailored intervention for multiple health behavior associated with metabolic syndrome which is informed by theoretical constructs from the Intervention Mapping and Transtheoretical model. The program components include one-to-one health counseling, a self-management handbook, and a health diary. To evaluate program impact theory we examined the logic of program goals and objectives, intervention methods and strategies, and the theoretical constructs of program materials through document review and matrix building. Results: This evaluation has found that the intervention program applied social cognitive theory constructs to design intervention methods and strategies in addition to the Transtheoretical model: self-monitoring for goal setting and monitoring skill, outcome expectation for the benefits of health behavior change, and interaction with environment for observational learning through modeling. While the intervention addresses multiple determinants and behaviors, it is limited to an individual level and lacks social and environmental approaches. Following the Transtheoretical framework, the contents of the intervention materials were developed utilizing consciousness raising as a main strategy for earlier stages of change, and counterconditioning and stimulus control for later stages of change. Conclusion: Program theory evaluation can be a process of enhancing program validity. It would also be necessary for providing basis for efficient program implementation. When comparisons of program theory between similar programs are possible, program theory and validity will be strengthened when comparisons of program theories between similar programs are possible.

• Journal of Korean Academic Society of Home Health Care Nursing
• /
• v.13 no.1
• /
• pp.46-53
• /
• 2006

Chunchoen Community Home Nursing Program (CCHNP) sponsored by Chuncheon City and Gangwondo Nurses Association was the first trial of community based home health nursing in Korea. The services have started since 1996. The purpose of the study was the evaluation CCHNP to establish standard of community based nursing program in Korea. The methods of evaluation were quantitative and Qualitative approaches. Evaluation for organization and management were conducted by the American Community Health Accreditation Program Standards With the result. several recommendations were suggested : It is necessary to expand the program to all the Gangwondo cities. And the liaison system is necessary between medical care facilities and community nursing home agency to establish the continuity of health care delivery system in home nursing program. Also it is necessary to set up the supporting system between community home nursing care agency and hospital home nursing department. Finally, the National Health Insurance should cover the cost of community home nursing care.