• Knowledge Management Research
• /
• v.10 no.2
• /
• pp.65-84
• /
• 2009

The purpose of this study is to develop Meta Evaluation Indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process and evaluation outcome. And fifty two indicators for this meta evaluation were developed by experts who performed evaluations for Defense R&D Programs. The reliability of components and items was verified by Cronbach's ${\alpha}$ coefficient. It was over 0.6 in all areas. The validity of components and items was verified by Factor Analysis. Analytic Hierarchy Process method was used in assigning the evaluation weight. The survey of twenty two evaluators participated in Defense R&D Programs showed that the Consistency Ratio was under 0.1 in evaluation components and items. In this study, an objective and reasonable set of Defense R&D Meta Evaluation Indicators was developed to increase the responsibility of Defense R&D Programs and improve the quality of evaluation results.

• Journal of Korean Society for Quality Management
• /
• v.50 no.2
• /
• pp.183-197
• /
• 2022

Purpose: The purpose of this study is to develop a quantitative evaluation model for the defense quality management system and suggest institutionalization plans. To this end, another existing evaluation model was reviewed and analyzed to develop a quantitative evaluation model applicable to military institutions. Methods: In this study, in order to establish a DQMS quantitative evaluation model, a military product quality level survey model and a defense quality model operated in the defense field were analyzed. In addition, evaluation models and indicators were analyzed by investigating evaluation models operated by other institutions and private sectors. Results: As a result of the study, the total score of the DQMS model was 1,000 points, 600 points for maturity level indicators and 400 points for operation performance indicators, and the evaluation items consisted of 7 major categories and 25 middle categories. The maturity level index 600 points are 70 points for organizational situation, 60 points for leadership, 40 points for planning, 100 points for support, 180 points for operation, 90 points for performance evaluation, and 60 points for improvement. Conclusion: It will be easy to quantify and evaluate the operating level of DQMS certified companies through the application of the DQMS quantitative evaluation model and evaluation criteria presented in this study. As a result, it will be possible to grasp the level of quality management system and the areas of improvement, and the overall level of improvement can be expected by inducing voluntary improvement activities through sharing of best practices and identifying improvement cases.

• International conference on construction engineering and project management
• /
• 2009.05a
• /
• pp.1453-1462
• /
• 2009

It is very important for performance of information system that we make an effort to raise user's satisfaction by continuously grasping user's requirement by evaluation of PMIS based on ASP service quality and reflecting this to information system. However, It is lack that developments of suitable evaluation index of PMIS based on ASP service quality. Hereupon, In this study, we propose the evaluation indicators. First, The evaluation area is classified by form the foundation of D & M IS Success Model (2003); system quality, information quality, service quality. Second, The detail evaluation item which include considerations which are gotten through investigation of the construction industry and PMIS based on ASP is grouping by form the foundation SERVQUAL which is a service quality evaluation tool proposed PZB(1988). It is suitable to evaluate PMIS based on ASP service quality in construction industry and able to evaluate various aspects.

• Journal of vocational education research
• /
• v.37 no.3
• /
• pp.1-23
• /
• 2018

The purpose of this study was to develop evaluation indicators which can help decision making in the quality control and improvement of the job capability strengthening program for the vocational high school depending on the situation, input, process and output of CIPP evaluation model. For this purpose, through the literature review and the research of expert opinions, the evaluation indicators for the job capability strengthening program in the vocational high school was designed. In addition, the Delphi research was conducted to 15 teachers in charge of job searching in specialized high schools and education related experts to validate it. The CVR value which indicates the value of validity was analyzed through the findings of the collected Delphi questionnaires and the degree of opinion consistency was analyzed through the degrees of agreement and convergence. Through the correction and complementation, the final evaluation criteria and evaluation indicators was decided. The evaluation criteria developed from the findings include 7 references such as requirement analysis, objective setting, implementation plan, implementation contents, program activities, program control & evaluation and program performance. Each Criteria has 41 evaluation indicators. It is expected that the finally decided evaluation indicators would be used by the people concerned with the job capability strengthening program at the vocational high schools and contribute to the quality improvement of the job capability strengthening program at the vocational high schools as well as its future directions.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.42 no.4
• /
• pp.135-144
• /
• 2019

In this study, BSC model of center for teaching and learning was developed using balanced scorecard suitable for non-profit organization. Firstly, relevant literature surveys and evaluation indicators of various CTL and institution with similar characteristics were examined. Next, a draft BSC model was designed through interviews of specialists. Lastly, the BSC model was proposed by verifying the content validity of the evaluation model by conducting two Delphi surveys. The BSC model of CTL has 4 perspectives: resource, customer, internal process, learning and growth, 9 critical success factors: 2 factors in resource, customer and learning and growth perspectives, 3 factors in internal process perspective, and 23 key performance Indicators: 4 indicators in resource and learning and growth, 7 indicators in customer perspective, 8 indicators in internal process perspective. The implications of this study through the results were as follows: firstly, the proposed BSC model showed an evaluation model suitable for a non-profit organization. Second, the BSC model was linked to the organization's mission and vision. Third, it could contribute to the long-term development of CTL. Lastly, if it could be applied to management, and evaluated, it is expected to play a role of providing basic data for the budget support and spread of the university.

• Journal of Environmental Impact Assessment
• /
• v.10 no.1
• /
• pp.59-71
• /
• 2001

This study aims to propose a determinant model to select a method on calculating weight of each indicator for environmental evaluation. According to analyzing and comparing with three types of methods for calculating weights which are usually used to evaluate environment with indicators, the weights which were obtained by each type were all different from each other. This means that a differential weighting method must be applied to each of environmental evaluation studies. Therefore, a determinant model is required to determine weight-calculating methods. Three types of weighting methods, such as weighting by importance degree, weighting by eigen-value and weighting by analytic hierarchy process, were compared. Under the necessity, a determinant model was drawn for selecting a compatible method to calculate weights of indicators in environmental evaluation.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.12 no.3
• /
• pp.299-308
• /
• 2009

In this paper, we have developed an evaluation model of technology green index(TGI) which includes 3 evaluation factors and 13 indicators. Furthermore, as presenting the degree of relative importance among evaluation factors and indicators for all R&D evaluation stages and all green technology areas, and applying the proposed model to 5 defense projects, we have found applicability of the model to evaluation of defense R&D projects. The results of evaluation using this model can be used to monitor the performance of project life cycle and develop R&D investment strategy of green technology using portfolio analysis.

• The Korean Journal of Health Service Management
• /
• v.9 no.4
• /
• pp.1-12
• /
• 2015

Objectives : The aim of this research was to develop evaluation indicators that ensure safe services and enhance the quality of small-sized dental hospitals within local communities to prepare for the dental hospital accreditation system. Methods : Materials and data from a total of 460 respondents were analyzed after quality improvement indicators were formed by surveying experts and studying documents in Korea and abroad, and by conducting a survey from August 21, 2013 to September 30, 2013 for validation purposes. Results : Based on the results of factor analysis. all measured items appeared to be statistically significant with a factor loading score of at least 0.5, and the correlation between the factors all appeared to be high as well. The goodness-of-fit for the model also appeared to be within the recommended acceptance level. Thus, the proposed evaluation indicators for dental hospital accreditation developed in this study consisted of a total of seven major category factors and a total of 91 detailed items. Conclusions : Furthermore, the results suggest that the evaluation indicators can be used to improve the quality and to ensure the safe services of dental hospitals in local communities.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.113-136
• /
• 2009

The purpose of this study is to develop meta evaluating indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process, evaluation output. And fifty two indicators were developed for this meta evaluation. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adapting the result of experts who performed evaluations for Defense R&D Programs in recent years. Factor Analysis method was used to verify the validity of meta evaluation model. The survey of fifty three members turned out that Cronbach' ${\alpha}$ was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. Analytic Hierarchy Process (AHP) method was used in assigning the evaluation weight. The survey of twenty two members showed that the Consistency Ratio was 0.09 in evaluation components and items.

• Journal of Korean Library and Information Science Society
• /
• v.45 no.1
• /
• pp.217-248
• /
• 2014

The purpose of this study is to construct the school library consulting supervision model and to develop the evaluation indicators of school libraries in Korea. Individual School library should contribute from school educational objectives to national level educational objectives. When school libraries have accountability, consulting supervision and evaluation for the school library education is needed. School library consulting supervision model was developed with seven components. School library evaluation index is proposed with seventy-two indicators in six categories. Results of the evaluation will be able to take advantage consulting supervision.