• Journal of Korean Society for Quality Management
• /
• v.51 no.2
• /
• pp.185-202
• /
• 2023

Purpose: The purpose of this study is to identify key performance evaluation items and factors that are effective and practical for project management of defense standard standard improvement projects, and to develop a quantitative performance evaluation model. Methods: For the development of a performance evaluation model for defense standard improvement projects, we analyzed past major project performance and derived evaluation items and factors. To increase the objectivity and efficiency of project evaluation, we developed an evaluation index that enables relative evaluation of evaluation targets, and calculated the main importance of evaluation items using the Analytic Hierarchy Process (AHP) method based on the main opinions of expert groups. Results: The study resulted in the identification of main performance items for defense standard improvement projects, which were classified into defense standard conformity review performance and defense standard improvement performance items. We also simplified the evaluation model by integrating various evaluation items into similar evaluation factors. Additionally, we developed a quantitative evaluation index that enables relative evaluation of the targets and verified the objectivity and validity of the suggested performance evaluation model by reevaluating it using performance data from past commissioned professional institutions Conclusion: Developing a quantitative evaluation model for defense standard improvement projects is expected to provide a means of measuring the effectiveness of the project, and to be used as a tool to determine the appropriateness and effectiveness of medium and long-term project plans.

• Proceeding of Spring/Autumn Annual Conference of KHA
• /
• 2009.04a
• /
• pp.288-293
• /
• 2009

The evaluation of the quality of residential environment may be different according to the experts' characteristics. This study aimed at estimating the relative weights of the constituents of a residential environment by AHP(Analytic Hierarchy Process) through experts' evaluation. The respondent group was composed of 72 experts in the fields of architectural design, housing design, urban design, and urban planning. The findings are as follows(:) 1) the relative weights of residential constituents were different between detailed fields ; 2) the relative weights of residential constituents were not different according to institute in which experts are engaged ; and 3) for the practical application of estimation results of the relative weights, the relation between residential performance constituents and physical design elements should be considered in future.

• Korean Journal of Community Nutrition
• /
• v.18 no.2
• /
• pp.154-164
• /
• 2013

The objectives of this study were to assign reasonability to importance of weight selection issue in key performance indicator for performance evaluation of Centers for Child-care Foodservice Management (CCFSM) developed by using Balanced Scorecard (BSC), to draw key performance indicator (KPI) by perspective and to analyze differences in recognition on importance. From September 25 to October 9, 2012, we conducted a questionnaire-based study via e-mail, targeting chiefs and team leaders of nationwide 21 CCFSMs (43 persons), officials of local governments where CCFSM was established (21 persons), officials of Korea Food and Drug Administration (2 persons) and foodservice management experts (27 persons) in order to estimate the relative importance on 4 perspectives and 14 KPIs and analyzed its results by using 61 collected data. The results showed that relative importance of perspectives was estimated in order of importance as follows: business performance (0.3519), customer (0.3393), resource (0.1557), learning and growth (0.1531). Relative importance of KPIs was in order of importance as follows: Evaluation of sanitary management level in child-care foodservice facilities (0.1327), Level of customer recognition and behavior improvement (0.1153), performances of round visiting inspection on foodservice, sanitary, safety management, and foodservice consulting (0.0913). Our results showed that the recognition differences exist on the relative importance of perspectives and KPIs between officials of CCFSM, KFDA, local government and foodservice management experts. These observations will form the basis for developing evaluation systems, and it is considered that performance indicators developed on this basis will suggest direction of operation which CCFSM will have to perform.

• Journal of Korean Library and Information Science Society
• /
• v.39 no.4
• /
• pp.71-96
• /
• 2008

Recently, some universities and university libraries have implemented performance management system as a part of managerial innovation, and they have either implemented or are considering implementing BSC. Thus there are needs to develop performance indicator, which is a tool measuring performance of university libraries, based on BSC, and to assess the developed performance indicator's relative weights to analyze which indicators are essential to fulfill and improve the university library's mission. The performance indicators are also affected by the characteristics and perspectives of the people who develop them during the development process. Therefore, it is necessary to analyze the differences among the professional groups in relative weighting of the performance indicator. The purposes of this study are to derive a university library performance indicator model based on BSC, to analyze the importance of each evaluation factor of the derived performance indicator model, and to analyze the differences among the professional groups in relative weighting of the performance indicator model.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.19 no.39
• /
• pp.219-227
• /
• 1996

For the equitable and objective evaluation of the performances of R & D (Research and Development) Projects, the quantitative evaluation of research products was performed. In this research, the AHP(Analytic Hierarchy Process) technique was used to calculate the relative importance(weight) of research products such as patents, thesis, conferences and man-power with make up individual questions. With calculated relative weight of research products, the model that gives the quantitative grades of research products was studied.

• Journal of Information Technology Services
• /
• v.6 no.1
• /
• pp.65-81
• /
• 2007

Recently, the affiliates of the Ministry of Information and Communication have been conducting a performance evaluation study on IT policy projects, based on the performance evaluation model of the U.S. Office of Management and Budgets, with regard to investment in computerization. The performance evaluation model for the policy project could provide the objective information required for the planning, development, and operation of the policy project. However, the performance of the most policy project is likely to be evaluated using the subjective evaluation criteria of evaluators. Therefore, this case study evaluates the relative efficiency using DEA (Data Envelopment Analysis) in order to improve the performance evaluation method of the digital pioneer' project implemented by the Korea IT Industry Promotion Agency. The improvement value of inefficient Decision Making Units (DMUs) was measured by a static efficiency analysis. The measured value will suggest a objective viewpoint of the performance between DMUs to evaluators. In doing so, it will show an appropriate direction for the policy project to be evaluated successfully.

• Journal of the Korean housing association
• /
• v.20 no.2
• /
• pp.69-76
• /
• 2009

The evaluation of the quality of residential environment, in the planning process, is very important. If the environmental quality can be measured on the design scheme itself, it would be possible not only to estimate the residential environment, but also to apply the results of measuring in the planning and design of new residential projects. This study aimed at estimating the relative weights of the constituents of a residential environment by AHP (Analytic Hierarchy Process). For the detailed analysis of relative weights, the respondent of survey were composed of two different groups-dwellers and experts. The findings are as follows (:) 1) the relative weights of residential constituents were different between the respondent groups; 2) the relative weights of residential constituents were different according to socio-demographic characteristics; and 3) for the practical application of estimation results of the relative weights, the relation between residential performance constituents and physical design elements should be considered.

• Geomechanics and Engineering
• /
• v.29 no.3
• /
• pp.369-376
• /
• 2022

Accurately evaluating and predicting the performance of facilities is a key task in establishing a maintenance strategy for facilities. The importance of performance evaluation is becoming more pronounced, especially when the aging of facilities requires a huge budget. In this study, performance assessment models were developed for road and railway tunnels. Delphi analysis was performed to identify sub-elements necessary to evaluate the performance of a tunnel. The relative importance of the evaluation factors was derived from the AHP analysis. The correlation analysis was performed between each assessment factor and the final result to verify the significance of the model. For the correlation analysis, the survey data measured through precision safety diagnosis in tunnels in use was applied. The cost effectiveness analysis was also conducted according to the scenarios with different composition of performance factors in order to improve the practical applicability of the evaluation model developed in this study.

• Journal of the Korean Institute of Navigation
• /
• v.18 no.4
• /
• pp.33-47
• /
• 1994

On developing port system, the performance tests of system in relation to ship maneuver generally consists of the three parts: the channel transit, the manoeuvring in a turning basin and the docking/undocking. The quantifications of risk of an accident has priviously been difficult due to the low occurrence of accidents relative to the number of transits. Additionally, accident statistics could not be related port system because of the large number of factors contributing to the accident. such as human error, equipment failure, visibility, light, traffic. etc. In case of the channel transit, "Relative Risk Factor(RRF)" or "Relative Risk Factor for Meeting Traffic" was proposed as the as the measures derived to quantify the relative risk of accident by M.W.Smith. This factor measure the tracking performance, the turning performance and the passing performance at meeting traffic. On the other hand, the safety of berthing maneuver is not measured with a few evaluating factors as controlled due to complex controllabilites such as steering, engine, side thrusters or tugs. This work, therefore, aims to propose the evaluating measure by the Analytic Hierarchy Process(AHP). Six experimental scenarios were establised under the various environmental conditions as independent variables. In every simulation, the difficulty of maneuver was scored by captain and compared with AHP scores. The results show almost same and from which the weights of eight evaluating factors could be fixed. Additionally, the limit value of relative factor in berthing safety to six scenarios could be estimated to 0.11.e estimated to 0.11.

• Journal of Technology Innovation
• /
• v.10 no.1
• /
• pp.201-217
• /
• 2002

Researchers, institutes, and government involved in research & development (R&D) are faced with the problem of performing R&D project evaluations. As a real-word case of evaluation, we elicited and reproduced the evaluation process of the national nuclear R&D projects, using a specific case study of Korea. In the methodology, the analytic hierarchy process (AHP) is employed to evaluate and rank the selected nuclear R&D projects which have a wide range of evaluation objectives and characteristics. As a result, we obtained relative ranking for research projects and importance of evaluation criteria. The method and implications can be easily understood and applied by practitioners since it follows naturally the standard practice of evaluating and relative comparisons of performance using evaluation procedures. By applying particular R&D project output to the procedures, project evaluators can compare and prioritize evaluation objectives.