• Journal of the Korean Operations Research and Management Science Society
• /
• v.32 no.2
• /
• pp.123-140
• /
• 2007

This study focuses on establishing theoretically-reasonable framework of evaluation areas and items for the informatization program and analyzing the weights for each area and item by means of the AHP. To obtain the goal of this research, firstly, based on broadly reviewing previous literature and logical reasoning, the evaluation criteria were Identified and conceptualized, which were 3 evaluation phases, 5 evaluation areas, and 22 evaluation items. Secondly, The data used for calculating the weight values for the evaluation criteria were collected from 48 academic and practical experts in the field of the informatization program promotion using internet survey. Thirdly, the relative weights among evaluation phases, evaluation areas, and its items were derived by AHP analysis. The findings of this study are thought not only to be useful as a practical guideline in performing evaluating the informatization program but also to provide significant basis for constructing the theoretical framework of evaluating method and management of the informatization program.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.46 no.4
• /
• pp.209-217
• /
• 2023

In this study, the evaluation items related to the effectiveness evaluation of the LVC (Live, Virtual, Constructive) training system of the Air Force were derived and the weights of each item were analyzed. The LVC training system evaluation items for AHP (Analytic Hierarchy Process) analysis were divided into three layers, and according to the level, 3 items were derived at level 1, 11 items at level 2, and 33 items at level 3. For weight analysis of evaluation items, an AHP-based pairwise comparison questionnaire was conducted for Air Force experts related to the LVC training system. As a result of the survey, related items such as (1) Achievement of education and training goals (53.8%), (1.2) Large-scale mission and operational performance (25.5%), and (1.2.1) Teamwork among training participants (19.4%) was highly rated. Also, it was confirmed that the weights of evaluation items were not different for each expert group, that is, the priority for importance was evaluated in the same order between the policy department and the working department. Through these analysis results, it will be possible to use them as evaluation criteria for new LVC-related projects of the Air Force and selection of introduction systems.

• Journal of Soil and Groundwater Environment
• /
• v.20 no.7
• /
• pp.13-22
• /
• 2015

In this study, we have developed the performance evaluation model for the optimal soil remediation technology selection. Performance evaluation model is composed in the evaluation of two steps. In the first stage, the candidate technologies are derived according to the conditions of drilling, type and concentration of pollutants, and the saturated/unsaturated of target site. In the second stage, each individual candidate technology is evaluated by performance evaluation model. The performance evaluation model has 5 groups of evaluation items and 12 evaluation items which have their own evaluation index and their own weights through the AHP approach surveying 40 experts. From the case study of actual design cases, the applicability of the performance evaluation model was confirmed.

• Journal of Korean Institute of Industrial Engineers
• /
• v.14 no.1
• /
• pp.57-71
• /
• 1988

Checklist method is rapid and comprehensive to evaluate in practice. Check items are commonly rated by subjective utility function; i.e., evaluator's significant judgment. Since human judgment includes fuzziness (vagueness) inherently in spite of its significance, fuzzy set theory is useful in this case. The paper illustrates a evaluation method using fuzzy checklist where check items are rated as fuzzy numbers. Pairwise comparison data is used to determine the weights of check items, since it has comparative advantage for human's fuzzy judgment. Sample of BASIC program is provided for microcomputer. When uncertainty is due to subjectivity or imprecision of data, this method can be applied to practical problems widely.

• Journal of Technology Innovation
• /
• v.3 no.1
• /
• pp.55-83
• /
• 1995

This paper addresses three central decision-making problems frequently encountered in developing evaluation checklists for ex-post evaluation of R&D projects at private R&D centers: 1) what kind of evaluation elements and factors should be included in the evaluation forms\ulcorner 2) how much weight should be assigned to each evaluation factor and element\ulcorner and 3) could the same evaluation elements and factors with weights be applied all the project type(research, development, and engineering)\ulcorner To answer these questions, we identified the evaluation elements/factors based on the review of relevant literature and measured the perceptions of researchers, R&D managers, and top managements of the three private R&D centers to get the information about the importance levels of the elements and the weights of the factors for each of the three project types. The findings include that 1) all the evaluation elements derived from the literature exhibited high importance levels, and 2) the importance levels of the elements and the weights of the factors were quite varied along the project types. Theoretical and practical implications of the findings for ex-post evaluation of R&D projects are discussed.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.27 no.1
• /
• pp.109-120
• /
• 2004

In large scale complex system such as a nuclear power plant, it is important to select guidelines and/or checklist to evaluate the system performance, especially human performance for visual information while the number of evaluation items of the guidelines and checklist is voluminous. This paper presents the methodology and experiment for the relative weights or priority selection of evaluation items on the advanced information display of main control room in a nuclear power plant. To summarize this, 1) many human factors guidelines of Visual Display Terminal(VDT) displays are collected, 2) the collected guidelines are integrated and unified based on some rules in a way to avoid confusion or errors about work performances of operator groups, 3) using the unified guidelines, the more important items are defined when the advanced information indexes are applied by using the Analytic Hierarchy Process(AHP). For employing the AHP, the decisions and response of many human factors evaluation specialists in this field are collected to get the priority order of the evaluation items of VDT. The result of this paper will be applied for the evaluation of the usability of next generation of nuclear power plant which is focused on the visual information display on VDT.

• Journal of Korean Society for Quality Management
• /
• v.30 no.2
• /
• pp.1-10
• /
• 2002

A performance evaluation model of an R&D module in the quality management system for M Company Is constructed using QFD. The company produces telecommunication devices and employs the performance evaluation model based on ISO 9000 family. However, the model has some problems, one of them is that all check items are regarded as equally important Customer requirements are gathered from internal customers and QFD is utilized to obtain weights for each check item.

• Journal of Wetlands Research
• /
• v.11 no.3
• /
• pp.21-35
• /
• 2009

To propose a sound direction for river rehabilitation plan, the naturalness of the river must be evaluated. In this study, the conventional methods for evaluating the naturalness of rivers proposed by Park, et al. has been improved to estimate the weights for each items subject to assessment and applied adequate Analytic Hierarchy Process (AHP). To estimate the weights, survey was conducted on a group of 83 experts in Civil and Environmental Engineering with a customized questionnaire. The results of the survey were generalized and used to estimate the weights of each items. Among the 14 evaluation items that have been generated as a result of the estimation, a total of 7 weight values such as water quality, variations in water flow, vegetation around minor bed, curve of waterway, vegetation around flood plain, variety in minor bed width, and diversity of stream bed materials appeared to be high. The improved method for evaluating the naturalness of rivers was applied to Hoe-ya River, where the method has successfully discriminated the sections having low degree of naturalness. The proposed assessment method can be employed as a criterion to determine the business zones in the river environment maintenance projects.

• 한국방재학회:학술대회논문집
• /
• 2008.02a
• /
• pp.703-706
• /
• 2008

Structural flood defensive alternatives have been evaluated based on economic feasibility, riskiness of safety and sustainability. Social problems associated with structural flood defensive alternatives such as dams, flood control channels, etc. are currently issued. The evaluation items of policy presented in KDI(2001) are should be modified in order to resolve the social problems. Hence, this study conducted a questionnaire survey of public servants, researchers, and engineers to obtain how to determine evaluation items for policy assessment and to compute their weights in the analytic hierarchy process. This study also compared the weights of the items in KDI(2000) with the weights from the survey in this study. The policy assessment weight was estimated higher than KDI(2000). This result suggests that social awareness increases and the analysis of policy becomes important for selecting optimal structural defensive alternatives.

• Journal of the Korea Society of Computer and Information
• /
• v.23 no.7
• /
• pp.121-129
• /
• 2018

Since 2005, POSCO has been conducting continuous innovation activities using its own innovation methodology, QSS + (Quick Six Sigma Plus). Recently, the effectiveness of QSS + has been decreased owing to the different needs and purposes for each group. The purpose of this study is to compare the weights of the QSS + factors using AHP analysis. QSS + factors consist of two levels. The high level consists of 7 items : 'Master Plan, Waste Zero Activity, Daily Improvement Activity, Talent Development, Project Activity, Initiative/Encouragement activity'. The low level consists of 3 items '5S, My Machine, My M&S' for Daily Improvement Activity. As a result, we found that there was a difference between the weights of the four groups. We suggest the effective QSS + directions to improve the quality of POSCO.