• Journal of Korean Society for Quality Management
• /
• v.50 no.4
• /
• pp.665-677
• /
• 2022

Purpose: The purpose of this study is to analyze the current status and investigate relevant indicators so that R&D performance evaluation suitable for government-funded research institutes can proceed. A suitable performance evaluation model was presented based on the surveyed indicators. Based on the presented performance evaluation model, the importance was analyzed to calculate the weight for each indicator of the performance evaluation model. Methods: The method applied in this study presented a performance evaluation model based on the organizational performance evaluation cases of advanced overseas countries. By using the AHP(Analytic Hierarchy Process) technique, the weight of each indicator of the performance evaluation model was studied. Results: As a result of examining the indicators necessary for the evaluation model, focusing on overseas cases, 13 evaluation items were derived. A weight was calculated for the importance of the study results. And the scientific/technical research results showed the highest excellence. Conclusion: Key indicators of performance evaluation suitable for government-funded research institutes were derived and presented through detailed modeling in three stages. A realistic model that can objectively evaluate the performance of government-funded research institutes was proposed using the AHP technique.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.27 no.2
• /
• pp.123-152
• /
• 2002

This study establishes key success Predictors of internet venture enterprises in Korea. The five factors are derived from the relevant literature and clarified the concept of entrepreneurship, industrial level, enterprise strategy, organizational capability, and resource procurement by distinguishing between its components and determinants. Organizational performance indicators were derived from the previous studies classifying by financial performance indicator and non-financial performance indicator using by recent evaluation method as BSC (Balanced Scorecard). We then examine the impact of critical success factors on the internet venture performance. Hypotheses on five factors of internet venture were tested for 103 organizations. Results indicate that critical success factors may serve as key predictors. Organizational strategy and resource capability was found to be positively influenced on both financial performance indicator and non-financial performance indicator while entrepreneurship, industrial level and organizational capability positively affected only non-financial performance indicator.

• Korean Journal of Community Nutrition
• /
• v.18 no.2
• /
• pp.154-164
• /
• 2013

The objectives of this study were to assign reasonability to importance of weight selection issue in key performance indicator for performance evaluation of Centers for Child-care Foodservice Management (CCFSM) developed by using Balanced Scorecard (BSC), to draw key performance indicator (KPI) by perspective and to analyze differences in recognition on importance. From September 25 to October 9, 2012, we conducted a questionnaire-based study via e-mail, targeting chiefs and team leaders of nationwide 21 CCFSMs (43 persons), officials of local governments where CCFSM was established (21 persons), officials of Korea Food and Drug Administration (2 persons) and foodservice management experts (27 persons) in order to estimate the relative importance on 4 perspectives and 14 KPIs and analyzed its results by using 61 collected data. The results showed that relative importance of perspectives was estimated in order of importance as follows: business performance (0.3519), customer (0.3393), resource (0.1557), learning and growth (0.1531). Relative importance of KPIs was in order of importance as follows: Evaluation of sanitary management level in child-care foodservice facilities (0.1327), Level of customer recognition and behavior improvement (0.1153), performances of round visiting inspection on foodservice, sanitary, safety management, and foodservice consulting (0.0913). Our results showed that the recognition differences exist on the relative importance of perspectives and KPIs between officials of CCFSM, KFDA, local government and foodservice management experts. These observations will form the basis for developing evaluation systems, and it is considered that performance indicators developed on this basis will suggest direction of operation which CCFSM will have to perform.

• Journal of the Korean Institute of Rural Architecture
• /
• v.14 no.1
• /
• pp.45-56
• /
• 2012

This study focuses on design of supplementary evaluation indicator system geared towards comprehensive rearrangement projects in seats of township and town offices. In the first phase, it tries to reveal major problems and issues related to evaluation of the existing small town promotion projects. In terms of analytical tools, this study depends on the Delphi and AHP techniques. In specific, after three rounds of the Delphi methods, it extracts a series of alternative evaluation indicators derived from the AHP methods. It covers 5 major evaluation criteria, under which 18 independent items are hierarchically interconnected. It expects that these alternative evaluation indicators would contribute to selecting appropriate small town promotion projects. Next, applying these evaluation indicators, we examine couples of comprehensive rearrangement projects in seats of township and town offices. From the comparative contexts, we believe that the proposed alternative evaluation criteria would improve the general satisfaction level of key stakeholders in deciding the priority order of the small town promotion projects.

• Journal of Korean Society for Quality Management
• /
• v.47 no.4
• /
• pp.767-781
• /
• 2019

Purpose: The purpose of this study is to derive key evaluation indicators to improve the quality of daycare centers by identifying the relationships among the 18 evaluation indicators of the daycare evaluation system using the DEMATEL technique. Methods: In this study, the questionnaires are completed by 17 daycare center directors who have received accreditation of daycare center. They are requested to consider the level of direct influence between two evaluation indicators. A DEMATEL analysis was conducted based on the survey results. Results: The result of the study shows that the most important indicators of daycare center quality are directors leadership, institutional operations and professionalism of staff. Among evaluation areas, educational childcare curriculum & interactions is affected by all areas, and staff area affect all areas. Conclusion: The evaluation areas and indicators of the daycare center are judged to be well-balanced. It is expected that the findings of the key evaluation indicators that should be prioritized among the evaluation indicators will be helpful to those preparing for the evaluation of the daycare center.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.44 no.1
• /
• pp.17-25
• /
• 2021

Ammunition Demilitarization facility (ADF) should be set up the feasible goals and continue to operate, taking into account non-profit characteristics. However, due to the lack of performance measurement methods in ADF, which are essential to national policy at a significant cost each year, the reliability of the evaluation results can be insufficient. In this paper, the Balanced Score Card (BSC) method was applied that could be evaluated to reflect the financial and non-financial features. The relevant literature research and army regulations reflected the results of various interviews of the expert group. The extraction of success performance area in ADF was confirmed using the BSC method and the Decision Variable (DV) candidate was created to use regression for selecting the DV. Additionally, the key performance indicator was presented by verification the feasibility of content by conducting the survey of experts. The implications of this paper are as follows. First, the proposed BSC model was found to be suitable for practical use in ADF reflecting the non-profit characteristics. Second, accurate evaluation of ADF can contribute to long-term development of ADF. Finally, it can be applied to the management process of the other military sector, so it can be expected to play a role in providing basic data and spreading it to other areas.

• Health Policy and Management
• /
• v.13 no.4
• /
• pp.1-27
• /
• 2003

The purpose of this study was to develop the evaluation indicator for the health promotion programs of the Community Health Centers and to test its validity. The modified logic model was used as the evaluation model based on the literature reviews. Using this model, four dimensions, eleven sub­dimensions, and forty­one individual indicators were developed. These evaluation indicators are superior in reflecting the distinctiveness of the community health promotion programs, and also flexible enough to accommodate diverse programs. These indicators also emphasize the role of process evaluation, and the diversity of outcomes. To test content validity, survey method of experts in the community health promotion field was conducted. Eleven in three expert groups(professionals, practitioners in Community Health Centers, and policy makers) generally agreed with the validity of evaluation indicators. To examine criteria and construct validity, these indicators were used to evaluate the health promotion programs conducted by the 18 Key Community Health Centers. The data came from the interview surveys of the main health promotion practitioner and 30 visitors from each center. The ranks of these eighteen Community Health Centers were computed from these data. There was no significant difference in ranking either by these indicators or by the existing indicators, which was developed by Technical Support and Evaluation Team for criteria validity. There was no statistically significant difference in ranking between input, process and outcome dimensions. Based on these study results, evaluation indicators developed in this study are valid to evaluate Community Health Center's health promotion program. It can be used both by the Community Health Center for internal evaluation, and by the stakeholders for external evaluation.

• Journal of Korean Institute of Industrial Engineers
• /
• v.39 no.1
• /
• pp.1-9
• /
• 2013

The current manufacturers have generated tremendous amount of digitized product data to efficiently share and exchange it with other stakeholders or various software systems for product development. The digitized product data is a valuable asset for manufacturers, and has a potential to support high level strategic decision makings needed at many stages in product development. However, the lack of studies on extraction of key performance indicators(KPIs) from product data management(PDM) databases has prohibited manufacturers to use the product data to support the decision makings. Therefore this paper examines a possibility of an architecture that supports KPIs for evaluation of product development performances, by applying multidimensional product data model and on-line analytic processing(OLAP) to operational databases of product data management. To validate the architecture, the paper provides a prototype product data management system and OLAP applications that implement the multidimensional product data model and analytic processing.

• International Journal of Quality Innovation
• /
• v.8 no.3
• /
• pp.156-172
• /
• 2007

The high-tech industry is the economic lifeline for Taiwan. Its characteristics are short product life cycle, rapid changes in the market, and a high obsolescence rate for new products. Under globalization, the high-tech industry has adopted Information Technology (IT) to shorten the manufacturing process, reduce costs and conduct product research and development (R&D) to increase the core competence of enterprises and achieve the goal of sustainable operations. Enterprises should actively strengthen their integration with internal and external resources and lead in R&D management to increase industrial operating performance. Effectively managing operations and R&D management evaluation in Taiwan's High-tech Industry has become a critical subject. This study adopted 4 major Balanced Scorecard (BSC) perspectives to establish the Total Performance Evaluation Indicators for the R&D management department in Taiwan's High-tech Industry. The Analytic Network Process (ANP) was applied to evaluate the overall performance of the R&D management department. The research framework is divided into 2 phases. The first phase is combined with the 4 major perspectives, Financial, Customer, Internal Business Process and Learning and Growth, as the related indicators for each measurement perspective. The Key Performance Indicators (KPI) were selected using Factor Analysis to identify the key factor from the complicated indicators. The relationship between the characteristics of each BSC's evaluation perspective is dependence and feedback. This study applied ANP to conduct the calculation and adjustment of correlation between each KPI, and determine on their relative weights for the objective KPI. The "Financial Perspective" for R&D management department in Taiwan's High-tech Industry focused on the budget achievement rate of R&D management. The weight indicator value is (0.05863). The "Customer Perspective" focused on problem-solving satisfaction. The weight value of this indicator is (0.17549). The "Internal Business Process Perspective" focused on the quantity and quality of R&D. The weight value of this indicator is (0.13506). The "Learning and Growth Perspective" focused on improving competence in the research personnel's professional techniques. The weight value of this indicator is (0.02789). From the total weighting indicators, the order of the Performance Indicators for the R&D management department in Taiwan's High-tech Industry is: (1) Customer Perspective; (2) Internal Business Process Perspective; (3) Financial Perspective; and (4) Learning and Growth Perspective.

• Nuclear Engineering and Technology
• /
• v.46 no.1
• /
• pp.81-92
• /
• 2014

This study suggests 5 evaluation criteria (safety and technology, environmental impact, economic feasibility, social factors, and institutional factors) and 24 evaluation indicators for a NFC (nuclear fuel cycle) derived using factor analysis. To do so, a survey using 1 on 1 interview was given to nuclear energy experts and local residents who live near nuclear power plants. In addition, by conducting a factor analysis, homogeneous evaluation indicators were grouped with the same evaluation criteria, and unnecessary evaluation criteria and evaluation indicators were dropped out. As a result of analyzing the weight of evaluation criteria with the sample of nuclear power experts and the general public, both sides recognized safety as the most important evaluation criterion, and the social factors such as public acceptance appeared to be ranked as more important evaluation criteria by the nuclear energy experts than the general public.