• Journal of Technology Innovation
• /
• v.14 no.3
• /
• pp.117-154
• /
• 2006

This research examines performance evaluatees' opinions regarding the current institutional performance evaluation systems of Government S&T Research Institutes (GRIs). Under the current evaluation systems, twenty GRIs are grouped into three Research Groups and each Group has its own evaluation systems. One problem of the current institutional evaluation systems is that the systems cannot reflect individual GRIs' characteristics. The following methods are used. First, based on four perspectives of Kaplan & Norton(1992)'s Balanced Scorecard(BSC) model, six perspectives appropriate to GRUs' characteristics are derived. Second, experts classify current performance evaluation measures into the six perspectives. This enables different evaluation systems of three GRI Research Groups to be compared under the same evaluation measures. Third, GRIs' evaluatees are asked to allocate appropriate weights on the performance measures. Evaluatees' weights of a GRI are compared with average weights of the related Group. Finally in every BSC's perspective, GRIs that have extraordinarily over-scored or under-scored weights are analyzed in terms of GRIs' missions, customers, capability of human resources, etc. In the Basic Research Group, the Korea Basic Science Institute is deviated in the financial perspective and the strategic direction perspectives. In the Public Research Group, Korea Institute of Construction Technology is significantly different from other GRIs in three perspectives. Five out of eight GRIs in the Industrial Research Group, GRIs are significantly different each other in several perspectives. It could be concluded that the current institutional evaluation systems are least appropriate in measuring performance of the GRIs of the Industrial Research Group.

• Journal of Korean Institute of Industrial Engineers
• /
• v.29 no.1
• /
• pp.100-113
• /
• 2003

In order to improve business competency by the IS(Information Systems), every enterprise needs to evaluate the current level of IS performance and their utilization. The evaluation that measures the performance of enterprise information systems and diagnoses their effectiveness of business goals and efficiency of resources should represent the useful informations based on sustainable goal-oriented viewpoints to managers. This work develops an integrated evaluation system for continuous maturity of information systems performance, enabling enterprises to achieve their goals of information systems and related business strategies. The integrated evaluation system has been applied to performance measurement of information systems with a huge set of real data from domestic industries for three years, and proven reliable and practical.

• Journal of Korea Multimedia Society
• /
• v.13 no.4
• /
• pp.487-495
• /
• 2010

It has been required to develop an accurate and reliable evaluation method for the performance of biometric systems as their use is getting popular. Among a number of biometric systems, face recognition is one of the most widely used techniques and this leads to develop a stable evaluation method for face recognition systems in order to standardize the performance of face recognition systems. However, it is considered as a difficult task to evaluation such systems due to a large number of factors that affect their performance. Thus, it may be infeasible to take into account all the environmental factors that are related to the performance of face recognition systems and this naturally suggests an evaluation method for the overall performance based on scenarios. In this paper, we have analyzed environmental factors that are related to the performance of general face recognition systems and proposed their evaluation method taking into account those factors. We have proposed an evaluation method based on scenario that considers the combination of individual environment factors instead of evaluating the performance of face recognition systems regarding each factor. Indeed, we have presented examples on the evaluation of face recognition systems based on scenario that takes into account overall environmental factors.

• Journal of Korea Society of Industrial Information Systems
• /
• v.13 no.5
• /
• pp.124-132
• /
• 2008

Most companies in Korea that are implementing six sigma programs evaluate belt's project performance based on their own evaluation systems. Financial performance is a major criterion to evaluate project performance. New project evaluation systems which are based on not only financial performance but also non-financial performance need to be presented for better performance system. The study presents the integration system of balanced scorecard and six sigma project evaluation systems to show balanced view points of performance. Each evaluation index of four view points are presented in the study and could be utilized for alternative project evaluation systems.

• Journal of the Korean Society of Systems Engineering
• /
• v.19 no.2
• /
• pp.117-125
• /
• 2023

Systematic performance evaluation of the Defense Acquisition Program is very important, since they are directly related to national security. In this paper, we reviewed various performance evaluation models from a methodological perspective for pragmatic performance evaluation, and the limitations of each model. In order to evaluate the performance of the Defense acquisition program efficiently, especially for the Naval ship Projects and considering their unique characteristics, both various stakeholders' participation, standard indicators for performance measurement, and tailoring them considering the projects' circumstances are necessary. We also propose indicators, contents, and detailed criteria example for the Requirements management. This approach enables a pragmatic and consistent evaluation of defense projects, and through this, meaningful insights could be acquired with accumulate data.

• International conference on construction engineering and project management
• /
• 2005.10a
• /
• pp.719-724
• /
• 2005

It has been debating on the performance evaluation of professional construction management (PCM) services since its introduction to Taiwan's construction industry more than a decade ago. Several evaluation systems were proposed by previous researchers. However, there has no comparison study been conducted for the feasibility, effectiveness, and appropriateness of these systems to the performance management (PM) of practical PCM services. This paper is intended for this end to compare the existing PCM performance evaluation systems in Taiwan. A real world design/build (D/B) building project was selected for case study. The result of case study concludes and compares the pro's and con's of the three systems. At the end, it recommends strategies for selecting the most appropriate PCM performance evaluation for PCM services.

• Journal of Korea Technology Innovation Society
• /
• v.8 no.3
• /
• pp.1087-1116
• /
• 2005

This research examines performance evaluatees' opinions regarding the institutional performance evaluation systems of Government S&T Research Institutes (GRI). Research methodology is as follows: first, four perspectives of Kaplan & Norton (1992) Balanced Scorecard Model are revised into six perspectives suitable to GRI's characteristics. Second, experts classify current performance evaluation measures into the six perspectives. This enables different evaluation systems of three GRI evaluation groups to be compared under the same evaluation measures. Third, GRI's evaluatees are asked to allocate ideal weights on the performance measures. The evaluatees' weights are compared with the weights of current performance measures, and the characteristics of evaluatees' opinions about current performance evaluation systems are analyzed. Results are as follows; first, six perspectives for Korean GRIs are financial, long-term outcome, short-term outcome, strategic direction, project management, human resources perspectives. second, GRI evaluation systems put the most weights on the long- and short-term outcome perspectives and the least weights on the financial perspective. This result complies with theoretical model: in performance evaluation of GRIs, the customer perspective is the most important one while the financial perspective is the least important one. Third, evaluatees think that the long-term outcome perspective of the Basic-technology GRI group and the short-term outcome perspective of the Applied-technology GRI Group needs more weight. Fourth, it is found that the current systems have more weights on the project management and strategic direction perspectives than evaluatees think. The possible explanation of this result would be that since the measures of these perspectives are relatively easier to set up than those of other perspectives, the current systems contains larger number of measures and, accordingly more weights.

• Journal of Information Technology Services
• /
• v.12 no.3
• /
• pp.273-287
• /
• 2013

The objective of this study is to empirically develop performance evaluation measures for LIS (logistics information systems) based upon BSC (balanced scorecard) model and determine the relative importance among four perspectives of BSC using AHP (analytic hierarchy process) methodology. Above all, forty nine probable measures for evaluating LIS performance were identified through reviewing the previous research related with SCM (supply chain management), logistics management, and information systems evaluation. And then, these probable measures were examined by means of coincidence analyses using three mutually exclusive criteria(validity of content, ease of measurement and reliability of measurement). Data for conducting the coincidence analyses were collected from LIS users and LIS development personnel. As the results of the coincidence analyses, it was found that 31 ones among 49 probable performance evaluation measures theoretically derived could be qualified for LIS performance evaluation. And AHP analysis showed that the weight of each perspective was respectively as follows : 46.8% for financial perspective, 31.3% for customer perspective, 14.8% for internal business process perspective, and 7.1% for learning and growth perspective. The academic contribution of this study is that performance evaluation measures for LIS could be systematically and empirically developed on the basis of BSC. Also, the results of this study are expected to be used as a practice guideline of evaluating and improving LIS.

• Proceedings of the Earthquake Engineering Society of Korea Conference
• /
• 2000.10a
• /
• pp.251-260
• /
• 2000

Seismic performance evaluation systems require rational classification of structure systems, proper evaluation criteria, and their scoring index for synthesis. Current seismic performance systems need expert judgments based on collection of available data, approximate analysis of important items, and various scoring system. This study presents a three-step seismic performance evaluation system for building structures in Korea. Each evaluation step determines the seismic performance and the method depends on the degree of refinement of analysis. The preliminary step evaluation involves the global attributes of structures such as vertical irregularity, asymmetric plan, redundancy, and age of structures. The second step requires an elastic analysis for estimation of forces acting on critical sections and checks the strength and ductility. The final step requires inelastic capacity of structures. Each stephas own evaluation scheme with proper weighing factor dependent on the importance and consequence. This study applies the fuzzy theory to a scoring method that synthesizes the individual quantity to a representative value.

• 제어로봇시스템학회:학술대회논문집
• /
• 1992.10a
• /
• pp.165-170
• /
• 1992

In this paper, the Hardware-In-The-Loop Simulation(HILS) of missile systems are studied. The HILS is an effective performance evaluation technique that bridges the simulation fidelity gap between analytic all-digital simulations and actual flight tests of missile systems. The HILS may be required to perform system integration tests, performance evaluation at system or subsystem level. Major elements of this HILS facility will include the flight table, simulation computers, I/O computer and peripheral equipments. HILS of missile systems typically involve computer modeling of flight dynamics coupled with a hardware guidance and control(G/C) systems. This paper describes a real time performance evaluation technique of a G/C system, Development of a HILS for a Autopilot of SAM G/C will be used as an example.