• Title/Summary/Keyword: Evaluation of Model Performance

Search Result 3,659, Processing Time 0.033 seconds

Constructing a Performance Evaluation Model of an R&D Module in Quality Management System Using QFD (QFD를 이용한 품질경영 시스템의 개발모듈에 대한 이행도 평가모형)

  • 류문찬;우성권
    • Journal of Korean Society for Quality Management
    • /
    • v.30 no.2
    • /
    • pp.1-10
    • /
    • 2002
  • A performance evaluation model of an R&D module in the quality management system for M Company Is constructed using QFD. The company produces telecommunication devices and employs the performance evaluation model based on ISO 9000 family. However, the model has some problems, one of them is that all check items are regarded as equally important Customer requirements are gathered from internal customers and QFD is utilized to obtain weights for each check item.

The Design and Implementation of a Performance Evaluation Tool for the Face Recognition System (얼굴인식시스템 성능평가 도구의 설계 및 구현)

  • Shin, Woo-Chang
    • Journal of Information Technology Services
    • /
    • v.6 no.2
    • /
    • pp.161-175
    • /
    • 2007
  • Face recognition technology has lately attracted considerable attention because of its non-intrusiveness, usability and applicability. Related companies insist that their commercial products show the recognition rates more than 95% according to their self-testing. But, the rates cannot be admitted as official recognition rates. So, performance evaluation methods and tools are necessary to objectively measure the accuracy and performance of face recognition systems. In this paper, I propose a reference model for biometrics recognition evaluation tools, and implement an evaluation tool for the face recognition system based on the proposed reference model.

A Study on the Design of EA Performance Evaluation Model and the Application Case (EA성과평가 모델의 설계 및 적용사례에 관한 연구)

  • Lee, Seok-Kyun;Lee, Young-Min;Rhew, Sung-Yul
    • The KIPS Transactions:PartD
    • /
    • v.16D no.3
    • /
    • pp.395-406
    • /
    • 2009
  • Korean government has operated EA by the act on efficient introduction of information system and operation, etc. But the evaluation system for EA and the criteria don't prepare well. Particularly, There is no model for EA performance measurement and the way is insufficient. In this study, we derived 8 areas and 17 criteria for the performance evaluation based on the Performance Reference Model of U.S FEA and Korea. And we also derived 8 areas and 10 criteria for it based on the OMB EA Assessment Framework and the EA maturity model in Korea. We propose the performance evaluation model of the five areas that consists of the business performance, customer performance, process, human resource and the technology for EA performance evaluation. To verify the model, we applied the model to three organizations and evaluated EA performance. In addition, we compared the performance result with the performance evaluation area of EA maturity model of Korea to verify the result. We also analyzed the criteria of the proposed performance evaluation model with the current EA maturity model and Performance Reference Model of Korea. As a result of the evaluation, we verified of the proposed performance evaluation model, too.

An Extended Model Evaluation Method using Multiple Assessment Indices (MAIs) under Uncertainty in Rainfall-Runoff Modeling (강우-유출 모델링의 불확실성 고려한 다중 평가지수에 의한 확장형 모형평가 방법)

  • Lee, Gi-Ha;Jung, Kwan-Sue;Tachikawa, Yasuto
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2010.05a
    • /
    • pp.591-595
    • /
    • 2010
  • Conventional methods of model evaluation usually rely only on model performance based on a comparison of simulated variables to corresponding observations. However, this type of model evaluation has been criticized because of its insufficient consideration of the various uncertainty sources involved in modeling processes. This study aims to propose an extended model evaluation method using multiple assesment indices (MAIs) that consider not only the model performance but also the model structure and parameter uncertainties in rainfall-runoff modeling. A simple reservoir model (SFM) and distributed kinematic wave models (KWMSS1 and KWMSS2 using topography from 250m, 500m, and 1km digital elevation models) were developed and assessed by three MAIs for model performance, model structural stability, and parameter identifiability. All the models provided acceptable performance in terms of a global response, but the simpler SFM and KWMSS1 could not accurately represent the local behaviors of hydrographs. In addition, SFM and KWMSS1 were structurally unstable; their performance was sensitive to the applied objective functions. On the other hand, the most sophisticated model, KWMSS2, performed well, satisfying both global and local behaviors. KMSS2 also showed good structural stability, reproducing hydrographs regardless of the applied objective functions; however, superior parameter identifiability was not guaranteed. Numerous parameter sets could lead to indistinguishable hydrographs. This result supports that while making a model complex increases its performance accuracy and reduces its structural uncertainty, the model is likely to suffer from parameter uncertainty. The proposed model evaluation process can provide an effective guideline for identifying a reliable hydrologic model.

  • PDF

Performance Evaluation for Public u-IT Services using a Proposed Three-dimensional Model (3차원 평가모델을 이용한 공공 u-IT 서비스 성능분석)

  • Kim, Jae-Won;Kim, Se-Jin;Byun, Jong-Bong
    • Journal of Digital Convergence
    • /
    • v.9 no.6
    • /
    • pp.165-172
    • /
    • 2011
  • In this paper, we introduce an integrated performance evaluation model defined by the three indices (evaluation index for each evaluation stage, performance viewpoint, and performance type) and analyze the utilization and satisfaction of the seven public u-IT services implemented from 2008 to 2009 using the proposed model. From the performance results of the public u-IT services, it was found out that most of the research goals initially set by the public u-IT service support projects were satisfied. Furthermore, we suggest improvement directions and promotion strategies of future projects.

A Case Study on Efficiency Evaluation of DMUs Performances for Digital Pioneer Project by Data Envelopment Analysis Model (DEA를 활용한 차세대첨단콘텐츠육성사업 참여 DMU의 효율성 평가에 관한 사례 연구)

  • Shin, Jae-Shig;Yang, Hae-Sool
    • Journal of Information Technology Services
    • /
    • v.6 no.1
    • /
    • pp.65-81
    • /
    • 2007
  • Recently, the affiliates of the Ministry of Information and Communication have been conducting a performance evaluation study on IT policy projects, based on the performance evaluation model of the U.S. Office of Management and Budgets, with regard to investment in computerization. The performance evaluation model for the policy project could provide the objective information required for the planning, development, and operation of the policy project. However, the performance of the most policy project is likely to be evaluated using the subjective evaluation criteria of evaluators. Therefore, this case study evaluates the relative efficiency using DEA (Data Envelopment Analysis) in order to improve the performance evaluation method of the digital pioneer' project implemented by the Korea IT Industry Promotion Agency. The improvement value of inefficient Decision Making Units (DMUs) was measured by a static efficiency analysis. The measured value will suggest a objective viewpoint of the performance between DMUs to evaluators. In doing so, it will show an appropriate direction for the policy project to be evaluated successfully.

A Performance Evaluation Mode1 for Information Systems using the Balanced Scorecard and the Value Chain : A Case Study (BSC와 가치사슬을 이용한 정보시스템의 성과 측정 방법 : 제조업체 사례분석)

  • 최경현;김태균
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.27 no.2
    • /
    • pp.63-79
    • /
    • 2002
  • During the last decade many enterprises spent a huge amount of money for investment on Information Technology (IT) & Information System (IS) to attain competitive advantage and to maximize their business performance by satisfying the various requirements of customers. Under such circumstances, methodologies for evaluating IT impact on business performance are very important issues for strategic decision making on investment. In this study, we propose a performance evaluation model that adopts the concept of the Balanced Scorecard (BSC) and the Value Chain to analyze the financial impact and non-financial impact of IT & IS at each critical work area. This model combines the 4 evaluation areas from BSC and 6 critical work areas from Value Chain and measures the Key Performance Indicator (HPI) and the effect of KPI. Also, we present a case study of which the evaluation model has been conducted on a major manufacturing company. finally. we address some important notes to improve the IT & IS performances in the real-world.

Designing a Hydro-Structural Ship Model to Experimentally Measure its Vertical Bending and Torsional Vibrations

  • Houtani, Hidetaka;Komoriyama, Yusuke;Matsui, Sadaoki;Oka, Masayoshi;Sawada, Hiroshi;Tanaka, Yoshiteru;Tanizawa, Katsuji
    • Journal of Advanced Research in Ocean Engineering
    • /
    • v.4 no.4
    • /
    • pp.174-184
    • /
    • 2018
  • We herein propose a new design procedure of a flexible container ship model where the vertical bending and torsional vibration modes are similar to its prototype. To achieve similarity in torsional vibration mode shapes, the height of the shear center of the model must be located below the bottom hull, similar to an actual container ship with large opening decks. Therefore, we designed a ship model by imparting appropriate stiffness to the hull, using urethane foam without a backbone. We built a container ship model according to this design strategy and validated its dynamic elastic properties using a decay test. We measured wave-induced structural vibrations and present the results of tank experiments in regular and freak waves.

Development of performance evaluation model for road and railway tunnels in use

  • Kim, Hong-Kyoon;Moon, Joon-Shik;An, Jai-Wook;Michael, E.S.
    • Geomechanics and Engineering
    • /
    • v.29 no.3
    • /
    • pp.369-376
    • /
    • 2022
  • Accurately evaluating and predicting the performance of facilities is a key task in establishing a maintenance strategy for facilities. The importance of performance evaluation is becoming more pronounced, especially when the aging of facilities requires a huge budget. In this study, performance assessment models were developed for road and railway tunnels. Delphi analysis was performed to identify sub-elements necessary to evaluate the performance of a tunnel. The relative importance of the evaluation factors was derived from the AHP analysis. The correlation analysis was performed between each assessment factor and the final result to verify the significance of the model. For the correlation analysis, the survey data measured through precision safety diagnosis in tunnels in use was applied. The cost effectiveness analysis was also conducted according to the scenarios with different composition of performance factors in order to improve the practical applicability of the evaluation model developed in this study.

A Study on the Previous Evaluation Model for Safety Performance of Construction Companies (건설회사의 사전 안전성 평가모델에 관한 연구)

  • 손창백;홍성호
    • Journal of the Korean Society of Safety
    • /
    • v.18 no.2
    • /
    • pp.73-78
    • /
    • 2003
  • In order to improve the safety performance oi construction projects, effective and corporative safety management program between head office and job site must be implemented. And its performance must be measured and analyzed for the identification of the problems in the safety management area. This study proposes a previous evaluation model of safety performance for the large construction firm in order to enhance their safety level. The fundamental data for proposed model is based on the past research(Son 2002), which is structured of evaluation criteria. weighted factor. statistical evaluation formula. The model would help the firm management in identifying the weak areas of safety performance in terms of the degree performing certain safety tasks. It is expected that the model could contribute to achieving the "zero accident" level.ot; level.