• Title/Summary/Keyword: Model Validation & Evaluation

Search Result 392, Processing Time 0.03 seconds

A Study on Robust Identification Based on the Validation Evaluation of Model (모델의 타당성 평가에 기초한 로바스트 동정에 관한 연구)

  • Lee, D.C.
    • Journal of Power System Engineering
    • /
    • v.4 no.3
    • /
    • pp.72-80
    • /
    • 2000
  • In order to design a stable robust controller, nominal model, and the upper bound about the uncertainty which is the error of the model are needed. The problem to estimate the nominal model of controlled system and the upper bound of uncertainty at the same time is called robust identification. When the nominal model of controlled system and the upper bound of uncertainty in relation to robust identification are given, the evaluation of the validity of the model and the upper bound makes it possible to distinguish whether there is a model which explains observation data including disturbance among the model set. This paper suggests a method to identity the uncertainty which removes disturbance and expounds observation data by giving a probable postulation and plural data set to disturbance. It also examines the suggested method through a numerical computation simulation and validates its effectiveness.

  • PDF

A Study on Robust Identification Based on the Validation Evaluation of Model (모델의 타당성 평가에 기초한 로바스트 동정에 관한 연구)

  • Lee, Dong-Cheol;Chung, Hyung-Hwan;Bae, Jong-Il
    • Proceedings of the KIEE Conference
    • /
    • 2000.07d
    • /
    • pp.2690-2692
    • /
    • 2000
  • In order to design a stable robust controller, nominal model, and the upper bound about the uncertainty which is the error of the model are needed. The problem to estimate the nominal model of controlled system and the upper bound of uncertainty at the same time is called robust identifcation. When the nominal model of controlled system and the upper bound of uncertainty in relation to robust identifcation are given, the evaluation of the validity of the model and the upper bound makes it possible to distinguish whether there is a model which explains observation data including disturbance among the model set. This paper suggests a method to identify the uncertainty which removes disturbance and expounds observation data by giving a probable postulation and plural data set to disturbance. It also examines the suggested method through a numerical computation simulation and validates its effectiveness.

  • PDF

A Study on the Method of Constructive Simulation Operation Analysis for Warfighting Experiment Supplied with the Validation Evaluation (타당성 평가가 보완된 모델 운용상의 전투실험 모의분석 절차 연구)

  • Park, Jin-Woo;Kim, Nung-Jin;Kang, Sung-Jin;Soo, Hyuk
    • Journal of the Korea Society for Simulation
    • /
    • v.19 no.4
    • /
    • pp.77-87
    • /
    • 2010
  • Currently, our society has been changed from the industrial society to the information society. As the war progresses to Information Warfare, Network-Centric Warfare, Long-Range Precision Engagement and Robot Warfare, the military should advance to High-tech Scientific force. For this creation of the war potential, it is regarded as the warfighting experiment is a critical method. Surely it is rational that LVC(Live Virtual Constructive simulation) is desirable to make the warfighting experiment. But because it is limited by the cost, the time, the place and the resource, the constructive simulation(M&S : Modeling&Simulation) is a good tool to solve those problems. There are some studies about the evaluation process for developing the model, but it is unsatisfying in the process of the constructive simulations' operation. This study focuses on the way of constructive simulation operation, which is supplied with the evaluation process(VV&A : Verification Validation & Accreditation). We introduce the example of the rear area operation simulation for "appropriateness evaluation to the organization of logistic corps" by the AWAM(Army Weapon Analysis Model). This study presents the effective methods of the constructive simulations, which is based on the reliable evaluation process, so it will contribute to the warfighting experiments.

Study on Damage Evaluation Model for Reinforced Concrete Members (철근콘크리트 부재의 손상량 평가 모델에 관한 연구)

  • Cho, Byung Min;Maeda, Masaki;Kim, Taejin
    • Journal of the Earthquake Engineering Society of Korea
    • /
    • v.19 no.2
    • /
    • pp.75-83
    • /
    • 2015
  • The purpose of this study is to improve the previous damage evaluation model for RC members which is proposed by Igarashi[1] in 2010.The previous model was not confirmed by enough data of damage such as, residual crack length, width and area for exfoliation of concrete, etc. In addition, validation of the model is still insufficient. Therefore, experiment of a real-scale RC structure and experiment of RC columns using the high-strength concrete were conducted to gather the data of damage in RC members. The investigation has been conducted gathering the data not only additional experiments data but also existing data for modification of damage evaluation model. It has been investigated on changing damage in RC due to axial force ratio, shear reinforcement and shear span ratio. As a result, several problems were founded in the previous model, such as, hinge length($l_p$), spacing of flexural crack($S_{av,f}$), total width of flexural cracks regulated by maximum width of flexural crack($n_f$) and total width of shear cracks regulated by maximum width of shear crack($n_s$). New model is proposed and evaluated the damage properly.

The Validation Test process and CTE Suitability Evaluation based on IEC-61508 for Improving Safety and Reliability on Unmanned ICT Parcel Storage

  • Myung Sung Kim;Young Min Kim
    • International journal of advanced smart convergence
    • /
    • v.12 no.3
    • /
    • pp.233-243
    • /
    • 2023
  • In modern society, since the expansion of the e-commerce market and the spread of the pandemic, face-to-face business are gradually changing to non-face-to-face. In the logistics industry, the demand for unmanned courier storage is increasing due to lack of loading space from urbanization and courier theft accidents. As the demand for unmanned parcel lockers increases, improved functions such as food storage and efficient space loading are required. This study develops an integrated model-based evaluation procedure of product based on performance factors according to the IEC 61508 standard for newly unmanned parcel storage devices with active loading technology, and derive Critical Technology Element based on the product's core functions and performance goals. As proposing these research, We expect improve the safety and reliability of development targets by identifying and evaluating elements.

Evaluation of Regression Models with various Criteria and Optimization Methods for Pollutant Load Estimations (다양한 평가 지표와 최적화 기법을 통한 오염부하 산정 회귀 모형 평가)

  • Kim, Jonggun;Lim, Kyoung Jae;Park, Youn Shik
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2018.05a
    • /
    • pp.448-448
    • /
    • 2018
  • In this study, the regression models (Load ESTimator and eight-parameter model) were evaluated to estimate instantaneous pollutant loads under various criteria and optimization methods. As shown in the results, LOADEST commonly used in interpolating pollutant loads could not necessarily provide the best results with the automatic selected regression model. It is inferred that the various regression models in LOADEST need to be considered to find the best solution based on the characteristics of watersheds applied. The recently developed eight-parameter model integrated with Genetic Algorithm (GA) and Gradient Descent Method (GDM) were also compared with LOADEST indicating that the eight-parameter model performed better than LOADEST, but it showed different behaviors in calibration and validation. The eight-parameter model with GDM could reproduce the nitrogen loads properly outside of calibration period (validation). Furthermore, the accuracy and precision of model estimations were evaluated using various criteria (e.g., $R^2$ and gradient and constant of linear regression line). The results showed higher precisions with the $R^2$ values closed to 1.0 in LOADEST and better accuracy with the constants (in linear regression line) closed to 0.0 in the eight-parameter model with GDM. In hence, based on these finding we recommend that users need to evaluate the regression models under various criteria and calibration methods to provide the more accurate and precise results for pollutant load estimations.

  • PDF

Development and validation of novel simple prognostic model for predicting mortality in Korean intensive care units using national insurance claims data

  • Ah Young Leem;Soyul Han;Kyung Soo Chung;Su Hwan Lee;Moo Suk Park;Bora Lee;Young Sam Kim
    • The Korean journal of internal medicine
    • /
    • v.39 no.4
    • /
    • pp.625-639
    • /
    • 2024
  • Background/Aims: Intensive care unit (ICU) quality is largely determined by the mortality rate. Therefore, we aimed to develop and validate a novel prognostic model for predicting mortality in Korean ICUs, using national insurance claims data. Methods: Data were obtained from the health insurance claims database maintained by the Health Insurance Review and Assessment Service of South Korea. From patients who underwent the third ICU adequacy evaluation, 42,489 cases were enrolled and randomly divided into the derivation and validation cohorts. Using the models derived from the derivation cohort, we analyzed whether they accurately predicted death in the validation cohort. The models were verified using data from one general and two tertiary hospitals. Results: Two severity correction models were created from the derivation cohort data, by applying variables selected through statistical analysis, through clinical consensus, and from performing multiple logistic regression analysis. Model 1 included six categorical variables (age, sex, Charlson comorbidity index, ventilator use, hemodialysis or continuous renal replacement therapy, and vasopressor use). Model 2 additionally included presence/absence of ICU specialists and nursing grades. In external validation, the performance of models 1 and 2 for predicting in-hospital and ICU mortality was not inferior to that of pre-existing scoring systems. Conclusions: The novel and simple models could predict in-hospital and ICU mortality and were not inferior compared to the pre-existing scoring systems.

Validation Comparison of Credit Rating Models for Categorized Financial Data (범주형 재무자료에 대한 신용평가모형 검증 비교)

  • Hong, Chong-Sun;Lee, Chang-Hyuk;Kim, Ji-Hun
    • Communications for Statistical Applications and Methods
    • /
    • v.15 no.4
    • /
    • pp.615-631
    • /
    • 2008
  • Current credit evaluation models based on only financial data except non-financial data are used continuous data and produce credit scores for the ranking. In this work, some problems of the credit evaluation models based on transformed continuous financial data are discussed and we propose improved credit evaluation models based on categorized financial data. After analyzing and comparing goodness-of-fit tests of two models, the availability of the credit evaluation models for categorized financial data is explained.

Chest Radiography of Tuberculosis: Determination of Activity Using Deep Learning Algorithm

  • Ye Ra Choi;Soon Ho Yoon;Jihang Kim;Jin Young Yoo;Hwiyoung Kim;Kwang Nam Jin
    • Tuberculosis and Respiratory Diseases
    • /
    • v.86 no.3
    • /
    • pp.226-233
    • /
    • 2023
  • Background: Inactive or old, healed tuberculosis (TB) on chest radiograph (CR) is often found in high TB incidence countries, and to avoid unnecessary evaluation and medication, differentiation from active TB is important. This study develops a deep learning (DL) model to estimate activity in a single chest radiographic analysis. Methods: A total of 3,824 active TB CRs from 511 individuals and 2,277 inactive TB CRs from 558 individuals were retrospectively collected. A pretrained convolutional neural network was fine-tuned to classify active and inactive TB. The model was pretrained with 8,964 pneumonia and 8,525 normal cases from the National Institute of Health (NIH) dataset. During the pretraining phase, the DL model learns the following tasks: pneumonia vs. normal, pneumonia vs. active TB, and active TB vs. normal. The performance of the DL model was validated using three external datasets. Receiver operating characteristic analyses were performed to evaluate the diagnostic performance to determine active TB by DL model and radiologists. Sensitivities and specificities for determining active TB were evaluated for both the DL model and radiologists. Results: The performance of the DL model showed area under the curve (AUC) values of 0.980 in internal validation, and 0.815 and 0.887 in external validation. The AUC values for the DL model, thoracic radiologist, and general radiologist, evaluated using one of the external validation datasets, were 0.815, 0.871, and 0.811, respectively. Conclusion: This DL-based algorithm showed potential as an effective diagnostic tool to identify TB activity, and could be useful for the follow-up of patients with inactive TB in high TB burden countries.

Development of a Postural Evaluation Function for Effective Use of an Ergonomic Human Model (인체모형의 효과적 활용을 위한 자세 함수의 개발)

  • Park, Sungjoon;Kim, Ho
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.28 no.2
    • /
    • pp.216-222
    • /
    • 2002
  • The ergonomic human model can be considered as a tool for the evaluation of ergonomic factors in vehicle design process. The proper anthropometric data on driver's postures are needed in order to apply a human model to vehicle design. Although studies on driver's posture have been carried out for the last few decades, there are still some problems for the posture data to be applied directly to the human model due to the lack of fitness because such studies were not carried out under the conditions for the human model application. In the traditional researches, the joint angles were evaluated by the categorized data, which are not appropriate for the human model application because it is so extensive that it can not explain the posture evaluation data in detail. And the human models require whole-body posture evaluation data rather than joint evaluation data. In this study a postural evaluation function was developed not by category data but by the concept of the loss function in quality engineering. The loss was defined as the discomfort in driver's posture and measured by the magnitude estimation technique in the experiment using a seating buck. Four loss functions for the each joint - knee, hip, shoulder, and elbow were developed and a whole-body postural evaluation function was constructed by the regression analysis using these loss functions as independent factors. The developed postural evaluation function shows a good prediction power for the driver's posture discomfort in validation test. It is expected that the driver's postural evaluation function based on the loss function can be used in the human model application to the vehicle design process.