• Title/Summary/Keyword: Model Validation & Evaluation

Search Result 392, Processing Time 0.027 seconds

Development on the model of outcome-based course evaluation design for Course-Embedded Assessment (교과기반평가를 위한 성과중심 교과목 평가설계모형 개발)

  • Kim, Hyekyung
    • Journal of Engineering Education Research
    • /
    • v.18 no.6
    • /
    • pp.24-31
    • /
    • 2015
  • The purpose of this study is to develop the model of course evaluation design for CEA(Course-Embedded Assessment), which is focused on course level for assessment reliability. This study was conducted by the process of model development and validation according to Richey & Klein(2007)'s model development methodology. The model of this study was comprised with the three steps of learning objectives based on course outcome, assessment design and goal achievement analysis of course, which were explained by specific design principles. Also, this model was validated by two steps, which one was on the inner validation and the other was the outer validation(Richey & Klein, 2007). Considerations for designing the model of course evaluation have been suggested and a few implications were discussed.

A Study on the Statistical Model Validation using Response-adaptive Experimental Design (반응적응 시험설계법을 이용하는 통계적 해석모델 검증 기법 연구)

  • Jung, Byung Chang;Huh, Young-Chul;Moon, Seok-Jun;Kim, Young Joong
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2014.10a
    • /
    • pp.347-349
    • /
    • 2014
  • Model verification and validation (V&V) is a current research topic to build computational models with high predictive capability by addressing the general concepts, processes and statistical techniques. The hypothesis test for validity check is one of the model validation techniques and gives a guideline to evaluate the validity of a computational model when limited experimental data only exist due to restricted test resources (e.g., time and budget). The hypothesis test for validity check mainly employ Type I error, the risk of rejecting the valid computational model, for the validity evaluation since quantification of Type II error is not feasible for model validation. However, Type II error, the risk of accepting invalid computational model, should be importantly considered for an engineered products having high risk on predicted results. This paper proposes a technique named as the response-adaptive experimental design to reduce Type II error by adaptively designing experimental conditions for the validation experiment. A tire tread block problem and a numerical example are employed to show the effectiveness of the response-adaptive experimental design for the validity evaluation.

  • PDF

Evaluation and validation of stem volume models for Quercus glauca in the subtropical forest of Jeju Island, Korea

  • Seo, Yeon Ok;Lumbres, Roscinto Ian C.;Won, Hyun Kyu;Jung, Sung Cheol;Lee, Young Jin
    • Journal of Ecology and Environment
    • /
    • v.38 no.4
    • /
    • pp.485-491
    • /
    • 2015
  • This study was conducted to develop stem volume models for the volume estimation of Quercus glauca Thunb. in Jeju Island, Republic of Korea. Furthermore, this study validated the developed stem volume models using an independent dataset. A total of 167 trees were measured for their diameter at breast height (DBH), total height and stem volume using non-destructive sampling methods. Eighty percent of the dataset was used for the initial model development while the remaining 20% was used for model validation. The performance of the different models was evaluated using the following fit statistics: standard error of estimate (SEE), mean bias absolute mean deviation (AMD), coefficient of determination (R2), and root mean square error (RMSE). The AMD of the five models from the different DBH classes were determined using the validation dataset. Model 5 (V = aDbHc), which estimates volume using DBH and total height as predicting variables, had the best SEE (0.02745), AMD (0.01538), R2 (0.97603) and RMSE (0.02746). Overall, volume models with two independent variables (DBH and total height) performed better than those with only one (DBH) based on the model evaluation and validation. The models developed in this study can provide forest managers with accurate estimations for the stem volumes of Quercus glauca in the subtropical forests of Jeju Island, Korea.

Implementation of dynamic start-up test experimental data as a main part of the nuclear code validation procedure: Developed RELAP5 model for VVER-1000

  • Navid Vahman;Reza Akbari
    • Nuclear Engineering and Technology
    • /
    • v.56 no.9
    • /
    • pp.3826-3834
    • /
    • 2024
  • The main purposes of start-up tests in nuclear power plants (NPPs) are to ensure safe and reliable operation, verify system functionality, comply with regulatory requirements, optimize performance, and establish a foundation for ongoing plant operation and maintenance. However, the start-up tests of NPPs also could be used as a main part of the nuclear code validation procedure for several reasons including: realistic simulation, comprehensive evaluation, detection of code limitations, validation of safety margins and confidence in code predictions. The main purpose of the current study is to define and assess the validation procedure based on actual start-up test data. In this regard, the developed RELAP5 model has been validated against the actual data of VVER-1000 plant during a dynamic start-up test. The results of this full-scale validation show a good agreement between the developed RELAP5 model results and actual plant data. Finally, by defining a step by step validation procedure, it has been recommended to use the start-up phase test data as a more robust validation process which allow for full-scale validation of the nuclear code by comparing its predictions with actual plant measurements and also other advantages which have been demonstrated in the current study.

A study on the Preconditions of Space Program Validation of Healthcare Architecture for Application of BIM Technology (병원건축의 BIM적용을 위한 공간프로그램유효성평가의 전제조건에 관한 연구)

  • Seong, Joonho;Kim, Khilchae
    • Journal of The Korea Institute of Healthcare Architecture
    • /
    • v.19 no.2
    • /
    • pp.19-30
    • /
    • 2013
  • Purpose: The planning and design of hospital generally requires the participation and consultation of skilled experts since it has more complex space program than any other buildings. Therefore, the BIM systems for the planning of hospital have been tried continuously. The purpose of this study is to identify the precondition for space Program validation of healthcare architecture based on BIM, which is recently receiving wide attention. Method: For this study, United States, Australia and Finland's guidelines were analyzed among the description space program validation system in 14 overseas BIM Guidelines. And the propose precondition that can be applied to healthcare architecture from among these description of space program validation items, target, process etc for General building. Result: 1) spatial program validation is the following four evaluation phase. Step 1: Standard setting phase Step 2: BIM model accuracy assessment phase Step 3: space validation phase Step 4: Performance evaluation phase 2) The standards for the building elements at Standards Setting stage is considered to the standards for the architectural elements of General building. 3) Healthcare Architecture Area calculation method is considered to be reasonable that borrowing the area calculation standard of general architecture according to the UIA of international standards. However, Be proposed of measuring method that reflect the efficiency of the design process step-by-step area calculation method. The performance assessment indicators of reflect the Hospital uniqueness have to developed. And the research needs to be carried out continuously according to the purpose for healthcare architecture of feature-oriented. Implications: In this paper like to understanding that precondition of space program validation considering the BIM. As a result, understanding to condition about step of the evaluation, the evaluation standards. Is expected to keep the focus on the development of performance indicators that reflect the uniqueness of the hospital for the efficient evaluation of the Hospital building.

A Study on an Evaluation Method for Human/System Interface of Advanced Supervisory Control Systems in Nuclear Power Plant (신형 원자력발전소 감시제어체계의 인간/체계 인터페이스 평가 방법에 관한 연구)

  • Lee, Dong-Ha;Im, Hyeon-Gyo;Jeong, Byeong-Yong
    • Journal of the Ergonomics Society of Korea
    • /
    • v.18 no.3
    • /
    • pp.153-169
    • /
    • 1999
  • The design of nuclear control room is advancing toward totally computer based human system interfaces (HSI). Computer based interfaces offer the opportunity to provide improved support of operator performance, but if not properly deployed, can introduce new challenges. This paper reviews the Westinghouse AP-600 Human Factors Verification and Validation Plan selected for HSI evaluation model of Korea next generation nuclear control rooms. The AP-600 HSI evaluation model addressed 15 evaluation issues considering major activity class of operator and task complexity factors. This paper also describes the test procedures experimenters should follow to evaluate the addressed issues.

  • PDF

Validation Comparison of Credit Rating Models Using Box-Cox Transformation

  • Hong, Chong-Sun;Choi, Jeong-Min
    • Journal of the Korean Data and Information Science Society
    • /
    • v.19 no.3
    • /
    • pp.789-800
    • /
    • 2008
  • Current credit evaluation models based on financial data make use of smoothing estimated default ratios which are transformed from each financial variable. In this work, some problems of the credit evaluation models developed by financial experts are discussed and we propose improved credit evaluation models based on the stepwise variable selection method and Box-Cox transformed data whose distribution is much skewed to the right. After comparing goodness-of-fit tests of these models, the validation of the credit evaluation models using statistical methods such as the stepwise variable selection method and Box-Cox transformation function is explained.

  • PDF

A Study on the Risk-based Model for Validation of Civil Aircraft (민간항공기 형식증명승인을 위한 위험기반 모델 개발 동향)

  • Baek, Unryul;Lee, Eunhee;Kim, Jinhee;Lee, Kyungchul
    • Journal of Aerospace System Engineering
    • /
    • v.12 no.4
    • /
    • pp.1-8
    • /
    • 2018
  • The state of registry issues a type certificate validation (TCV) based on the satisfactory evidence that the product (aircraft, engine, and propeller) is in compliance with the appropriate airworthiness requirements. The Korean government performs an evaluation to determine whether the product complies with Korean airworthiness standards for issuing TCV according to the Korean aviation safety law. Recently, the Validation Principles Working Group (VPWG) has developed a risk-based model for validation of civil aeronautical products. Also, VPWG proposed to incorporate this validation model into the corresponding ICAO Standards and Recommended Practices and guidance material. In this paper, we have reviewed the validation model and discussed improvements in the validation process.

An Evaluation Study on Artificial Intelligence Data Validation Methods and Open-source Frameworks (인공지능 데이터 품질검증 기술 및 오픈소스 프레임워크 분석 연구)

  • Yun, Changhee;Shin, Hokyung;Choo, Seung-Yeon;Kim, Jaeil
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.10
    • /
    • pp.1403-1413
    • /
    • 2021
  • In this paper, we investigate automated data validation techniques for artificial intelligence training, and also disclose open-source frameworks, such as Google's TensorFlow Data Validation (TFDV), that support automated data validation in the AI model development process. We also introduce an experimental study using public data sets to demonstrate the effectiveness of the open-source data validation framework. In particular, we presents experimental results of the data validation functions for schema testing and discuss the limitations of the current open-source frameworks for semantic data. Last, we introduce the latest studies for the semantic data validation using machine learning techniques.

Development of Performance Analysis Methodology for Nuclear Power Plant Turbine Cycle Using Validation Model of Performance Measurements (원전 터빈사이클 성능 데이터의 검증 모델에 의한 성능분석 기법의 개발)

  • Kim, Seong-Geun;Choe, Gwang-Hui
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.24 no.12
    • /
    • pp.1625-1634
    • /
    • 2000
  • Verification of measurements is required for precise evaluation of turbine cycle performance in nuclear power plant. We assumed that initial acceptance data and design data of the plant could provide correlation information between performance data. The data can be used as sample sets for the correct estimation model of measurement value. The modeling was done practically by using regression model based on plant design data, plant acceptance data and verified plant performance data of domestic nuclear power plant. We can construct more robust performance analysis system for an operation nuclear power plant with this validation scheme.