• Title/Summary/Keyword: Model Validation & Evaluation

Search Result 374, Processing Time 0.024 seconds

Development on the model of outcome-based course evaluation design for Course-Embedded Assessment (교과기반평가를 위한 성과중심 교과목 평가설계모형 개발)

  • Kim, Hyekyung
    • Journal of Engineering Education Research
    • /
    • v.18 no.6
    • /
    • pp.24-31
    • /
    • 2015
  • The purpose of this study is to develop the model of course evaluation design for CEA(Course-Embedded Assessment), which is focused on course level for assessment reliability. This study was conducted by the process of model development and validation according to Richey & Klein(2007)'s model development methodology. The model of this study was comprised with the three steps of learning objectives based on course outcome, assessment design and goal achievement analysis of course, which were explained by specific design principles. Also, this model was validated by two steps, which one was on the inner validation and the other was the outer validation(Richey & Klein, 2007). Considerations for designing the model of course evaluation have been suggested and a few implications were discussed.

A Study on the Statistical Model Validation using Response-adaptive Experimental Design (반응적응 시험설계법을 이용하는 통계적 해석모델 검증 기법 연구)

  • Jung, Byung Chang;Huh, Young-Chul;Moon, Seok-Jun;Kim, Young Joong
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2014.10a
    • /
    • pp.347-349
    • /
    • 2014
  • Model verification and validation (V&V) is a current research topic to build computational models with high predictive capability by addressing the general concepts, processes and statistical techniques. The hypothesis test for validity check is one of the model validation techniques and gives a guideline to evaluate the validity of a computational model when limited experimental data only exist due to restricted test resources (e.g., time and budget). The hypothesis test for validity check mainly employ Type I error, the risk of rejecting the valid computational model, for the validity evaluation since quantification of Type II error is not feasible for model validation. However, Type II error, the risk of accepting invalid computational model, should be importantly considered for an engineered products having high risk on predicted results. This paper proposes a technique named as the response-adaptive experimental design to reduce Type II error by adaptively designing experimental conditions for the validation experiment. A tire tread block problem and a numerical example are employed to show the effectiveness of the response-adaptive experimental design for the validity evaluation.

  • PDF

Evaluation and validation of stem volume models for Quercus glauca in the subtropical forest of Jeju Island, Korea

  • Seo, Yeon Ok;Lumbres, Roscinto Ian C.;Won, Hyun Kyu;Jung, Sung Cheol;Lee, Young Jin
    • Journal of Ecology and Environment
    • /
    • v.38 no.4
    • /
    • pp.485-491
    • /
    • 2015
  • This study was conducted to develop stem volume models for the volume estimation of Quercus glauca Thunb. in Jeju Island, Republic of Korea. Furthermore, this study validated the developed stem volume models using an independent dataset. A total of 167 trees were measured for their diameter at breast height (DBH), total height and stem volume using non-destructive sampling methods. Eighty percent of the dataset was used for the initial model development while the remaining 20% was used for model validation. The performance of the different models was evaluated using the following fit statistics: standard error of estimate (SEE), mean bias absolute mean deviation (AMD), coefficient of determination (R2), and root mean square error (RMSE). The AMD of the five models from the different DBH classes were determined using the validation dataset. Model 5 (V = aDbHc), which estimates volume using DBH and total height as predicting variables, had the best SEE (0.02745), AMD (0.01538), R2 (0.97603) and RMSE (0.02746). Overall, volume models with two independent variables (DBH and total height) performed better than those with only one (DBH) based on the model evaluation and validation. The models developed in this study can provide forest managers with accurate estimations for the stem volumes of Quercus glauca in the subtropical forests of Jeju Island, Korea.

A study on the Preconditions of Space Program Validation of Healthcare Architecture for Application of BIM Technology (병원건축의 BIM적용을 위한 공간프로그램유효성평가의 전제조건에 관한 연구)

  • Seong, Joonho;Kim, Khilchae
    • Journal of The Korea Institute of Healthcare Architecture
    • /
    • v.19 no.2
    • /
    • pp.19-30
    • /
    • 2013
  • Purpose: The planning and design of hospital generally requires the participation and consultation of skilled experts since it has more complex space program than any other buildings. Therefore, the BIM systems for the planning of hospital have been tried continuously. The purpose of this study is to identify the precondition for space Program validation of healthcare architecture based on BIM, which is recently receiving wide attention. Method: For this study, United States, Australia and Finland's guidelines were analyzed among the description space program validation system in 14 overseas BIM Guidelines. And the propose precondition that can be applied to healthcare architecture from among these description of space program validation items, target, process etc for General building. Result: 1) spatial program validation is the following four evaluation phase. Step 1: Standard setting phase Step 2: BIM model accuracy assessment phase Step 3: space validation phase Step 4: Performance evaluation phase 2) The standards for the building elements at Standards Setting stage is considered to the standards for the architectural elements of General building. 3) Healthcare Architecture Area calculation method is considered to be reasonable that borrowing the area calculation standard of general architecture according to the UIA of international standards. However, Be proposed of measuring method that reflect the efficiency of the design process step-by-step area calculation method. The performance assessment indicators of reflect the Hospital uniqueness have to developed. And the research needs to be carried out continuously according to the purpose for healthcare architecture of feature-oriented. Implications: In this paper like to understanding that precondition of space program validation considering the BIM. As a result, understanding to condition about step of the evaluation, the evaluation standards. Is expected to keep the focus on the development of performance indicators that reflect the uniqueness of the hospital for the efficient evaluation of the Hospital building.

A Study on an Evaluation Method for Human/System Interface of Advanced Supervisory Control Systems in Nuclear Power Plant (신형 원자력발전소 감시제어체계의 인간/체계 인터페이스 평가 방법에 관한 연구)

  • Lee, Dong-Ha;Im, Hyeon-Gyo;Jeong, Byeong-Yong
    • Journal of the Ergonomics Society of Korea
    • /
    • v.18 no.3
    • /
    • pp.153-169
    • /
    • 1999
  • The design of nuclear control room is advancing toward totally computer based human system interfaces (HSI). Computer based interfaces offer the opportunity to provide improved support of operator performance, but if not properly deployed, can introduce new challenges. This paper reviews the Westinghouse AP-600 Human Factors Verification and Validation Plan selected for HSI evaluation model of Korea next generation nuclear control rooms. The AP-600 HSI evaluation model addressed 15 evaluation issues considering major activity class of operator and task complexity factors. This paper also describes the test procedures experimenters should follow to evaluate the addressed issues.

  • PDF

Validation Comparison of Credit Rating Models Using Box-Cox Transformation

  • Hong, Chong-Sun;Choi, Jeong-Min
    • Journal of the Korean Data and Information Science Society
    • /
    • v.19 no.3
    • /
    • pp.789-800
    • /
    • 2008
  • Current credit evaluation models based on financial data make use of smoothing estimated default ratios which are transformed from each financial variable. In this work, some problems of the credit evaluation models developed by financial experts are discussed and we propose improved credit evaluation models based on the stepwise variable selection method and Box-Cox transformed data whose distribution is much skewed to the right. After comparing goodness-of-fit tests of these models, the validation of the credit evaluation models using statistical methods such as the stepwise variable selection method and Box-Cox transformation function is explained.

  • PDF

A Study on the Risk-based Model for Validation of Civil Aircraft (민간항공기 형식증명승인을 위한 위험기반 모델 개발 동향)

  • Baek, Unryul;Lee, Eunhee;Kim, Jinhee;Lee, Kyungchul
    • Journal of Aerospace System Engineering
    • /
    • v.12 no.4
    • /
    • pp.1-8
    • /
    • 2018
  • The state of registry issues a type certificate validation (TCV) based on the satisfactory evidence that the product (aircraft, engine, and propeller) is in compliance with the appropriate airworthiness requirements. The Korean government performs an evaluation to determine whether the product complies with Korean airworthiness standards for issuing TCV according to the Korean aviation safety law. Recently, the Validation Principles Working Group (VPWG) has developed a risk-based model for validation of civil aeronautical products. Also, VPWG proposed to incorporate this validation model into the corresponding ICAO Standards and Recommended Practices and guidance material. In this paper, we have reviewed the validation model and discussed improvements in the validation process.

An Evaluation Study on Artificial Intelligence Data Validation Methods and Open-source Frameworks (인공지능 데이터 품질검증 기술 및 오픈소스 프레임워크 분석 연구)

  • Yun, Changhee;Shin, Hokyung;Choo, Seung-Yeon;Kim, Jaeil
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.10
    • /
    • pp.1403-1413
    • /
    • 2021
  • In this paper, we investigate automated data validation techniques for artificial intelligence training, and also disclose open-source frameworks, such as Google's TensorFlow Data Validation (TFDV), that support automated data validation in the AI model development process. We also introduce an experimental study using public data sets to demonstrate the effectiveness of the open-source data validation framework. In particular, we presents experimental results of the data validation functions for schema testing and discuss the limitations of the current open-source frameworks for semantic data. Last, we introduce the latest studies for the semantic data validation using machine learning techniques.

Development of Performance Analysis Methodology for Nuclear Power Plant Turbine Cycle Using Validation Model of Performance Measurements (원전 터빈사이클 성능 데이터의 검증 모델에 의한 성능분석 기법의 개발)

  • Kim, Seong-Geun;Choe, Gwang-Hui
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.24 no.12
    • /
    • pp.1625-1634
    • /
    • 2000
  • Verification of measurements is required for precise evaluation of turbine cycle performance in nuclear power plant. We assumed that initial acceptance data and design data of the plant could provide correlation information between performance data. The data can be used as sample sets for the correct estimation model of measurement value. The modeling was done practically by using regression model based on plant design data, plant acceptance data and verified plant performance data of domestic nuclear power plant. We can construct more robust performance analysis system for an operation nuclear power plant with this validation scheme.

Behavior-Structure-Evolution Evaluation Model(BSEM) for Open Source Software Service (공개소프트웨어 서비스 평가모델(BSEM)에 관한 개념적 연구)

  • Lee, Seung-Chang;Park, Hoon-Sung;Suh, Eung-Kyo
    • Journal of Distribution Science
    • /
    • v.13 no.1
    • /
    • pp.57-70
    • /
    • 2015
  • Purpose - Open source software has high utilization in most of the server market. The utilization of open source software is a global trend. Particularly, Internet infrastructure and platform software open source software development has increased rapidly. Since 2003, the Korean government has published open source software promotion policies and a supply promotion policy. The dynamism of the open source software market, the lack of relevant expertise, and the market transformation due to reasons such as changes in the relevant technology occur slowly in relation to adoption. Therefore, this study proposes an assessment model of services provided in an open source software service company. In this study, the service level of open source software companies is classified into an enterprise-level assessment area, the service level assessment area, and service area. The assessment model is developed from an on-site driven evaluation index and proposed evaluation framework; the evaluation procedures and evaluation methods are used to achieve the research objective, involving an impartial evaluation model implemented after pilot testing and validation. Research Design, data, and methodology - This study adopted an iteration development model to accommodate various requirements, and presented and validated the assessment model to address the situation of the open source software service company. Phase 1 - Theoretical background and literature review Phase 2 - Research on an evaluation index based on the open source software service company Phase 3 - Index improvement through expert validation Phase 4 - Finalizing an evaluation model reflecting additional requirements Based on the open source software adoption case study and latest technology trends, we developed an open source software service concept definition and classification of public service activities for open source software service companies. We also presented open source software service company service level measures by developing a service level factor analysis assessment. The Behavior-Structure-Evolution Evaluation Model (BSEM) proposed in this study consisted of a rating methodology for calculating the level that can be granted through the assessment and evaluation of an enterprise-level data model. An open source software service company's service comprises the service area and service domain, while the technology acceptance model comprises the service area, technical domain, technical sub-domain, and open source software name. Finally, the evaluation index comprises the evaluation group, category, and items. Results - Utilization of an open source software service level evaluation model For the development of an open source software service level evaluation model, common service providers need to standardize the quality of the service, so that surveys and expert workshops performed in open source software service companies can establish the evaluation criteria according to their qualitative differences. Conclusion - Based on this evaluation model's systematic evaluation process and monitoring, an open source software service adoption company can acquire reliable information for open source software adoption. Inducing the growth of open source software service companies will facilitate the development of the open source software industry.