• Proceedings of the KSME Conference
• /
• 2008.11a
• /
• pp.1169-1175
• /
• 2008

The validation technique is classified with two methods whether to demand of additional experimental points. The method which requires additional experimental points such as RSME is actually impossible in engineering field. Therefore, the method which only use experimented points such as the cross validation technique is only available. But the cross validation not only requires considerable computational costs for generating metamodel each iterations, but also cannot measure quantitatively the fidelity of metamodel. In this research we propose a new validation technique for representative metamodels using an variance of metamodel and confidence interval information. The proposed validation technique computes confidence intervals using a variance information from the metamodel. This technique will have influence on choosing the accurate metamodel, constructing ensemble of each metamodels and advancing effectively sequential sampling technique.

• Coupled systems mechanics
• /
• v.4 no.1
• /
• pp.37-65
• /
• 2015

Modeling and simulation of mechanical response of infrastructure object, solids and structures, relies on the use of computational models to foretell the state of a physical system under conditions for which such computational model has not been validated. Verification and Validation (V&V) procedures are the primary means of assessing accuracy, building confidence and credibility in modeling and computational simulations of behavior of those infrastructure objects. Validation is the process of determining a degree to which a model is an accurate representation of the real world from the perspective of the intended uses of the model. It is mainly a physics issue and provides evidence that the correct model is solved (Oberkampf et al. 2002). Our primary interest is in modeling and simulating behavior of porous particulate media that is fully saturated with pore fluid, including cyclic mobility and liquefaction. Fully saturated soils undergoing dynamic shaking fall in this category. Verification modeling and simulation of fully saturated porous soils is addressed in more detail by (Tasiopoulou et al. 2014), and in this paper we address validation. A set of centrifuge experiments is used for this purpose. Discussion is provided assessing the effects of scaling laws on centrifuge experiments and their influence on the validation. Available validation test are reviewed in view of first and second order phenomena and their importance to validation. For example, dynamics behavior of the system, following the dynamic time, and dissipation of the pore fluid pressures, following diffusion time, are not happening in the same time scale and those discrepancies are discussed. Laboratory tests, performed on soil that is used in centrifuge experiments, were used to calibrate material models that are then used in a validation process. Number of physical and numerical examples are used for validation and to illustrate presented discussion. In particular, it is shown that for the most part, numerical prediction of behavior, using laboratory test data to calibrate soil material model, prior to centrifuge experiments, can be validated using scaled tests. There are, of course, discrepancies, sources of which are analyzed and discussed.

• Journal of Nuclear Fuel Cycle and Waste Technology(JNFCWT)
• /
• v.17 no.4
• /
• pp.363-373
• /
• 2019

Waste characterisation associated with nuclear site decommissioning relies on radiochemical analysis of a diverse range of sample types, requiring extensive validation of analytical techniques using matrix-matched materials. The absence of relevant reference materials has hindered robust method development and validation. The paper discusses how method validation in support of nuclear waste characterisation can be achieved without using reference materials. The key stages in an analytical procedure are evaluated and a multi-stage approach is proposed with the ultimate aim of determining an operational envelope for an analytical procedure.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.34 no.5
• /
• pp.541-547
• /
• 2010

The rigorous validation of the accuracy of metamodels is an important topic in research on metamodel techniques. Although a leave-k-out cross-validation technique involves a considerably high computational cost, it cannot be used to measure the fidelity of metamodels. Recently, the mean$_0$ validation technique has been proposed to quantitatively determine the accuracy of metamodels. However, the use of mean$_0$ validation criterion may lead to premature termination of a sampling process even if the kriging model is inaccurate. In this study, we propose a new validation technique based on the mean and variance of the response evaluated when sequential sampling method, such as maximum entropy sampling, is used. The proposed validation technique is more efficient and accurate than the leave-k-out cross-validation technique, because instead of performing numerical integration, the kriging model is explicitly integrated to accurately evaluate the mean and variance of the response evaluated. The error in the proposed validation technique resembles a root mean squared error, thus it can be used to determine a stop criterion for sequential sampling of metamodels.

• Communications for Statistical Applications and Methods
• /
• v.5 no.2
• /
• pp.277-285
• /
• 1998

The smoothing parameter $\lambda$ in smoothing spline regression is usually selected by minimizing cross-validation (CV) or generalized cross-validation (GCV). But, simple CV or GCV is poor candidate for estimating prediction error. We defined MGCV (Multifold Generalized Cross-validation) as a criterion for selecting smoothing parameter in smoothing spline regression. This is a version of cross-validation using $leave-\kappa-out$ method. Some numerical results comparing MGCV and GCV are done.

• Journal of the Korea Society for Simulation
• /
• v.1 no.1
• /
• pp.77-86
• /
• 1992

In this paper, we study validation test methods of DEVSA(Descrete Event system Specification) models using SPN(Stochastic Petri Net) models. We discuss conventional validation test methods, by which DEVS models can be transformed to SPN models, by reviewing the features of DEVS model. Based on the model transformation method, we define a new homogeneous function for validation test and suggest a new validation test method of DEVS models using the property of SPN models and the new homogeneous function.

• Industrial Engineering and Management Systems
• /
• v.8 no.2
• /
• pp.101-108
• /
• 2009

Biclustering is a method to extract subsets of objects and features from a dataset which are characterized in some way. In contrast to traditional clustering algorithms which group objects similar in a whole feature set, biclustering methods find groups of objects which have similar values or patterns in some features. Both in clustering and biclustering, validating how much the result is informative or reliable is a very important task. Whereas validation methods of cluster solutions have been studied actively, there are only few measures to validate bicluster solutions. Furthermore, the existing validation methods of bicluster solutions have some critical problems to be used in general cases. In this paper, we review several well-known validation measures for cluster and bicluster solutions and discuss their limitations. Then, we propose several improved validation indices as modified versions of existing ones.

• Proceedings of the KSRS Conference
• /
• 2004.10a
• /
• pp.291-293
• /
• 2004

The aim of this study was to cross-validate a spatial probabilistic model of landslide likelihood ratios at Boun, Janghung and Yongin, in Korea, using a Geographic Information System (GIS). Landslide locations within the study areas were identified by interpreting aerial photographs, satellite images and field surveys. Maps of the topography, soil type, forest cover, lineaments and land cover were constructed from the spatial data sets. The 14 factors that influence landslide occurrence were extracted from the database and the likelihood ratio of each factor was computed. 'Landslide susceptibility maps were drawn for these three areas using likelihood ratios derived not only from the data for that area but also using the likelihood ratios calculated from each of the other two areas (nine maps in all) as a cross-check of the validity of the method For validation and cross-validation, the results of the analyses were compared, in each study area, with actual landslide locations. The validation and cross-validation of the results showed satisfactory agreement between the susceptibility map and the existing landslide locations.

• Journal of Aerospace System Engineering
• /
• v.12 no.4
• /
• pp.1-8
• /
• 2018

The state of registry issues a type certificate validation (TCV) based on the satisfactory evidence that the product (aircraft, engine, and propeller) is in compliance with the appropriate airworthiness requirements. The Korean government performs an evaluation to determine whether the product complies with Korean airworthiness standards for issuing TCV according to the Korean aviation safety law. Recently, the Validation Principles Working Group (VPWG) has developed a risk-based model for validation of civil aeronautical products. Also, VPWG proposed to incorporate this validation model into the corresponding ICAO Standards and Recommended Practices and guidance material. In this paper, we have reviewed the validation model and discussed improvements in the validation process.

• Proceedings of the KSRS Conference
• /
• 2007.10a
• /
• pp.146-148
• /
• 2007

CMDPS (COMS Meteorological Data Processing System) is the operational meteorological products extraction system for data observed from COMS (Communication, Ocean and Meteorological Satellite) meteorological imager. CMDPS baseline products consist of 16 parameters including cloud information, water vapor products, surface information, environmental products and atmospheric motion vector. Additionally, CMDPS includes the function of calibration monitoring, and validation mechanism of the baseline products. The main objective of CMDPS validation module development is near-real time monitoring for the accuracy and reliability of the whole CMDPS products. Also, its long time validation statistics are used for upgrade of CMDPS such as algorithm parameter tuning and retrieval algorithm modification. This paper introduces the preliminary design on CMDPS validation module.