• 제목/요약/키워드: calibration and validation

검색결과 658건 처리시간 0.033초

Development of the Algorithm for Optimizing Wavelength Selection in Multiple Linear Regression

  • Hoeil Chung
    • Near Infrared Analysis
    • /
    • 제1권1호
    • /
    • pp.1-7
    • /
    • 2000
  • A convenient algorithm for optimizing wavelength selection in multiple linear regression (MLR) has been developed. MOP (MLP Optimization Program) has been developed to test all possible MLR calibration models in a given spectral range and finally find an optimal MLR model with external validation capability. MOP generates all calibration models from all possible combinations of wavelength, and simultaneously calculates SEC (Standard Error of Calibration) and SEV (Standard Error of Validation) by predicting samples in a validation data set. Finally, with determined SEC and SEV, it calculates another parameter called SAD (Sum of SEC, SEV, and Absolute Difference between SEC and SEV: sum(SEC+SEV+Abs(SEC-SEV)). SAD is an useful parameter to find an optimal calibration model without over-fitting by simultaneously evaluating SEC, SEV, and difference of error between calibration and validation. The calibration model corresponding to the smallest SAD value is chosen as an optimum because the errors in both calibration and validation are minimal as well as similar in scale. To evaluate the capability of MOP, the determination of benzene content in unleaded gasoline has been examined. MOP successfully found the optimal calibration model and showed the better calibration and independent prediction performance compared to conventional MLR calibration.

HSPF를 이용한 임하호 유역 유사량 모의 (Simulation of Sediment Yield from Imha Watershed Using HSPF)

  • 전지홍
    • 한국농공학회논문집
    • /
    • 제52권6호
    • /
    • pp.39-48
    • /
    • 2010
  • Sediment yields from Imha watershed were simulated during 1993-2008 using Hydrologic Simulation Program-Fortran (HSPF). Using observed daily stream flow for 2004-2008 and hourly suspended solid concentration for three events during 2006, HSPF was calibrated and validated at the sites of Imha and Youngyang for stream flow and Dongchun and Jangpachun for sediment yield. The calibration and validation results represented high model efficiency for simulating daily stream flow and hourly suspended solid. The determination coefficients of calibration and validation were 0.90 and 0.81 for daily stream flow, and 0.91 and 0.86 for monthly stream flow, respectively. Based on model tolerances for calibration and validation of stream flow, HSPF performance for simulating stream flow represented 'very good'. The determination coefficients of calibration and validation were 0.94-0.96 and 0.95 for hourly sediment yields, respectively. The average yearly sediment yield during 1993-2008 was 122,290 ton/year and most of sediment yield (77 % of total yield) were generated from June to August. The calibrated HSPF simulated well the movement of water and eroded soil within Imha watershed.

Calibration of APEX-Paddy Model using Experimental Field Data

  • Mohammad, Kamruzzaman;Hwang, Syewoon;Cho, Jaepil;Choi, Soon-Kun;Park, Chanwoo
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2019년도 학술발표회
    • /
    • pp.155-155
    • /
    • 2019
  • The Agricultural Policy/Environmental eXtender (APEX) models have been developed for assessing agricultural management efforts and their effects on soil and water at the field scale as well as more complex multi-subarea landscapes, whole farms, and watersheds. National Academy of Agricultural Sciences, Wanju, Korea, has modified a key component of APEX application, named APEX-Paddy for simulating water quality with considering appropriate paddy management practices, such as puddling and flood irrigation management. Calibration and validation are an anticipated step before any model application. Simple techniques are essential to assess whether or not a parameter should be adjusted for calibration. However, very few study has been done to evaluate the ability of APEX-Paddy to simulate the impact of multiple management scenarios on nutrients loss. In this study, the observation data from experimental fields at Iksan in South Kora was used in calibration and evaluation process during 2013-2015. The APEX auto- calibration tool (APEX-CUTE) was used for model calibration and sensitivity analysis. Four quantitative statistics, the coefficient of determination ($R^2$),Nash-Sutcliffe(NSE),percentbias(PBIAS)androotmeansquareerror(RMSE)were used in model evaluation. In this study, the hydrological process of the modified model, APEX-Paddy, is being calibrated and tested in predicting runoff discharge rate and nutrient yield. Field-scale calibration and validation processes are described with an emphasis on essential calibration parameters and direction regarding logical sequences of calibration steps. This study helps to understand the calibration and validation way is further provided for applications of APEX-Paddy at the field scales.

  • PDF

Calibration and Validation Activities for Earth Observation Mission Future Evolution for GMES

  • LECOMTE Pascal
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2005년도 Proceedings of ISRS 2005
    • /
    • pp.237-240
    • /
    • 2005
  • Calibration and Validation are major element of any space borne Earth Observation Mission. These activities are the major objective of the commissioning phases but routine activities shall be maintained during the whole mission in order to maintain the quality of the product delivered to the users or at least to fully characterise the evolution with time of the product quality. With the launch of ERS-l in 1991, the European Space Agency decided to put in place a group dedicated to these activities, along with the daily monitoring of the product quality for anomaly detection and algorithm evolution. These four elements are all strongly linked together. Today this group is fully responsible for the monitoring of two ESA missions, ERS-2 and Envisat, for a total of 12 instruments of various types, preparing itself for the Earth Explorer series of five. other satellites (Cryosat, Goce, SMOS, ADM-Aeolus, Swarm) and at various levels in past and future Third Party Missions such as Landsat, J-ERS, ALOS and KOMPSAT. The Joint proposal by the European Union and the European Space Agency for a 'Global Monitoring for Environment and Security' project (GMES), triggers a review of the scope of these activities in a much wider framework than the handling of single missions with specific tools, methods and activities. Because of the global objective of this proposal, it is necessary to put in place Multi-Mission Calibration and Validation systems and procedures. GMES Calibration and Validation activities will rely on multi source data access, interoperability, long-term data preservation, and definition standards to facilitate the above objectives. The scope of this presentation is to give an overview of the current Calibration and Validation activities at ESA, and the planned evolution in the context of GMES.

  • PDF

Automatic RF Input Power Level Control Methodology for SAR Measurement Validation

  • Kim, Ki-Hwea;Choi, Dong-Geun;Gimm, Yoon-Myoung
    • Journal of electromagnetic engineering and science
    • /
    • 제15권3호
    • /
    • pp.181-184
    • /
    • 2015
  • Evaluation of radiating radiofrequency fields from hand-held and body-mounted wireless communication devices to human bodies are conducted by measuring the specific absorption rate (SAR). The uncertainty of system validation and probe calibration in SAR measurement depend on the variation of RF power used for the validation and calibration. RF input power for system validation or probe calibration is controlled manually during the test process of the existing systems in the laboratories. Consequently, a long time is required to reach the stable power needed for testing that will cause less uncertainty. The standard uncertainty due to this power drift is typically 2.89%, which can be obtained by applying IEC 62209 in a normal operating condition. The principle of the Automatic Input Power Level Control System (AIPLC), which controls the equipment by a program that maintains a stable input power level, is suggested in this paper. The power drift is reduced to less than ${\pm}1.16dB$ by AIPLC, which reduces the standard uncertainty of power drift to 0.67%.

강수패턴과 토지이용의 시공간적 분석을 위한 SWAT모형의 검보정 개선방안 연구 (Study on Improvement of Calibration/Validation of SWAT for Spatio-Temporal Analysis of Land Uses and Rainfall Patterns)

  • 이지원;금동혁;김범철;김영석;정교철;김기성;최중대;임경재
    • 한국물환경학회지
    • /
    • 제29권3호
    • /
    • pp.365-376
    • /
    • 2013
  • The purpose of this study was to evaluate effects of spatio-temporal changes in land uses and rainfall magnitude using the Soil and Water Assessment Tool (SWAT). Prior of application of the model to real-world problem, the model should be calibrated and validated properly. In most modeling approaches, the validation process is done assuming no significant changes occurring at the study watershed between calibration and validation periods, which is not proper assumption for agricultural watersheds. If simulated results obtained with calibrated parameters match observed data with higher accuracy for validation period, this does not always mean the simulated result represents rainfall-runoff, pollutant generation and transport mechanism for validation period because temporal and spatial variables and rainfall magnitude are often not the same. In this study SWAT was applied to Mandae study watershed in Korea to evaluate effects of spatio-temporal changes in landuses using 2009 and 2010 crop data for each field at the watershed. The Nash-Sutcliffe model efficiency (NSE) values for calibration and validation with either 2009 or 2010 was evaluated and the NSE value for calibration with 2009 and calibration with 2010 were compared. It was found that if there is substantial change in land use and rainfall, model calibration period should be determined to reflect those changes. Through these approaches, inherent limitation of the SWAT, which does not consider changes in land uses over the simulation period, was investigated. Also, Effects of changes in rainfall magnitude during calibration process were analyzed.

근적외분광분석법을 사용한 암브록솔 정제의 비파괴적 정량분석 (Nondestructive Quantification of Intact Ambroxol Tablet using Near-infrared Spectroscopy)

  • 임현량;우영아;김도형;김효진;강신정;최현철;최한곤
    • 약학회지
    • /
    • 제48권1호
    • /
    • pp.60-64
    • /
    • 2004
  • Near-infrared (NIR) spectroscopy was used to determine rapidly and nondestructively the content of ambroxol in intact ambroxol tablets containing 30 mg (12.5% m/m nominal concentration) by collecting NIR spectra in range 1100-1750 nm. The laboratory-made samples had 10.3∼15.9% m/m nominal ambroxol concentration. The measurements were made by reflection using a fiber-optic probe and calibration was carried out by partial least square regression (PLSR) with autoscaling. Model validation was performed by randomly splitting the data set into calibration and validation data set (7 samples as a calibration data set and 5 samples as a validation data set). The developed NIR method gave results comparable to the known values of tablets in a laboratorial manufacturing Process, standard error of calibration (SEC) and standard error of prediction (SEP) being 0.49% and 0.49% m/m respectively. The method showed good accuracy and repeatability NIR spectroscopic determination in intact tablets allowed the potential use of real time monitoring for a running production process.

COMPARISON OF LINEAR AND NON-LINEAR NIR CALIBRATION METHODS USING LARGE FORAGE DATABASES

  • Berzaghi, Paolo;Flinn, Peter C.;Dardenne, Pierre;Lagerholm, Martin;Shenk, John S.;Westerhaus, Mark O.;Cowe, Ian A.
    • 한국근적외분광분석학회:학술대회논문집
    • /
    • 한국근적외분광분석학회 2001년도 NIR-2001
    • /
    • pp.1141-1141
    • /
    • 2001
  • The aim of the study was to evaluate the performance of 3 calibration methods, modified partial least squares (MPLS), local PLS (LOCAL) and artificial neural network (ANN) on the prediction of chemical composition of forages, using a large NIR database. The study used forage samples (n=25,977) from Australia, Europe (Belgium, Germany, Italy and Sweden) and North America (Canada and U.S.A) with information relative to moisture, crude protein and neutral detergent fibre content. The spectra of the samples were collected with 10 different Foss NIR Systems instruments, which were either standardized or not standardized to one master instrument. The spectra were trimmed to a wavelength range between 1100 and 2498 nm. Two data sets, one standardized (IVAL) and the other not standardized (SVAL) were used as independent validation sets, but 10% of both sets were omitted and kept for later expansion of the calibration database. The remaining samples were combined into one database (n=21,696), which was split into 75% calibration (CALBASE) and 25% validation (VALBASE). The chemical components in the 3 validation data sets were predicted with each model derived from CALBASE using the calibration database before and after it was expanded with 10% of the samples from IVAL and SVAL data sets. Calibration performance was evaluated using standard error of prediction corrected for bias (SEP(C)), bias, slope and R2. None of the models appeared to be consistently better across all validation sets. VALBASE was predicted well by all models, with smaller SEP(C) and bias values than for IVAL and SVAL. This was not surprising as VALBASE was selected from the calibration database and it had a sample population similar to CALBASE, whereas IVAL and SVAL were completely independent validation sets. In most cases, Local and ANN models, but not modified PLS, showed considerable improvement in the prediction of IVAL and SVAL after the calibration database had been expanded with the 10% samples of IVAL and SVAL reserved for calibration expansion. The effects of sample processing, instrument standardization and differences in reference procedure were partially confounded in the validation sets, so it was not possible to determine which factors were most important. Further work on the development of large databases must address the problems of standardization of instruments, harmonization and standardization of laboratory procedures and even more importantly, the definition of the database population.

  • PDF

SAR 위성 검보정 사이트 선택을 위한 분석 (A Analysis for Calibration Site Selection of SAR Satellite)

  • 금정훈;나성웅
    • Journal of Astronomy and Space Sciences
    • /
    • 제26권4호
    • /
    • pp.659-666
    • /
    • 2009
  • 탑재체에 따른 위성의 임무가 다양하듯이, 적합한 검보정(Calibration & Validation)을 위한 작업은 탑재체에 따라 특정적인 요소를 가진다. SAR(Synthetic Aperture Radar) 위성의 경우에는 전파를 사용하여 물체를 인식하므로, 검보정을 위해서 특정한 형태로 전파를 반사하는 목표물을 지상에 설치하여야 한다. 또한 이 목표물은 설계된 위성궤도에서 지상목표물을 획득할 수 있도록 하여야한다. 상기의 목적을 달성하기 위해서는 우선적으로 검보정을 위한 사이트를 면밀히 분석하여야 한다. 여기에서는 상대방사보정(Relative Radiometric Calibration)과 절대방사 보정(Absolute Radiometric Calibration) 중에서 후자를 위한 반사기의 점표적 설치를 위해 적합한 검보정 사이트에 대한 고찰을 하였다.

HSPF 모형을 이용한 합천댐 유입량 추정 (Estimation of the Hapcheon Dam Inflow Using HSPF Model)

  • 조현경;김상민
    • 한국농공학회논문집
    • /
    • 제61권5호
    • /
    • pp.69-77
    • /
    • 2019
  • The objective of this study was to calibrate and validate the HSPF (Hydrological Simulation Program-Fortran) model for estimating the runoff of the Hapcheon dam watershed. Spatial data, such as watershed, stream, land use, and a digital elevation map, were used as input data for the HSPF model. Observed runoff data from 2000 to 2016 in study watershed were used for calibration and validation. Hydrologic parameters for runoff calibration were selected based on the user's manual and references, and trial and error method was used for parameter calibration. The $R^2$, RMSE (root-mean-square error), RMAE (relative mean absolute error), and NSE (Nash-Sutcliffe efficiency coefficient) were used to evaluate the model's performance. Calibration and validation results showed that annual mean runoff was within ${\pm}4%$ error. The model performance criteria for calibration and validation showed that $R^2$ was in the rang of 0.78 to 0.83, RMSE was 2.55 to 2.76 mm/day, RMAE was 0.46 to 0.48 mm/day, and NSE was 0.81 to 0.82 for daily runoff. The amount of inflow to Hapcheon Dam was calculated from the calibrated HSPF model and the result was compared with observed inflow, which was -0.9% error. As a result of analyzing the relation between inflow and storage capacity, it was found that as the inflow increases, the storage increases, and when the inflow decreases, the storage also decreases. As a result of correlation between inflow and storage, $R^2$ of the measured inflow and storage was 0.67, and the simulated inflow and storage was 0.61.