• 제목/요약/키워드: Parameter calibration/validation

검색결과 57건 처리시간 0.028초

Development of the Algorithm for Optimizing Wavelength Selection in Multiple Linear Regression

  • Hoeil Chung
    • Near Infrared Analysis
    • /
    • 제1권1호
    • /
    • pp.1-7
    • /
    • 2000
  • A convenient algorithm for optimizing wavelength selection in multiple linear regression (MLR) has been developed. MOP (MLP Optimization Program) has been developed to test all possible MLR calibration models in a given spectral range and finally find an optimal MLR model with external validation capability. MOP generates all calibration models from all possible combinations of wavelength, and simultaneously calculates SEC (Standard Error of Calibration) and SEV (Standard Error of Validation) by predicting samples in a validation data set. Finally, with determined SEC and SEV, it calculates another parameter called SAD (Sum of SEC, SEV, and Absolute Difference between SEC and SEV: sum(SEC+SEV+Abs(SEC-SEV)). SAD is an useful parameter to find an optimal calibration model without over-fitting by simultaneously evaluating SEC, SEV, and difference of error between calibration and validation. The calibration model corresponding to the smallest SAD value is chosen as an optimum because the errors in both calibration and validation are minimal as well as similar in scale. To evaluate the capability of MOP, the determination of benzene content in unleaded gasoline has been examined. MOP successfully found the optimal calibration model and showed the better calibration and independent prediction performance compared to conventional MLR calibration.

매개변수 보정 전문가시스템을 이용한 HSPF 모형의 수문 매개변수 보정 및 적용성 평가 (Evaluation of Applicability and Hydrologic Parameter Calibration for HSPF Model using Expert System for HSPF)

  • 김성민;김상민
    • 한국농공학회논문집
    • /
    • 제55권4호
    • /
    • pp.13-20
    • /
    • 2013
  • The purpose of this study was to evaluate the applicability of the HSPEXP expert system for the calibration of the Hydrological Simulation Program - Fortran (HSPF) for the study watershed. HSPEXP offers advice to the modeler, suggesting parameter changes that might result in better representation of a river basin and provides explanations supporting the recommended parameter changes. The study watershed, Sancheong, is located within the Nakdong River Basin and having the size of $1,072.4km^2$. Input data for the HSPF model were obtained from the landuse map, digital elevation map, meteorological data and others. Water flow data from 2006 to 2008 were used for calibration and from 2009 to 2010 were for validation. Using the HSPEXP expert system, hydrological parameters were adjusted based on total volume, then low flows, storm flows, and finally seasonal flows. For the calibration and validation period, all the HSPEXP model performance criteria were satisfied.

PEST를 이용한 임하호유역 HSPF 수문 보정 (Hydrologic Calibration of HSPF Model using Parameter Estimation (PEST) Program at Imha Watershed)

  • 전지홍;김태일;최동혁;임경재;김태동
    • 한국물환경학회지
    • /
    • 제26권5호
    • /
    • pp.802-809
    • /
    • 2010
  • An automatic calibration tool of Hydrological Simulation Program-Fortran (HSPF), Parameter Estimation (PEST) program, was applied at the Imha lake watershed to get optimal hydrological parameters of HSPF. Calibration of HSPF parameters was performed during 2004 ~ 2008 by PEST and validation was carried out to examine the model's ability by using another data set of 1999 ~ 2003. The calibrated HSPF parameters had tendencies to minimize water loss to soil layer by infiltration and deep percolation and to atmosphere by evapotranspiration and maximize runoff rate. The results of calibration indicated that the PEST program could calibrate the hydrological parameters of HSPF with showing 0.83 and 0.97 Nash-Sutcliffe coefficient (NS) for daily and monthly stream flow and -3% of relative error for yearly stream flow. The validation results also represented high model efficiency with showing 0.88 and 0.95, -10% relative error for daily, monthly, and yearly stream flow. These statistical values of daily, monthly, and yearly stream flow for calibration and validation show a 'very good' agreement between observed and simulated values. Overall, the PEST program was useful for automatic calibration of HSPF, and reduced numerous time and effort for model calibration, and improved model setup.

다양한 평가 지표와 최적화 기법을 통한 오염부하 산정 회귀 모형 평가 (Evaluation of Regression Models with various Criteria and Optimization Methods for Pollutant Load Estimations)

  • 김종건;임경재;박윤식
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2018년도 학술발표회
    • /
    • pp.448-448
    • /
    • 2018
  • In this study, the regression models (Load ESTimator and eight-parameter model) were evaluated to estimate instantaneous pollutant loads under various criteria and optimization methods. As shown in the results, LOADEST commonly used in interpolating pollutant loads could not necessarily provide the best results with the automatic selected regression model. It is inferred that the various regression models in LOADEST need to be considered to find the best solution based on the characteristics of watersheds applied. The recently developed eight-parameter model integrated with Genetic Algorithm (GA) and Gradient Descent Method (GDM) were also compared with LOADEST indicating that the eight-parameter model performed better than LOADEST, but it showed different behaviors in calibration and validation. The eight-parameter model with GDM could reproduce the nitrogen loads properly outside of calibration period (validation). Furthermore, the accuracy and precision of model estimations were evaluated using various criteria (e.g., $R^2$ and gradient and constant of linear regression line). The results showed higher precisions with the $R^2$ values closed to 1.0 in LOADEST and better accuracy with the constants (in linear regression line) closed to 0.0 in the eight-parameter model with GDM. In hence, based on these finding we recommend that users need to evaluate the regression models under various criteria and calibration methods to provide the more accurate and precise results for pollutant load estimations.

  • PDF

기록치 오차와 유역모형의 검정(II) - 모니터링 검정방법 - (Errors in Recorded Information and Calibration of a Catchment Modelling System(II) - Monitoring Calibration Approach -)

  • Choi, Kyung Sook
    • 한국농공학회지
    • /
    • 제45권5호
    • /
    • pp.117-125
    • /
    • 2003
  • Since the recorded information used for operation of a catchment modelling system contain errors that influence the calibration of catchment modelling system control parameter values, the accurate estimation of these parameters is difficult. Despite these influences, existing traditional calibration approaches focus only on achieving the best "curve fitting" between simulated and recorded data, and not on generic evaluation of control parameter values. This paper introduces an Early Stopping Technique which is aimed at avoiding the procedure of curve-fitting through monitoring improvements in the objective function used for assessing the optimal parameter set. Application of this approach to the calibration of SWMM (Storm Water Management Model) on the Centennial Park catchment in Sydney, Australia is outlined. outlined.

Calibration of APEX-Paddy Model using Experimental Field Data

  • Mohammad, Kamruzzaman;Hwang, Syewoon;Cho, Jaepil;Choi, Soon-Kun;Park, Chanwoo
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2019년도 학술발표회
    • /
    • pp.155-155
    • /
    • 2019
  • The Agricultural Policy/Environmental eXtender (APEX) models have been developed for assessing agricultural management efforts and their effects on soil and water at the field scale as well as more complex multi-subarea landscapes, whole farms, and watersheds. National Academy of Agricultural Sciences, Wanju, Korea, has modified a key component of APEX application, named APEX-Paddy for simulating water quality with considering appropriate paddy management practices, such as puddling and flood irrigation management. Calibration and validation are an anticipated step before any model application. Simple techniques are essential to assess whether or not a parameter should be adjusted for calibration. However, very few study has been done to evaluate the ability of APEX-Paddy to simulate the impact of multiple management scenarios on nutrients loss. In this study, the observation data from experimental fields at Iksan in South Kora was used in calibration and evaluation process during 2013-2015. The APEX auto- calibration tool (APEX-CUTE) was used for model calibration and sensitivity analysis. Four quantitative statistics, the coefficient of determination ($R^2$),Nash-Sutcliffe(NSE),percentbias(PBIAS)androotmeansquareerror(RMSE)were used in model evaluation. In this study, the hydrological process of the modified model, APEX-Paddy, is being calibrated and tested in predicting runoff discharge rate and nutrient yield. Field-scale calibration and validation processes are described with an emphasis on essential calibration parameters and direction regarding logical sequences of calibration steps. This study helps to understand the calibration and validation way is further provided for applications of APEX-Paddy at the field scales.

  • PDF

HSPF-PEST를 이용한 불연속 실측치 자동보정 (Automatic Calibration for Noncontinuous Observed Data using HSPF-PEST)

  • 전지홍;이새봄
    • 한국농공학회논문집
    • /
    • 제54권6호
    • /
    • pp.111-119
    • /
    • 2012
  • Applicability of 8 day interval flow data for the calibration of hydrologic model was evaluated using Hydrological Simulation Program-Fortran (HSPF) at Kyungan watershed. The 8 day interval flow monitored by Ministry of Environment located at upstream was calibrated and periodically validated during 2004-2008. And continuous daily flow monitored by Ministry of Construction & Transportation (MOCT) and located at the mouth was compared with daily simulated data during 2004-2007 as spatial validation. Automatic calibration tool which is Model-Independent Parameter Estimation & Uncertainty Analysis (PEST) was applied for HSPF calibration procedure. The model efficiencies for calibration and periodic validation were 0.63 and 0.88, and model performances were fair and very good, respectively, based on criteria of calibration tolerances. Continuous daily stream flow at the mouth of Kyungan watershed were good agreement with observed continuous daily stream flow with showing 0.63 NS value. The PEST program is very useful tool for HSPF hydrologic calibration using non-continuous daily stream flow as well as continuous daily stream flow. The 8 day interval flow data monitored by MOE could be used to calibrate hydrologic model if the continuous daily stream flow is unavailable.

HSPEXP 모형평가지표 이용한 HSPF 모형의 수문매개변수 보정 (Calibration of HSPF Hydrology Parameters Using HSPEXP Model Performance Criteria)

  • 김상민;성충현;박승우
    • 한국농공학회논문집
    • /
    • 제51권4호
    • /
    • pp.15-20
    • /
    • 2009
  • The purpose of this study was to test the applicability of the HSPEXP model performance criteria for calibrating hydrologic parameters of HSPF. Baran watershed, located at Whasung city, was selected as a study watershed in this study. Input data for the HSPF model were obtained from the digital elevation map, landuse map, soil map and others. Water flow data from 1996 to 2000 was used for calibration and from 2002 to 2007 was for validation. Using the HSPEXP decision-support software, hydrology parameters were adjusted based on total volume, then low flows, storm flows, and finally seasonal flows. Suggested criteria for each model performance variables were referenced from the previous research. For the calibration period, all the HSPEXP model performance criteria were satisfied while two criteria were slightly violated for the validation period.

Hardware 유역의 수문매개변수 보정을 위한 SWAT-CUP 프로그램의 적용성 평가 (Evaluation of Applicability of SWAT-CUP Program for Hydrologic Parameter Calibration in Hardware Watershed)

  • 김상민
    • 한국농공학회논문집
    • /
    • 제59권3호
    • /
    • pp.63-70
    • /
    • 2017
  • The purpose of this study was to calibrate the hydrologic parameters of SWAT model and analyze the daily runoff for the study watershed using SWAT-CUP. The Hardware watershed is located in Virginia, USA. The watershed area is $356.15km^2$, and the land use accounts for 73.4 % of forest and 23.2 % of pasture. Input data for the SWAT model were obtained from the digital elevation map, landuse map, soil map and others. Water flow data from 1990 to 1994 was used for calibration and from 1997 to 2005 was for validation. The SUFI-2 module of the SWAT-CUP program was used to calibrate the hydrologic parameters. The parameters were calibrated for the highly sensitive parameters presented in previous studies. The P-factor, R-factor, $R^2$, Nash-Sutcliffe efficiency (NS), and average flow were used for the goodness-of-fit measures. The applicability of the model was evaluated by sequentially increasing the number of applied parameters from 4 to 11. In this study, 10-parameter set was accepted for calibration in consideration of goodness-of-fit measures. For the calibration period, P-factor was 0.85, R-factor was 1.76, $R^2$ was 0.51 and NS was 0.49. The model was validated using the adjusted ranges of selected parameters. For the validation period, P-factor was 0.78, R-factor was 1.60, $R^2$ was 0.60 and NS was 0.57.

HSPF 모형을 이용한 합천댐 유입량 추정 (Estimation of the Hapcheon Dam Inflow Using HSPF Model)

  • 조현경;김상민
    • 한국농공학회논문집
    • /
    • 제61권5호
    • /
    • pp.69-77
    • /
    • 2019
  • The objective of this study was to calibrate and validate the HSPF (Hydrological Simulation Program-Fortran) model for estimating the runoff of the Hapcheon dam watershed. Spatial data, such as watershed, stream, land use, and a digital elevation map, were used as input data for the HSPF model. Observed runoff data from 2000 to 2016 in study watershed were used for calibration and validation. Hydrologic parameters for runoff calibration were selected based on the user's manual and references, and trial and error method was used for parameter calibration. The $R^2$, RMSE (root-mean-square error), RMAE (relative mean absolute error), and NSE (Nash-Sutcliffe efficiency coefficient) were used to evaluate the model's performance. Calibration and validation results showed that annual mean runoff was within ${\pm}4%$ error. The model performance criteria for calibration and validation showed that $R^2$ was in the rang of 0.78 to 0.83, RMSE was 2.55 to 2.76 mm/day, RMAE was 0.46 to 0.48 mm/day, and NSE was 0.81 to 0.82 for daily runoff. The amount of inflow to Hapcheon Dam was calculated from the calibrated HSPF model and the result was compared with observed inflow, which was -0.9% error. As a result of analyzing the relation between inflow and storage capacity, it was found that as the inflow increases, the storage increases, and when the inflow decreases, the storage also decreases. As a result of correlation between inflow and storage, $R^2$ of the measured inflow and storage was 0.67, and the simulated inflow and storage was 0.61.