• Title/Summary/Keyword: Bias-correction

Search Result 270, Processing Time 0.03 seconds

STANDARDISATION OF NIR INSTRUMENTS, INFLUENCE OF THE CALIBRATION METHODS AND THE SIZE OF THE CLONING SET

  • Dardenne, Pierre;Cowe, Ian-A.;Berzaghi, Paolo;Flinn, Peter-C.;Lagerholm, Martin;Shenk, John-S.;Westerhaus, Mark-O.
    • Proceedings of the Korean Society of Near Infrared Spectroscopy Conference
    • /
    • 2001.06a
    • /
    • pp.1121-1121
    • /
    • 2001
  • A previous study (Berzaghi et al., 2001) evaluated the performance of 3 calibration methods, modified partial least squares (MPLS), local PLS (LOCAL) and artificial neural networks (ANN) on the prediction of the chemical composition of forages, using a large NIR database. The study used forage samples (n=25,977) from Australia, Europe (Belgium, Germany, Italy and Sweden) and North America (Canada and U.S.A) with reference values for moisture, crude protein and neutral detergent fibre content. The spectra of the samples were collected using 10 different Foss NIR Systems instruments, only some of which had been standardized to one master instrument. The aim of the present study was to evaluate the behaviour of these different calibration methods when predicting the same samples measured on different instruments. Twenty-two sealed samples of different kind of forages were measured in duplicate on seven instruments (one master and six slaves). Three sets of near infrared spectra (1100 to 2500nm) were created. The first set consisted of the spectra in their original form (unstandardized); the second set was created using a single sample standardization (Clone1); the third was created using a multiple sample procedure (Clone6). WinISI software (Infrasoft International Inc., Port Mathilda, PA, USA) was used to perform both types of standardization, Clone1 is just a photometric offset between a “master” instrument and the “slave” instrument. Clone6 modifies both the X-axis through a wavelength adjustment and the Y-axis through a simple regression wavelength by wavelength. The Clone1 procedure used one sample spectrally close to the centre of the population. The six samples used in Clone 6 were selected to cover the range of spectral variation in the sample set. The remaining fifteen samples were used to evaluate the performances of the different models. The predicted values for dry matter, protein and neutral detergent fibre from the master Instrument were considered as “reference Y values” when computing the statistics RMSEP, SEPC, R, Bias, Slope, mean GH (global Mahalanobis distance) and mean NH (neighbourhood Mahalanobis distance) for the 6 slave instruments. From the results we conclude that i) all the calibration techniques gave satisfactory results after standardization. Without standardization the predicted data from the slaves would have required slope and bias correction to produce acceptable statistics. ii) Standardization reduced the errors for all calibration methods and parameters tested, reducing not only systematic biases but also random errors. iii) Standardization removed slope effects that were significantly different from 1.0 in most of the cases. iv) Clone1 and Clone6 gave similar results except for NDF where Clone6 gave better RMSEP values than Clone1. v) GH and NH were reduced by half even with very large data sets including unstandardized spectra.

  • PDF

Estimation of Future Design Flood Under Non-Stationarity for Wonpyeongcheon Watershed (비정상성을 고려한 원평천 유역의 미래 설계홍수량 산정)

  • Ryu, Jeong Hoon;Kang, Moon Seong;Park, Jihoon;Jun, Sang Min;Song, Jung Hun;Kim, Kyeung;Lee, Kyeong-Do
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.57 no.5
    • /
    • pp.139-152
    • /
    • 2015
  • Along with climate change, it is reported that the scale and frequency of extreme climate events show unstable tendency of increase. Thus, to comprehend the change characteristics of precipitation data, it is needed to consider non-stationary. The main objectives of this study were to estimate future design floods for Wonpyeongcheon watershed based on RCP (Representative Concentration Pathways) scenario. Wonpyeongcheon located in the Keum River watershed was selected as the study area. Historical precipitation data of the past 35 years (1976~2010) were collected from the Jeonju meteorological station. Future precipitation data based on RCP4.5 were also obtained for the period of 2011~2100. Systematic bias between observed and simulated data were corrected using the quantile mapping (QM) method. The parameters for the bias-correction were estimated by non-parametric method. A non-stationary frequency analysis was conducted with moving average method which derives change characteristics of generalized extreme value (GEV) distribution parameters. Design floods for different durations and frequencies were estimated using rational formula. As the result, the GEV parameters (location and scale) showed an upward tendency indicating the increase of quantity and fluctuation of an extreme precipitation in the future. The probable rainfall and design flood based on non-stationarity showed higher values than those of stationarity assumption by 1.2%~54.9% and 3.6%~54.9%, respectively, thus empathizing the necessity of non-stationary frequency analysis. The study findings are expected to be used as a basis to analyze the impacts of climate change and to reconsider the future design criteria of Wonpyeongcheon watershed.

Prediction of SWAT Stream Flow Using Only Future Precipitation Data (미래 강수량 자료만을 이용한 SWAT모형의 유출 예측)

  • Lee, Ji Min;Kum, Donghyuk;Kim, Young Sug;Kim, Yun Jung;Kang, Hyunwoo;Jang, Chun Hwa;Lee, Gwan Jae;Lim, Kyoung Jae
    • Journal of Korean Society on Water Environment
    • /
    • v.29 no.1
    • /
    • pp.88-96
    • /
    • 2013
  • Much attention has been needed in water resource management at the watershed due to drought and flooding issues caused by climate change in recent years. Increase in air temperature and changes in precipitation patterns due to climate change are affecting hydrologic cycles, such as evaporation and soil moisture. Thus, these phenomena result in increased runoff at the watershed. The Soil and Water Assessment Tool (SWAT) model has been used to evaluate rainfall-runoff at the watershed reflecting effects on hydrology of various weather data such as rainfall, temperature, humidity, solar radiation, wind speed. For bias-correction of RCP data, at least 30 year data are needed. However, for most gaging stations, only precipitation data have been recorded and very little stations have recorded other weather data. In addition, the RCP scenario does not provide all weather data for the SWAT model. In this study, two scenarios were made to evaluate whether it would be possible to estimate streamflow using measured precipitation and long-term average values of other weather data required for running the SWAT. With measured long-term weather data (scenario 1) and with long-term average values of weather data except precipitation (scenario 2), the estimate streamflow values were almost the same with NSE value of 0.99. Increase/decrease by ${\pm}2%$, ${\pm}4%$ in temperature and humidity data did not affect streamflow. Thus, the RCP precipitation data for Hongcheon watershed were bias-corrected with measured long-term precipitation data to evaluate effects of climate change on streamflow. The results revealed that estimated streamflow for 2055s was the greatest among data for 2025s, 2055s, and 2085s. However, estimated streamflow for 2085s decreased by 9%. In addition, streamflow for Spring would be expected to increase compared with current data and streamflow for Summer will be decreased with RCP data. The results obtained in this study indicate that the streamflow could be estimated with long-term precipitation data only and effects of climate change could be evaluated using precipitation data as shown in this study.

Evaluating Changes and Uncertainty of Nitrogen Load from Rice Paddy according to the Climate Change Scenario Multi-Model Ensemble (기후변화시나리오 다중모형 앙상블에 따른 논 질소 유출 부하량 변동 및 불확실성 평가)

  • Choi, Soon-Kun;Jeong, Jaehak;Yeob, So-Jin;Kim, Minwook;Kim, Jin Ho;Kim, Min-Kyeong
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.62 no.5
    • /
    • pp.47-62
    • /
    • 2020
  • Rice paddy accounts for approximately 52.5% of all farmlands in South Korea, and it is closely related to the water environment. Climate change is expected to affect not only agricultural productivity also the water and the nutrient circulation. Therefore this study was aimed to evaluate changes of nitrogen load from rice paddy considering climate change scenario uncertainty. APEX-Paddy model which reflect rice paddy environment by modifying APEX (Agricultural Policy and Environmental eXtender) model was used. Using the AIMS (APCC Integrated Modeling Solution) offered by the APEC Climate Center, bias correction was conducted for 9 GCMs using non-parametric quantile mapping. Bias corrected climate change scenarios were applied to the APEX-Paddy model. The changes and uncertainty in runoff and nitrogen load were evaluated using multi-model ensemble. Paddy runoff showed a change of 23.1% for RCP4.5 scenario and 45.5% for RCP8.5 scenario compared the 2085s (2071 to 2100) against the base period (1976 to 2005). The nitrogen load was found to be increased as 43.9% for RCP4.5 scenario and 76.0% for RCP8.5 scenario. The uncertainty analysis showed that the annual standard deviation of nitrogen loads increased in the future, and the maximum entropy indicated an increasing tendency. And Duncan's analysis showed significant differences among GCMs as the future progressed. The result of this study seems to be used as a basis for mid- and long-term policies for water resources and water system environment considering climate change.

Spatial Gap-filling of GK-2A/AMI Hourly AOD Products Using Meteorological Data and Machine Learning (기상모델자료와 기계학습을 이용한 GK-2A/AMI Hourly AOD 산출물의 결측화소 복원)

  • Youn, Youjeong;Kang, Jonggu;Kim, Geunah;Park, Ganghyun;Choi, Soyeon;Lee, Yangwon
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.5_3
    • /
    • pp.953-966
    • /
    • 2022
  • Since aerosols adversely affect human health, such as deteriorating air quality, quantitative observation of the distribution and characteristics of aerosols is essential. Recently, satellite-based Aerosol Optical Depth (AOD) data is used in various studies as periodic and quantitative information acquisition means on the global scale, but optical sensor-based satellite AOD images are missing in some areas with cloud conditions. In this study, we produced gap-free GeoKompsat 2A (GK-2A) Advanced Meteorological Imager (AMI) AOD hourly images after generating a Random Forest based gap-filling model using grid meteorological and geographic elements as input variables. The accuracy of the model is Mean Bias Error (MBE) of -0.002 and Root Mean Square Error (RMSE) of 0.145, which is higher than the target accuracy of the original data and considering that the target object is an atmospheric variable with Correlation Coefficient (CC) of 0.714, it is a model with sufficient explanatory power. The high temporal resolution of geostationary satellites is suitable for diurnal variation observation and is an important model for other research such as input for atmospheric correction, estimation of ground PM, analysis of small fires or pollutants.

PM2.5 Simulations for the Seoul Metropolitan Area: (III) Application of the Modeled and Observed PM2.5 Ratio on the Contribution Estimation (수도권 초미세먼지 농도모사: (III) 관측농도 대비 모사농도 비율 적용에 따른 기여도 변화 검토)

  • Bae, Changhan;Yoo, Chul;Kim, Byeong-Uk;Kim, Hyun Cheol;Kim, Soontae
    • Journal of Korean Society for Atmospheric Environment
    • /
    • v.33 no.5
    • /
    • pp.445-457
    • /
    • 2017
  • In this study, we developed an approach to better account for uncertainties in estimated contributions from fine particulate matter ($PM_{2.5}$) modeling. Our approach computes a Concentration Correction Factor (CCF) which is a ratio of observed concentrations to baseline model concentrations. We multiply modeled direct contribution estimates with CCF to obtain revised contributions. Overall, the modeling system showed reasonably good performance, correlation coefficient R of 0.82 and normalized mean bias of 2%, although the model underestimated some PM species concentrations. We also noticed that model biases vary seasonally. We compared contribution estimates of major source sectors before and after applying CCFs. We observed that different source sectors showed variable magnitudes of sensitivities to the CCF application. For example, the total primary $PM_{2.5}$ contribution was increased $2.4{\mu}g/m^3$ or 63% after the CCF application. Out of a $2.4{\mu}g/m^3$ increment, line sources and area source made up $1.3{\mu}g/m^3$ and $0.9{\mu}g/m^3$ which is 92% of the total contribution changes. We postulated two major reasons for variations in estimated contributions after the CCF application: (1) monthly variability of unadjusted contributions due to emission source characteristics and (2) physico-chemical differences in environmental conditions that emitted precursors undergo. Since emissions-to-$PM_{2.5}$ concentration conversion rate is an important piece of information to prioritize control strategy, we examined the effects of CCF application on the estimated conversion rates. We found that the application of CCFs can alter the rank of conversion efficiencies of source sectors. Finally, we discussed caveats of our current approach such as no consideration of ion neutralization which warrants further studies.

Evaluating Water Supply Capacity of Embankment Raised Reservoir on Climate Change (기후변화에 따른 둑높임 저수지의 용수공급능력 평가)

  • Lee, Jaenam;Noh, Jaekyoung
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.57 no.4
    • /
    • pp.73-84
    • /
    • 2015
  • An embankment raising project on 113 agricultural reservoirs in Korea was implemented in 2009 to increase water supply capacity for agricultural water and instream uses. This study evaluated the future water supply capacity of the Imgo reservoir at which the agricultural reservoir embankment raising project was completed, considering climate change scenarios. The height of the embankment of the reservoir was increased by 4.5 m, thereby increasing its total storage from 1,657.0 thousand to 3,179.5 thousand cubic meters. To simulate the reservoir water storage with respect to climate changes, two climate change scenarios, namely, RCP 4.5 and RCP 8.5 (in which greenhouse gas reduction policy was executed and not executed, respectively) were applied with bias correction for reflecting the climate characteristics of the target basin. The analysis result of the agricultural water supply capacity in the future, after the agricultural reservoir embankment raising project is implemented, revealed that the water supply reliability and the agricultural water supply increased, regardless of the climate change scenarios. By simulating the reservoir water storage considering the instream flow post completion of the embankment raising project, it was found that water shortage in the reservoir in the future is not likely to occur when it is supplied with an appropriate instream flow. The range of instream flow tends to decrease over time under RCP 8.5, in which the greenhouse gas reduction policy was not executed, and the restoration of reservoir storage was lower in this scenario than in RCP 4.5, in which greenhouse gas reduction policy was executed.

Isotope Measurement of Uranium at Ultratrace Levels Using Multicollector Inductively Coupled Plasma Mass Spectrometry

  • Oh, Seong-Y.;Lee, Seon-A.;Park, Jong-Ho;Lee, Myung-Ho;Song, Kyu-Seok
    • Mass Spectrometry Letters
    • /
    • v.3 no.2
    • /
    • pp.54-57
    • /
    • 2012
  • Mass spectrometric analysis was carried out using multicollector inductively coupled plasma mass spectrometry (MC-ICP-MS) for the precise and accurate determination of the isotope ratios of ultratrace levels of uranium dissolved in 3% $HNO_3$. We used the certified reference material (CRM) 112-A at a trace level of 100 pg/mL for the uranium isotopic measurement. Multiple collectors were utilized for the simultaneous measurement of uranium isotopes to reduce the signal uncertainty due to variations in the ion beam intensity over time. Mass bias correction was applied to the measured U isotopes to improve the precision and accuracy. Furthermore, elemental standard solution with certified values of platinum, iridium, gold, and thallium dissolved in 3% $HNO_3$ were analyzed to investigate the formation rates of the polyatomic ions of $Ir^{40}$ $Ar^+$, $Pt^{40}$ $Ar^+$, $Tl^{40}$ $Ar^+$, $Au^{40}$ $Ar^+$ for the concentration range of 50-400 pg/mL. Those polyatomic ions have mass-to-charge ratios in the 230-245 m/z region that it would contribute to the increase of background intensity of uranium, thorium, plutonium, and americium isotopes. The effect of the polyatomic ion interference on uranium isotope measurement has been estimated.

Ambiguity Determination Technique for Multiple GPS Reference Stations using the Combination of L1/L2 Carrier Phase (L1/L2 측정치 조합을 이용한 GPS 기준국간 반송파 미지정수 결정 기법)

  • Park, Byung-Woon;Song, June-Sol;Kee, Chang-Don
    • Journal of Advanced Navigation Technology
    • /
    • v.15 no.5
    • /
    • pp.705-713
    • /
    • 2011
  • In this paper, we introduce two techniques for resolving integer ambiguities between reference stations, which is one of the most important processes in Network RTK correction generation process. Each techniques uses Hatch filter and combination of L1/L2 measurements and we used simulation data and real data to evaluate performance of the techniques. For evaluating performance of each technique, we compared corrections generated from user site and Network RTK. As a result, Network RTK with the technique which uses Hatch filter improves user performance much more than single baseline RTK does. Residual of user is smaller than a half size of wavelength so it does not affect user integer ambiguity resolution, however, it contains significant bias error. On the other hand, when we used the technique which uses combination of L1/L2 measurements, residual error of user is largely reduced compared to the technique using Hatch filter.

Improvement of Atmospheric Dispersion Model Performance by Pretreatment of Dispersion Coefficients (분산계수의 전처리에 의한 대기분산모델 성능의 개선)

  • Park, Ok-Hyun;Kim, Gyung-Soo
    • Journal of Korean Society for Atmospheric Environment
    • /
    • v.23 no.4
    • /
    • pp.449-456
    • /
    • 2007
  • Dispersion coefficient preprocessing schemes have been examined to improve plume dispersion model performance in complex coastal areas. The performances of various schemes for constructing the sigma correction order were evaluated through estimations of statistical measures, such as bias, gross error, R, FB, NMSE, within FAC2, MG, VG, IOA, UAPC and MRE. This was undertaken for the results of dispersion modeling, which applied each scheme. Environmental factors such as sampling time, surface roughness, plume rising, plume height and terrain rolling were considered in this study. Gaussian plume dispersion model was used to calculate 1 hr $SO_2$ concentration 4 km downwind from a power plant in Boryeung coastal area. Here, measured data for January to December of 2002 were obtained so that modelling results could be compared. To compare the performances between various schemes, integrated scores of statistical measures were obtained by giving weights for each measure and then summing each score. This was done because each statistical measure has its own function and criteria; as a result, no measure can be taken as a sole index indicative of the performance level for each modeling scheme. The best preprocessing scheme was discerned using the step-wise method. The most significant factor influencing the magnitude of real dispersion coefficients appeared to be sampling time. A second significant factor appeared to be surface roughness, with the rolling terrain being the least significant for elevated sources in a gently rolling terrain. The best sequence of correcting the sigma from P-G scheme was found to be the combination of (1) sampling time, (2) surface roughness, (3) plume rising, (4) plume height, and (5) terrain rolling.