• Title/Summary/Keyword: Data Bias

Search Result 1,757, Processing Time 0.029 seconds

Analysis of bias correction performance of satellite-derived precipitation products by deep learning model

  • Le, Xuan-Hien;Nguyen, Giang V.;Jung, Sungho;Lee, Giha
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2022.05a
    • /
    • pp.148-148
    • /
    • 2022
  • Spatiotemporal precipitation data is one of the primary quantities in hydrological as well as climatological studies. Despite the fact that the estimation of these data has made considerable progress owing to advances in remote sensing, the discrepancy between satellite-derived precipitation product (SPP) data and observed data is still remarkable. This study aims to propose an effective deep learning model (DLM) for bias correction of SPPs. In which TRMM (The Tropical Rainfall Measuring Mission), CMORPH (CPC Morphing technique), and PERSIANN-CDR (Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks) are three SPPs with a spatial resolution of 0.25o exploited for bias correction, and APHRODITE (Asian Precipitation - Highly-Resolved Observational Data Integration Towards Evaluation) data is used as a benchmark to evaluate the effectiveness of DLM. We selected the Mekong River Basin as a case study area because it is one of the largest watersheds in the world and spans many countries. The adjusted dataset has demonstrated an impressive performance of DLM in bias correction of SPPs in terms of both spatial and temporal evaluation. The findings of this study indicate that DLM can generate reliable estimates for the gridded satellite-based precipitation bias correction.

  • PDF

Evaluation of Ground-Truth Results of Radar Rainfall Depending on Rain-Gauge Data (우량계 강우 자료에 따른 레이더 강우의 지상보정 결과 검토)

  • Kim, Byoung-Soo;Kim, Kyoung-Jun;Yoo, Chul-Sang
    • Journal of the Korean Society of Hazard Mitigation
    • /
    • v.7 no.4
    • /
    • pp.19-29
    • /
    • 2007
  • This study compares various ground-truth designs of radar rainfall using rain-gauge data sets from Korea Meteorological Administration (KMA), AWS and Ministry of Construction and Transportation (MOCT). These Rain-gauge data sets and the Mt. Gwanak radar rainfall data for the same period were compared, and then the differences between two observed rainfall were evaluated with respect to the amount of bias. Additionally this study investigated possible differences in bias due to different storm characteristics. The application results showed no distinct differences between biases from three rain-gauge data sets, but some differences in their statistical characteristics. In overall, the design bias from MOCT was estimated to be the smallest among the three rain-gauge data sets. Among three storm events considered, the jangma with the highest spatial intermittency showed the smallest bias.

Sensitivity of an Anisotropic Magnetoresistance Device with Different Bias Conditions

  • Kim, T.S.;Kim, K.C.;Kim, Kibo;K. Koh;Y.J. Song;Song, Y.S.;Suh, S.J.;Kim, Y.S.
    • Journal of Magnetics
    • /
    • v.6 no.1
    • /
    • pp.36-41
    • /
    • 2001
  • A micromagnetic model and a single-domain model simulation programs were used to analyze the sensitivity of a $20\mu m\times 60\mu m \times 1000{\AA}$ permalloy strip as a magnetoresistance sensor with bias fields of various directions and magnitudes. The micromagnetic model agrees with the measured sensitivity data better than the single-domain model. The data show the highest peak sensitivity with the bias field at 90$^{\circ}$to the current. The peak sensitivity decreases and the peak broadens as the bias angle decreases. The simulation using the micromagnetic model shows that a bias angle smaller than 90$^{\circ}$eads to magnetization patterns which are free from closure domains or vertices over a wider range of bias fields.

  • PDF

Bias Correction of Satellite-Based Precipitation Using Convolutional Neural Network

  • Le, Xuan-Hien;Lee, Gi Ha
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2020.06a
    • /
    • pp.120-120
    • /
    • 2020
  • Spatial precipitation data is one of the essential components in modeling hydrological problems. The estimation of these data has achieved significant achievements own to the recent advances in remote sensing technology. However, there are still gaps between the satellite-derived rainfall data and observed data due to the significant dependence of rainfall on spatial and temporal characteristics. An effective approach based on the Convolutional Neural Network (CNN) model to correct the satellite-derived rainfall data is proposed in this study. The Mekong River basin, one of the largest river system in the world, was selected as a case study. The two gridded precipitation data sets with a spatial resolution of 0.25 degrees used in the CNN model are APHRODITE (Asian Precipitation - Highly-Resolved Observational Data Integration Towards Evaluation) and PERSIANN-CDR (Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks). In particular, PERSIANN-CDR data is exploited as satellite-based precipitation data and APHRODITE data is considered as observed rainfall data. In addition to developing a CNN model to correct the satellite-based rain data, another statistical method based on standard deviations for precipitation bias correction was also mentioned in this study. Estimated results indicate that the CNN model illustrates better performance both in spatial and temporal correlation when compared to the standard deviation method. The finding of this study indicated that the CNN model could produce reliable estimates for the gridded precipitation bias correction problem.

  • PDF

Application of Convolutional Neural Networks (CNN) for Bias Correction of Satellite Precipitation Products (SPPs) in the Amazon River Basin

  • Alena Gonzalez Bevacqua;Xuan-Hien Le;Giha Lee
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.159-159
    • /
    • 2023
  • The Amazon River basin is one of the largest basins in the world, and its ecosystem is vital for biodiversity, hydrology, and climate regulation. Thus, understanding the hydrometeorological process is essential to the maintenance of the Amazon River basin. However, it is still tricky to monitor the Amazon River basin because of its size and the low density of the monitoring gauge network. To solve those issues, remote sensing products have been largely used. Yet, those products have some limitations. Therefore, this study aims to do bias corrections to improve the accuracy of Satellite Precipitation Products (SPPs) in the Amazon River basin. We use 331 rainfall stations for the observed data and two daily satellite precipitation gridded datasets (CHIRPS, TRMM). Due to the limitation of the observed data, the period of analysis was set from 1st January 1990 to 31st December 2010. The observed data were interpolated to have the same resolution as the SPPs data using the IDW method. For bias correction, we use convolution neural networks (CNN) combined with an autoencoder architecture (ConvAE). To evaluate the bias correction performance, we used some statistical indicators such as NSE, RMSE, and MAD. Hence, those results can increase the quality of precipitation data in the Amazon River basin, improving its monitoring and management.

  • PDF

ERS-1 AND CCRS C-SAR Data Integration For Look Direction Bias Correction Using Wavelet Transform

  • Won, J.S.;Moon, Woo-Il M.;Singhroy, Vern;Lowman, Paul-D.Jr.
    • Korean Journal of Remote Sensing
    • /
    • v.10 no.2
    • /
    • pp.49-62
    • /
    • 1994
  • Look direction bias in a single look SAR image can often be misinterpreted in the geological application of radar data. This paper investigates digital processing techniques for SAR image data integration and compensation of the SAR data look direction bias. The two important approaches for reducing look direction bias and integration of multiple SAR data sets are (1) principal component analysis (PCA), and (2) wavelet transform(WT) integration techniques. These two methods were investigated and tested with the ERS-1 (VV-polarization) and CCRS*s airborne (HH-polarization) C-SAR image data sets recorded over the Sudbury test site, Canada. The PCA technique has been very effective for integration of more than two layers of digital image data. When there only two sets of SAR data are available, the PCA thchnique requires at least one more set of auxiliary data for proper rendition of the fine surface features. The WT processing approach of SAR data integration utilizes the property which decomposes images into approximated image ( low frequencies) characterizing the spatially large and relatively distinct structures, and detailed image (high frequencies) in which the information on detailed fine structures are preserved. The test results with the ERS-1and CCRS*s C-SAR data indicate that the new WT approach is more efficient and robust in enhancibng the fine details of the multiple SAR images than the PCA approach.

Development of Pre-Processing and Bias Correction Modules for AMSU-A Satellite Data in the KIAPS Observation Processing System (KIAPS 관측자료 처리시스템에서의 AMSU-A 위성자료 초기 전처리와 편향보정 모듈 개발)

  • Lee, Sihye;Kim, Ju-Hye;Kang, Jeon-Ho;Chun, Hyoung-Wook
    • Atmosphere
    • /
    • v.23 no.4
    • /
    • pp.453-470
    • /
    • 2013
  • As a part of the KIAPS Observation Processing System (KOPS), we have developed the modules of satellite radiance data pre-processing and quality control, which include observation operators to interpolate model state variables into radiances in observation space. AMSU-A (Advanced Microwave Sounding Unit-A) level-1d radiance data have been extracted using the BUFR (Binary Universal Form for the Representation of meteorological data) decoder and a first guess has been calculated with RTTOV (Radiative Transfer for TIROS Operational Vertical Sounder) version 10.2. For initial quality checks, the pixels contaminated by large amounts of cloud liquid water, heavy precipitation, and sea ice have been removed. Channels for assimilation, rejection, or monitoring have been respectively selected for different surface types since the errors from the skin temperature are caused by inaccurate surface emissivity. Correcting the bias caused by errors in the instruments and radiative transfer model is crucial in radiance data pre-processing. We have developed bias correction modules in two steps based on 30-day innovation statistics (observed radiance minus background; O-B). The scan bias correction has been calculated individually for each channel, satellite, and scan position. Then a multiple linear regression of the scan-bias-corrected innovations with several predictors has been employed to correct the airmass bias.

The Relationship between Optimistic Bias about Health Crisis and Health Behavior (성인의 건강위기에 대한 낙관적 편견과 건강행위 간의 관계)

  • Park, Su-Ho;Lee, Sul-Hee;Ham, Eun-Mi
    • Journal of Korean Academy of Nursing
    • /
    • v.38 no.3
    • /
    • pp.403-409
    • /
    • 2008
  • Purpose: This study was performed to identify the relationship between optimistic bias about health crisis and health behavior of Korean adults in a crisis of health, and to prepare baseline data for developing a health education and promotion program. Methods: Study subjects were 595 aged from 19 to 64 who live in Korea. Data were collected through questionnaires administered by one interviewer. Descriptive statistics and Pearson's correlation coefficient were calculated using the SPSS program. Results: The average score for optimistic bias about health crisis was 2.69, and that for health behavior was 107.05. The optimistic bias about health crisis showed a significantly positive correlation with health behavior (r=.187, p=.000). Conclusion: To make our results more useful, it is necessary to identity the causal relationship between health attitudes as an explanatory variable and optimistic bias as an outcome variable. In addition, a relatively low score in optimistic bias from this research compared to other studies must be explained through further studies considering unique Korean cultural background. Moreover, research of the relationship between optimistic bias about health crisis and health behavior looking at people who don't have good health behaviors is needed.

A Study of Static Bias Correction for Temperature of Aircraft based Observations in the Korean Integrated Model (한국형모델의 항공기 관측 온도의 정적 편차 보정 연구)

  • Choi, Dayoung;Ha, Ji-Hyun;Hwang, Yoon-Jeong;Kang, Jeon-ho;Lee, Yong Hee
    • Atmosphere
    • /
    • v.30 no.4
    • /
    • pp.319-333
    • /
    • 2020
  • Aircraft observations constitute one of the major sources of temperature observations which provide three-dimensional information. But it is well known that the aircraft temperature data have warm bias against sonde observation data, and therefore, the correction of aircraft temperature bias is important to improve the model performance. In this study, the algorithm of the bias correction modified from operational KMA (Korea Meteorological Administration) global model is adopted in the preprocessing of aircraft observations, and the effect of the bias correction of aircraft temperature is investigated by conducting the two experiments. The assimilation with the bias correction showed better consistency in the analysis-forecast cycle in terms of the differences between observations (radiosonde and GPSRO (Global Positioning System Radio Occultation)) and 6h forecast. This resulted in an improved forecasting skill level of the mid-level temperature and geopotential height in terms of the root-mean-square error. It was noted that the benefits of the correction of aircraft temperature bias was the upper-level temperature in the midlatitudes, and this affected various parameters (winds, geopotential height) via the model dynamics.

Orbit Determination Accuracy Improvement for Geostationary Satellite with Single Station Antenna Tracking Data

  • Hwang, Yoo-La;Lee, Byoung-Sun;Kim, Hae-Yeon;Kim, Hae-Dong;Kim, Jae-Hoon
    • ETRI Journal
    • /
    • v.30 no.6
    • /
    • pp.774-782
    • /
    • 2008
  • An operational orbit determination (OD) and prediction system for the geostationary Communication, Ocean, and Meteorological Satellite (COMS) mission requires accurate satellite positioning knowledge to accomplish image navigation registration on the ground. Ranging and tracking data from a single ground station is used for COMS OD in normal operation. However, the orbital longitude of the COMS is so close to that of satellite tracking sites that geometric singularity affects observability. A method to solve the azimuth bias of a single station in singularity is to periodically apply an estimated azimuth bias using the ranging and tracking data of two stations. Velocity increments of a wheel off-loading maneuver which is performed twice a day are fixed by planned values without considering maneuver efficiency during OD. Using only single-station data with the correction of the azimuth bias, OD can achieve three-sigma position accuracy on the order of 1.5 km root-sum-square.

  • PDF