• Title/Summary/Keyword: sequential data assimilation

Search Result 8, Processing Time 0.022 seconds

Development of a software framework for sequential data assimilation and its applications in Japan

  • Noh, Seong-Jin;Tachikawa, Yasuto;Shiiba, Michiharu;Kim, Sun-Min;Yorozu, Kazuaki
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2012.05a
    • /
    • pp.39-39
    • /
    • 2012
  • Data assimilation techniques have received growing attention due to their capability to improve prediction in various areas. Despite of their potentials, applicable software frameworks to probabilistic approaches and data assimilation are still limited because the most of hydrologic modelling software are based on a deterministic approach. In this study, we developed a hydrological modelling framework for sequential data assimilation, namely MPI-OHyMoS. MPI-OHyMoS allows user to develop his/her own element models and to easily build a total simulation system model for hydrological simulations. Unlike process-based modelling framework, this software framework benefits from its object-oriented feature to flexibly represent hydrological processes without any change of the main library. In this software framework, sequential data assimilation based on the particle filters is available for any hydrologic models considering various sources of uncertainty originated from input forcing, parameters and observations. The particle filters are a Bayesian learning process in which the propagation of all uncertainties is carried out by a suitable selection of randomly generated particles without any assumptions about the nature of the distributions. In MPI-OHyMoS, ensemble simulations are parallelized, which can take advantage of high performance computing (HPC) system. We applied this software framework for several catchments in Japan using a distributed hydrologic model. Uncertainty of model parameters and radar rainfall estimates is assessed simultaneously in sequential data assimilation.

  • PDF

Data Assimilation for Oceanographic Application: A Brief Overview

  • Park, Seon-K.
    • Journal of the korean society of oceanography
    • /
    • v.38 no.2
    • /
    • pp.52-59
    • /
    • 2003
  • In this paper, a brief overview on data assimilation is provided in the context of oceanographic application. The ocean data assimilation needs to ingest various types of data such as satellites and floats, thus essentially requires dynamically-consistent assimilation methods. For such purpose, sequential and variational approaches are discussed and compared. The major advantage of the Kalman filter (KF) is that it can forecast error covariances at each time step. However, for models with very large dimension of state vector, the KF Is exceedingly expensive and computationally less efficient than four-dimensional variational assimilation (4D-Var). For operational application, simplified 4D-Var schemes as well as ensemble KF may be considered.

Data Assimilation of Real-time Air Quality Forecast using CUDA (CUDA를 이용한 실시간 대기질 예보 자료동화)

  • Bae, Hyo-Sik;Yu, Suk-Hyun;Kwon, Hee-Yong
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.17 no.2
    • /
    • pp.271-277
    • /
    • 2017
  • As a result of rapid industrialization, air pollutants are seriously threatening the health of the people, the forecast is becoming more and more important. In forecasting air quality, it is very important to create a reliable initial field because the initial field input to the air quality forecasting model affects the accuracy of the forecast. There are several methods for enhancing the initial field input. One of the necessary techniques is data assimilation. The number of operations and the time required for such data assimilation is exponentially increased as the forecasting area is widened and the number of observation sites increases. Therefore, as the forecast size increases, it is difficult to apply the existing sequential processing method to a field requiring fast processing speed. In this paper, we propose a method that can process Cresman's method, which is one of the data assimilation techniques, in real time using CUDA. As a result, the proposed parallel processing method using CUDA improved at least 35 times faster than the conventional sequential method and other parallel processing methods.

Development of Real time Air Quality Prediction System

  • Oh, Jai-Ho;Kim, Tae-Kook;Park, Hung-Mok;Kim, Young-Tae
    • Proceedings of the Korean Environmental Sciences Society Conference
    • /
    • 2003.11a
    • /
    • pp.73-78
    • /
    • 2003
  • In this research, we implement Realtime Air Diffusion Prediction System which is a parallel Fortran model running on distributed-memory parallel computers. The system is designed for air diffusion simulations with four-dimensional data assimilation. For regional air quality forecasting a series of dynamic downscaling technique is adopted using the NCAR/Penn. State MM5 model which is an atmospheric model. The realtime initial data have been provided daily from the KMA (Korean Meteorological Administration) global spectral model output. It takes huge resources of computation to get 24 hour air quality forecast with this four step dynamic downscaling (27km, 9km, 3km, and lkm). Parallel implementation of the realtime system is imperative to achieve increased throughput since the realtime system have to be performed which correct timing behavior and the sequential code requires a large amount of CPU time for typical simulations. The parallel system uses MPI (Message Passing Interface), a standard library to support high-level routines for message passing. We validate the parallel model by comparing it with the sequential model. For realtime running, we implement a cluster computer which is a distributed-memory parallel computer that links high-performance PCs with high-speed interconnection networks. We use 32 2-CPU nodes and a Myrinet network for the cluster. Since cluster computers more cost effective than conventional distributed parallel computers, we can build a dedicated realtime computer. The system also includes web based Gill (Graphic User Interface) for convenient system management and performance monitoring so that end-users can restart the system easily when the system faults. Performance of the parallel model is analyzed by comparing its execution time with the sequential model, and by calculating communication overhead and load imbalance, which are common problems in parallel processing. Performance analysis is carried out on our cluster which has 32 2-CPU nodes.

  • PDF

Comparative assessment and uncertainty analysis of ensemble-based hydrologic data assimilation using airGRdatassim (airGRdatassim을 이용한 앙상블 기반 수문자료동화 기법의 비교 및 불확실성 평가)

  • Lee, Garim;Lee, Songhee;Kim, Bomi;Woo, Dong Kook;Noh, Seong Jin
    • Journal of Korea Water Resources Association
    • /
    • v.55 no.10
    • /
    • pp.761-774
    • /
    • 2022
  • Accurate hydrologic prediction is essential to analyze the effects of drought, flood, and climate change on flow rates, water quality, and ecosystems. Disentangling the uncertainty of the hydrological model is one of the important issues in hydrology and water resources research. Hydrologic data assimilation (DA), a technique that updates the status or parameters of a hydrological model to produce the most likely estimates of the initial conditions of the model, is one of the ways to minimize uncertainty in hydrological simulations and improve predictive accuracy. In this study, the two ensemble-based sequential DA techniques, ensemble Kalman filter, and particle filter are comparatively analyzed for the daily discharge simulation at the Yongdam catchment using airGRdatassim. The results showed that the values of Kling-Gupta efficiency (KGE) were improved from 0.799 in the open loop simulation to 0.826 in the ensemble Kalman filter and to 0.933 in the particle filter. In addition, we analyzed the effects of hyper-parameters related to the data assimilation methods such as precipitation and potential evaporation forcing error parameters and selection of perturbed and updated states. For the case of forcing error conditions, the particle filter was superior to the ensemble in terms of the KGE index. The size of the optimal forcing noise was relatively smaller in the particle filter compared to the ensemble Kalman filter. In addition, with more state variables included in the updating step, performance of data assimilation improved, implicating that adequate selection of updating states can be considered as a hyper-parameter. The simulation experiments in this study implied that DA hyper-parameters needed to be carefully optimized to exploit the potential of DA methods.

Uncertainty quantification for structural health monitoring applications

  • Nasr, Dana E.;Slika, Wael G.;Saad, George A.
    • Smart Structures and Systems
    • /
    • v.22 no.4
    • /
    • pp.399-411
    • /
    • 2018
  • The difficulty in modeling complex nonlinear structures lies in the presence of significant sources of uncertainties mainly attributed to sudden changes in the structure's behavior caused by regular aging factors or extreme events. Quantifying these uncertainties and accurately representing them within the complex mathematical framework of Structural Health Monitoring (SHM) are significantly essential for system identification and damage detection purposes. This study highlights the importance of uncertainty quantification in SHM frameworks, and presents a comparative analysis between intrusive and non-intrusive techniques in quantifying uncertainties for SHM purposes through two different variations of the Kalman Filter (KF) method, the Ensemble Kalman filter (EnKF) and the Polynomial Chaos Kalman Filter (PCKF). The comparative analysis is based on a numerical example that consists of a four degrees-of-freedom (DOF) system, comprising Bouc-Wen hysteretic behavior and subjected to El-Centro earthquake excitation. The comparison is based on the ability of each technique to quantify the different sources of uncertainty for SHM purposes and to accurately approximate the system state and parameters when compared to the true state with the least computational burden. While the results show that both filters are able to locate the damage in space and time and to accurately estimate the system responses and unknown parameters, the computational cost of PCKF is shown to be less than that of EnKF for a similar level of numerical accuracy.

A Development of Generalized Coupled Markov Chain Model for Stochastic Prediction on Two-Dimensional Space (수정 연쇄 말콥체인을 이용한 2차원 공간의 추계론적 예측기법의 개발)

  • Park Eun-Gyu
    • Journal of Soil and Groundwater Environment
    • /
    • v.10 no.5
    • /
    • pp.52-60
    • /
    • 2005
  • The conceptual model of under-sampled study area will include a great amount of uncertainty. In this study, we investigate the applicability of Markov chain model in a spatial domain as a tool for minimizing the uncertainty arose from the lack of data. A new formulation is developed to generalize the previous two-dimensional coupled Markov chain model, which has more versatility to fit any computational sequence. Furthermore, the computational algorithm is improved to utilize more conditioning information and reduce the artifacts, such as the artificial parcel inclination, caused by sequential computation. A generalized 20 coupled Markov chain (GCMC) is tested through applying a hypothetical soil map to evaluate the appropriateness as a substituting model for conventional geostatistical models. Comparing to sequential indicator model (SIS), the simulation results from GCMC shows lower entropy at the boundaries of indicators which is closer to real soil maps. For under-sampled indicators, however, GCMC under-estimates the presence of the indicators, which is a common aspect of all other geostatistical models. To improve this under-estimation, further study on data fusion (or assimilation) inclusion in the GCMC is required.

Climate Change Impact on the Flowering Season of Japanese Cherry (Prunus serrulata var. spontanea) in Korea during 1941-2100 (기후변화에 따른 벚꽃 개화일의 시공간 변이)

  • Yun Jin-I.
    • Korean Journal of Agricultural and Forest Meteorology
    • /
    • v.8 no.2
    • /
    • pp.68-76
    • /
    • 2006
  • A thermal time-based two-step phenological model was used to project flowering dates of Japanese cherry in South Korea from 1941 to 2100. The model consists of two sequential periods: the rest period described by chilling requirement and the forcing period described by heating requirement. Daily maximum and minimum temperature are used to calculate daily chill units until a pre-determined chilling requirement for rest release is met. After the projected rest release date, daily heat units (growing degree days) are accumulated until a pre-determined heating requirement for flowering is achieved. Model calculations using daily temperature data at 18 synoptic stations during 1955-2004 were compared with the observed blooming dates and resulted in 3.9 days mean absolute error, 5.1 days root mean squared error, and a correlation coefficient of 0.86. Considering that the phonology observation has never been fully standardized in Korea, this result seems reasonable. Gridded data sets of daily maximum and minimum temperature with a 270 m grid spacing were prepared for the climatological years 1941-1970 and 1971-2000 from observations at 56 synoptic stations by using a spatial interpolation scheme for correcting urban heat island effect as well as elevation effect. A 25km-resolution temperature data set covering the Korean Peninsula, prepared by the Meteorological Research Institute of Korea Meteorological Administration under the condition of Inter-governmental Panel on Climate Change-Special Report on Emission Scenarios A2, was converted to 270 m gridded data for the climatological years 2011-2040, 2041-2070 and 2071-2100. The model was run by the gridded daily maximum and minimum temperature data sets, each representing a climatological normal year for 1941-1970, 1971-2000, 2011-2040, 2041-2070, and 2071-2100. According to the model calculation, the spatially averaged flowering date for the 1971-2000 normal is shorter than that for 1941-1970 by 5.2 days. Compared with the current normal (1971-2000), flowering of Japanese cherry is expected to be earlier by 9, 21, and 29 days in the future normal years 2011-2040, 2041-2070, and 2071-2100, respectively. Southern coastal areas might experience springs with incomplete or even no Japanese cherry flowering caused by insufficient chilling for breaking bud dormancy.