• Title/Summary/Keyword: Markov Chain and Monte Carlo technique

Search Result 29, Processing Time 0.02 seconds

Markov Chain Monte Carlo simulation based Bayesian updating of model parameters and their uncertainties

  • Sengupta, Partha;Chakraborty, Subrata
    • Structural Engineering and Mechanics
    • /
    • v.81 no.1
    • /
    • pp.103-115
    • /
    • 2022
  • The prediction error variances for frequencies are usually considered as unknown in the Bayesian system identification process. However, the error variances for mode shapes are taken as known to reduce the dimension of an identification problem. The present study attempts to explore the effectiveness of Bayesian approach of model parameters updating using Markov Chain Monte Carlo (MCMC) technique considering the prediction error variances for both the frequencies and mode shapes. To remove the ergodicity of Markov Chain, the posterior distribution is obtained by Gaussian Random walk over the proposal distribution. The prior distributions of prediction error variances of modal evidences are implemented through inverse gamma distribution to assess the effectiveness of estimation of posterior values of model parameters. The issue of incomplete data that makes the problem ill-conditioned and the associated singularity problem is prudently dealt in by adopting a regularization technique. The proposed approach is demonstrated numerically by considering an eight-storey frame model with both complete and incomplete modal data sets. Further, to study the effectiveness of the proposed approach, a comparative study with regard to accuracy and computational efficacy of the proposed approach is made with the Sequential Monte Carlo approach of model parameter updating.

Parameter and Modeling Uncertainty Analysis of Semi-Distributed Hydrological Model using Markov-Chain Monte Carlo Technique (Markov-Chain Monte Carlo 기법을 이용한 준 분포형 수문모형의 매개변수 및 모형 불확실성 분석)

  • Choi, Jeonghyeon;Jang, Suhyung;Kim, Sangdan
    • Journal of Korean Society on Water Environment
    • /
    • v.36 no.5
    • /
    • pp.373-384
    • /
    • 2020
  • Hydrological models are based on a combination of parameters that describe the hydrological characteristics and processes within a watershed. For this reason, the model performance and accuracy are highly dependent on the parameters. However, model uncertainties caused by parameters with stochastic characteristics need to be considered. As a follow-up to the study conducted by Choi et al (2020), who developed a relatively simple semi-distributed hydrological model, we propose a tool to estimate the posterior distribution of model parameters using the Metropolis-Hastings algorithm, a type of Markov-Chain Monte Carlo technique, and analyze the uncertainty of model parameters and simulated stream flow. In addition, the uncertainty caused by the parameters of each version is investigated using the lumped and semi-distributed versions of the applied model to the Hapcheon Dam watershed. The results suggest that the uncertainty of the semi-distributed model parameters was relatively higher than that of the lumped model parameters because the spatial variability of input data such as geomorphological and hydrometeorological parameters was inherent to the posterior distribution of the semi-distributed model parameters. Meanwhile, no significant difference existed between the two models in terms of uncertainty of the simulation outputs. The statistical goodness of fit of the simulated stream flows against the observed stream flows showed satisfactory reliability in both the semi-distributed and the lumped models, but the seasonality of the stream flow was reproduced relatively better by the distributed model.

Stochastic Simple Hydrologic Partitioning Model Associated with Markov Chain Monte Carlo and Ensemble Kalman Filter (마코프 체인 몬테카를로 및 앙상블 칼만필터와 연계된 추계학적 단순 수문분할모형)

  • Choi, Jeonghyeon;Lee, Okjeong;Won, Jeongeun;Kim, Sangdan
    • Journal of Korean Society on Water Environment
    • /
    • v.36 no.5
    • /
    • pp.353-363
    • /
    • 2020
  • Hydrologic models can be classified into two types: those for understanding physical processes and those for predicting hydrologic quantities. This study deals with how to use the model to predict today's stream flow based on the system's knowledge of yesterday's state and the model parameters. In this regard, for the model to generate accurate predictions, the uncertainty of the parameters and appropriate estimates of the state variables are required. In this study, a relatively simple hydrologic partitioning model is proposed that can explicitly implement the hydrologic partitioning process, and the posterior distribution of the parameters of the proposed model is estimated using the Markov chain Monte Carlo approach. Further, the application method of the ensemble Kalman filter is proposed for updating the normalized soil moisture, which is the state variable of the model, by linking the information on the posterior distribution of the parameters and by assimilating the observed steam flow data. The stochastically and recursively estimated stream flows using the data assimilation technique revealed better representation of the observed data than the stream flows predicted using the deterministic model. Therefore, the ensemble Kalman filter in conjunction with the Markov chain Monte Carlo approach could be a reliable and effective method for forecasting daily stream flow, and it could also be a suitable method for routinely updating and monitoring the watershed-averaged soil moisture.

A Development of Markov Chain Monte Carlo History Matching Technique for Subsurface Characterization (지하 불균질 예측 향상을 위한 마르코프 체인 몬테 카를로 히스토리 매칭 기법 개발)

  • Jeong, Jina;Park, Eungyu
    • Journal of Soil and Groundwater Environment
    • /
    • v.20 no.3
    • /
    • pp.51-64
    • /
    • 2015
  • In the present study, we develop two history matching techniques based on Markov chain Monte Carlo method where radial basis function and Gaussian distribution generated by unconditional geostatistical simulation are employed as the random walk transition kernels. The Bayesian inverse methods for aquifer characterization as the developed models can be effectively applied to the condition even when the targeted information such as hydraulic conductivity is absent and there are transient hydraulic head records due to imposed stress at observation wells. The model which uses unconditional simulation as random walk transition kernel has advantage in that spatial statistics can be directly associated with the predictions. The model using radial basis function network shares the same advantages as the model with unconditional simulation, yet the radial basis function network based the model does not require external geostatistical techniques. Also, by employing radial basis function as transition kernel, multi-scale nested structures can be rigorously addressed. In the validations of the developed models, the overall predictabilities of both models are sound by showing high correlation coefficient between the reference and the predicted. In terms of the model performance, the model with radial basis function network has higher error reduction rate and computational efficiency than with unconditional geostatistical simulation.

Performance of Image Reconstruction Techniques for Efficient Multimedia Transmission of Multi-Copter (멀티콥터의 효율적 멀티미디어 전송을 위한 이미지 복원 기법의 성능)

  • Hwang, Yu Min;Lee, Sun Yui;Lee, Sang Woon;Kim, Jin Young
    • Journal of Satellite, Information and Communications
    • /
    • v.9 no.4
    • /
    • pp.104-110
    • /
    • 2014
  • This paper considers two reconstruction schemes of structured-sparse signals, turbo inference and Markov chain Monte Carlo (MCMC) inference, in compressed sensing(CS) technique that is recently getting an important issue for an efficient video wireless transmission system using multi-copter as an unmanned aerial vehicle. Proposed reconstruction algorithms are setting importance on reduction of image data sizes, fast reconstruction speed and errorless reconstruction. As a result of experimentation with twenty kinds of images, we can find turbo reconstruction algorithm based on loopy belief propagation(BP) has more excellent performances than MCMC algorithm based on Gibbs sampling as aspects of average reconstruction computation time, normalized mean squared error(NMSE) values.

Bayesian Analysis of Binary Non-homogeneous Markov Chain with Two Different Time Dependent Structures

  • Sung, Min-Je
    • Management Science and Financial Engineering
    • /
    • v.12 no.2
    • /
    • pp.19-35
    • /
    • 2006
  • We use the hierarchical Bayesian approach to describe the transition probabilities of a binary nonhomogeneous Markov chain. The Markov chain is used for describing the transition behavior of emotionally disturbed children in a treatment program. The effects of covariates on transition probabilities are assessed using a logit link function. To describe the time evolution of transition probabilities, we consider two modeling strategies. The first strategy is based on the concept of exchangeabiligy, whereas the second one is based on a first order Markov property. The deviance information criterion (DIC) measure is used to compare models with two different time dependent structures. The inferences are made using the Markov chain Monte Carlo technique. The developed methodology is applied to some real data.

Maximum penalized likelihood estimation for a stress-strength reliability model using complete and incomplete data

  • Hassan, Marwa Khalil
    • Communications for Statistical Applications and Methods
    • /
    • v.25 no.4
    • /
    • pp.355-371
    • /
    • 2018
  • The two parameter negative exponential distribution has many practical applications in queuing theory such as the service times of agents in system, the time it takes before your next telephone call, the time until a radioactive practical decays, the distance between mutations on a DNA strand, and the extreme values of annual snowfall or rainfall; consequently, has many applications in reliability systems. This paper considers an estimation problem of stress-strength model with two parameter negative parameter exponential distribution. We introduce a maximum penalized likelihood method, Bayes estimator using Lindley approximation to estimate stress-strength model and compare the proposed estimators with regular maximum likelihood estimator for complete data. We also introduce a maximum penalized likelihood method, Bayes estimator using a Markov chain Mote Carlo technique for incomplete data. A Monte Carlo simulation study is performed to compare stress-strength model estimates. Real data is used as a practical application of the proposed model.

Bayesian updated correlation length of spatial concrete properties using limited data

  • Criel, Pieterjan;Caspeele, Robby;Taerwe, Luc
    • Computers and Concrete
    • /
    • v.13 no.5
    • /
    • pp.659-677
    • /
    • 2014
  • A Bayesian response surface updating procedure is applied in order to update the parameters of the covariance function of a random field for concrete properties based on a limited number of available measurements. Formulas as well as a numerical algorithm are presented in order to update the parameters of response surfaces using Markov Chain Monte Carlo simulations. The parameters of the covariance function are often based on some kind of expert judgment due the lack of sufficient measurement data. However, a Bayesian updating technique enables to estimate the parameters of the covariance function more rigorously and with less ambiguity. Prior information can be incorporated in the form of vague or informative priors. The proposed estimation procedure is evaluated through numerical simulations and compared to the commonly used least square method.

Bayesian estimation for frequency using resampling methods (재표본 방법론을 활용한 베이지안 주파수 추정)

  • Pak, Ro Jin
    • The Korean Journal of Applied Statistics
    • /
    • v.30 no.6
    • /
    • pp.877-888
    • /
    • 2017
  • Spectral analysis is used to determine the frequency of time series data. We first determine the frequency of the series through the power spectrum or the periodogram and then calculate the period of a cycle that may exist in a time series. Estimating the frequency using a Bayesian technique has been developed and proven to be useful; however, the Bayesian estimator for the frequency cannot be analytically solved through mathematical equations and may be handled numerically or computationally. In this paper, we make an inference on the Bayesian frequency through both resampling a parameter by Markov chain Monte Carlo (MCMC) methods and resampling data by bootstrap methods for a time series. We take the Korean real estate price index as an example for Bayesian frequency estimation. We have found a difference in the periods between the sale price index and the long term rental price index, but the difference is not statistically significant.

Component-Based System Reliability using MCMC Simulation

  • ChauPattnaik, Sampa;Ray, Mitrabinda;Nayak, Mitalimadhusmita;Patnaik, Srikanta
    • Journal of information and communication convergence engineering
    • /
    • v.20 no.2
    • /
    • pp.79-89
    • /
    • 2022
  • To compute the mean and variance of component-based reliability software, we focused on path-based reliability analysis. System reliability depends on the transition probabilities of components within a system and reliability of the individual components as basic input parameters. The uncertainty in these parameters is estimated from the test data of the corresponding components and arises from the software architecture, failure behaviors, software growth models etc. Typically, researchers perform Monte Carlo simulations to study uncertainty. Thus, we considered a Markov chain Monte Carlo (MCMC) simulation to calculate uncertainty, as it generates random samples through sequential methods. The MCMC approach determines the input parameters from the probability distribution, and then calculates the average approximate expectations for a reliability estimation. The comparison of different techniques for uncertainty analysis helps in selecting the most suitable technique based on data requirements and reliability measures related to the number of components.