• Title/Summary/Keyword: Markov Chain Model

Search Result 560, Processing Time 0.023 seconds

The Minimum-cost Network Selection Scheme to Guarantee the Periodic Transmission Opportunity in the Multi-band Maritime Communication System (멀티밴드 해양통신망에서 전송주기를 보장하는 최소 비용의 망 선택 기법)

  • Cho, Ku-Min;Yun, Chang-Ho;Kang, Chung-G
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.36 no.2A
    • /
    • pp.139-148
    • /
    • 2011
  • This paper presents the minimum-cost network selection scheme which determines the transmission instance in the multi-band maritime communication system, so that the shipment-related real-time information can be transmitted within the maximum allowed period. The transmission instances and the corresponding network selection process are modeled by a Markov Decision Process (MDP), for the channel model in the 2-state Markov chain, which can be solved by stochastic dynamic programming. It derives the minimum-cost network selection rule, which can reduce the network cost significantly as compared with the straight-forward scheme with a periodic transmission.

Posterior density estimation for structural parameters using improved differential evolution adaptive Metropolis algorithm

  • Zhou, Jin;Mita, Akira;Mei, Liu
    • Smart Structures and Systems
    • /
    • v.15 no.3
    • /
    • pp.735-749
    • /
    • 2015
  • The major difficulty of using Bayesian probabilistic inference for system identification is to obtain the posterior probability density of parameters conditioned by the measured response. The posterior density of structural parameters indicates how plausible each model is when considering the uncertainty of prediction errors. The Markov chain Monte Carlo (MCMC) method is a widespread medium for posterior inference but its convergence is often slow. The differential evolution adaptive Metropolis-Hasting (DREAM) algorithm boasts a population-based mechanism, which nms multiple different Markov chains simultaneously, and a global optimum exploration ability. This paper proposes an improved differential evolution adaptive Metropolis-Hasting algorithm (IDREAM) strategy to estimate the posterior density of structural parameters. The main benefit of IDREAM is its efficient MCMC simulation through its use of the adaptive Metropolis (AM) method with a mutation strategy for ensuring quick convergence and robust solutions. Its effectiveness was demonstrated in simulations on identifying the structural parameters with limited output data and noise polluted measurements.

A Probabilistic Tracking Mechanism for Luxury Purchase Implemented by Hidden Markov Model, Bayesian Inference, Customer Satisfaction and Net Promoter Score (고객만족, NPS, Bayesian Inference 및 Hidden Markov Model로 구현하는 명품구매에 관한 확률적 추적 메카니즘)

  • Hwang, Sun Ju;Rhee, Jung Soo
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.23 no.6
    • /
    • pp.79-94
    • /
    • 2018
  • The purpose of this study is to specify a probabilistic tracking mechanism for customer luxury purchase implemented by hidden Markov model, Bayesian inference, customer satisfaction and net promoter score. In this paper, we have designed a probabilistic model based on customer's actual data containing purchase or non-purchase states by tracking the SPC chain : customer satisfaction -> customer referral -> purchase/non-purchase. By applying hidden Markov model and Viterbi algorithm to marketing theory, we have developed the statistical model related to probability theories and have found the best purchase pattern scenario from customer's purchase records.

Derivation of Intensity-Duration-Frequency and Flood Frequency Curve by Simulation of Hourly Precipitation using Nonhomogeneous Markov Chain Model (비동질성 Markov 모형의 시간강수량 모의 발생을 이용한 IDF 곡선 및 홍수빈도곡선의 유도)

  • Choi, Byung-Kyu;Oh, Tae-Suk;Park, Rae-Gun;Moon, Young-Il
    • Journal of Korea Water Resources Association
    • /
    • v.41 no.3
    • /
    • pp.251-264
    • /
    • 2008
  • In this study, a nonhomogeneous markov model which is able to simulate hourly rainfall series is developed for estimating reliable hydrologic variables. The proposed approach is applied to simulate hourly rainfall series in Korea. The simulated rainfall is used to estimate the design rainfall and flood in the watershed, and compared to observations in terms of reproducing underlying distributions of the data to assure model's validation. The model shows that the simulated rainfall series reproduce a similar statistical attribute with observations, and expecially maximum value is gradually increased as number of simulation increase. Therefore, with the proposed approach, the non-homogeneous markov model can be used to estimate variables for the purpose of design of hydraulic structures and analyze uncertainties associated with rainfall input in the hydrologic models.

A STUDY ON GARCH(p, q) PROCESS

  • Lee, Oe-Sook
    • Communications of the Korean Mathematical Society
    • /
    • v.18 no.3
    • /
    • pp.541-550
    • /
    • 2003
  • We consider the generalized autoregressive model with conditional heteroscedasticity process(GARCH). It is proved that if (equation omitted) β/sub i/ < 1, then there exists a unique invariant initial distribution for the Markov process emdedding the given GARCH process. Geometric ergodicity, functional central limit theorems, and a law of large numbers are also studied.

중국의 주택수급요인 변화성에 관한 연구 - 도시화, 소득변동, 수급가 변화에 대한 마르코프 체인(Markov Chains)과 패널모형(Panel Model) 응용을 중심으로 -

  • Chae, Dong-U;Jin, Guk-Hwa;Kim, Si-Yong
    • 중국학논총
    • /
    • no.72
    • /
    • pp.123-143
    • /
    • 2021
  • 自2000年以來, 中國通過經濟的高速增長迅速成爲世界第二大經濟體。与其他發展中國家一樣, 中國通過以政府爲主導的經濟增長方式推動了城市化進程進而助長了住房需求的增加和住房价格的上漲, 幷由此造成貧富差距不斷加大等各种社會問題。本硏究主要分析影響中國住房供給因素的中國住房生態系統。 通過自2001-2019年馬爾可夫鏈模型和效應模型的分析結果表明, 不同地區的城市化發展程度和收入的變化等与住房供需的相關因素, 存在有意義的顯著差异。特别是人口密度和收入最高的地區, 大部分在20年的持續城市化和收入差距的影響下没有發生變化, 幷且大部分在集群内移動。考慮住房城市化變化因素和收入變化因素, 20年投資供需价格變化彈性約爲0.628, 銷售需求价格變化彈性約爲0.748。换言之, 在中國住房也是具有財務屬性的商品。基于這一論点, 如果中國政府實施符合住房供需關系的住房供給政策, 卽可縮小貧富差距, 也將能够實現收入再分配和促進經濟增長兩个目標。

On the Exact Cycle Time of Failure Prone Multiserver Queueing Model Operating in Low Loading (낮은 교통밀도 하에서 서버 고장을 고려한 복수 서버 대기행렬 모형의 체제시간에 대한 분석)

  • Kim, Woo-Sung;Lim, Dae-Eun
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.39 no.2
    • /
    • pp.1-10
    • /
    • 2016
  • In this paper, we present a new way to derive the mean cycle time of the G/G/m failure prone queue when the loading of the system approaches to zero. The loading is the relative ratio of the arrival rate to the service rate multiplied by the number of servers. The system with low loading means the busy fraction of the system is low. The queueing system with low loading can be found in the semiconductor manufacturing process. Cluster tools in semiconductor manufacturing need a setup whenever the types of two successive lots are different. To setup a cluster tool, all wafers of preceding lot should be removed. Then, the waiting time of the next lot is zero excluding the setup time. This kind of situation can be regarded as the system with low loading. By employing absorbing Markov chain model and renewal theory, we propose a new way to derive the exact mean cycle time. In addition, using the proposed method, we present the cycle times of other types of queueing systems. For a queueing model with phase type service time distribution, we can obtain a two dimensional Markov chain model, which leads us to calculate the exact cycle time. The results also can be applied to a queueing model with batch arrivals. Our results can be employed to test the accuracy of existing or newly developed approximation methods. Furthermore, we provide intuitive interpretations to the results regarding the expected waiting time. The intuitive interpretations can be used to understand logically the characteristics of systems with low loading.

Simulation of Hourly Precipitation using Nonhomogeneous Markov Chain Model and Derivation of Rainfall Mass Curve using Transition Probability (비동질성 Markov 모형에 의한 시간강수량 모의 발생과 천이확률을 이용한 강우의 시간분포 유도)

  • Choi, Byung-Kyu;Oh, Tae-Suk;Park, Rae-Gun;Moon, Young-Il
    • Journal of Korea Water Resources Association
    • /
    • v.41 no.3
    • /
    • pp.265-276
    • /
    • 2008
  • The observed data of enough period need for design of hydrological works. But, most hydrological data aren't enough. Therefore in this paper, hourly precipitation generated by nonhomogeneous Markov chain model using variable Kernel density function. First, the Kernel estimator is used to estimate the transition probabilities. Second, wet hours are decided by transition probabilities and random numbers. Third, the amount of precipitation of each hours is calculated by the Kernel density function that estimated from observed data. At the results, observed precipitation data and generated precipitation data have similar statistic. Also, rainfall mass curve is derived by calculated transition probabilities for generation of hourly precipitation.

Continuous Time Markov Process Model for Nuclide Decay Chain Transport in the Fractured Rock Medium (균열 암반 매질에서의 핵종의 붕괴사슬 이동을 위한 연속시간 마코프 프로세스 모델)

  • Lee, Y.M.;Kang, C.H.;Hahn, P.S.;Park, H.H.;Lee, K.J.
    • Nuclear Engineering and Technology
    • /
    • v.25 no.4
    • /
    • pp.539-547
    • /
    • 1993
  • A stochastic approach using continuous time Markov process is presented to model the one-dimensional nuclide transport in fractured rock media as a further extension for previous works[1-3]. Nuclide transport of decay chain of arbitrary length in the single planar fractured rock media in the vicinity of the radioactive waste repository is modeled using a continuous time Markov process. While most of analytical solutions for nuclide transport of decay chain deal with the limited length of decay chain, do not consider the case of having rock matrix diffusion, and have very complicated solution form, the present model offers rather a simplified solution in the form of expectance and its variance resulted from a stochastic modeling. As another deterministic way, even numerical models of decay chain transport, in most cases, show very complicated procedure to get the solution and large discrepancy for the exact solution as opposed to the stochastic model developed in this study. To demonstrate the use of the present model and to verify the model by comparing with the deterministic model, a specific illustration was made for the transport of a chain of three member in single fractured rock medium with constant groundwater flow rate in the fracture, which ignores the rock matrix diffusion and shows good capability to model the fractured media around the repository.

  • PDF

Bayesian Hierarchical Mixed Effects Analysis of Time Non-Homogeneous Markov Chains (계층적 베이지안 혼합 효과 모델을 사용한 비동차 마코프 체인의 분석)

  • Sung, Minje
    • The Korean Journal of Applied Statistics
    • /
    • v.27 no.2
    • /
    • pp.263-275
    • /
    • 2014
  • The present study used a hierarchical Bayesian approach was used to develop a mixed effect model to describe the transitional behavior of subjects in time nonhomogeneous Markov chains. The posterior distributions of model parameters were not in analytically tractable forms; subsequently, a Gibbs sampling method was used to draw samples from full conditional posterior distributions. The proposed model was implemented with real data.