• Title/Summary/Keyword: Two-State Markov Model

Search Result 99, Processing Time 0.023 seconds

Daily Rainfall Simulation by Rainfall Frequency and State Model of Markov Chain (강우 빈도와 마코프 연쇄의 상태모형에 의한 일 강우량 모의)

  • Jung, Young-Hun;Kim, Buyng-Sik;Kim, Hung Soo;Shim, Myung-Pil
    • Journal of Wetlands Research
    • /
    • v.5 no.2
    • /
    • pp.1-13
    • /
    • 2003
  • In Korea, most of the rainfalls have been concentrated in the flood season and the flood study has received more attention than low flow analysis. One of the reasons that the analysis of low flows has less attention is the lacks of the required data like daily rainfall and so we have used the stochastic processes such as pulse noise, exponential distribution, and state model of Markov chain for the rainfall simulation in short term such as daily. Especially this study will pay attention to the state model of Markov chain. The previous study had performed the simulation study by the state model without considerations of the flood and non-flood periods and without consideration of the frequency of rainfall for the period of a state. Therefore this study considers afore mentioned two cases and compares the results with the known state model. As the results, the RMSEs of the suggested and known models represent the similar results. However, the PRE(relative percentage error) shows the suggested model is better results.

  • PDF

Oil Price Forecasting : A Markov Switching Approach with Unobserved Component Model

  • Nam, Si-Kyung;Sohn, Young-Woo
    • Management Science and Financial Engineering
    • /
    • v.14 no.2
    • /
    • pp.105-118
    • /
    • 2008
  • There are many debates on the topic of the relationship between oil prices and economic growth. Through the repeated processes of conformations and contractions on the subject, two main issues are developed; one is how to define and drive oil shocks from oil prices, and the other is how to specify an econometric model to reflect the asymmetric relations between oil prices and output growth. The study, thus, introduces the unobserved component model to pick up the oil shocks and a first-order Markov switching model to reflect the asymmetric features. We finally employ unique oil shock variables from the stochastic trend components of oil prices and adapt four lags of the mean growth Markov Switching model. The results indicate that oil shocks exert more impact to recessionary state than expansionary state and the supply-side oil shocks are more persistent and significant than the demand-side shocks.

System Replacement Policy for A Partially Observable Markov Decision Process Model

  • Kim, Chang-Eun
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.16 no.2
    • /
    • pp.1-9
    • /
    • 1990
  • The control of deterioration processes for which only incomplete state information is available is examined in this study. When the deterioration is governed by a Markov process, such processes are known as Partially Observable Markov Decision Processes (POMDP) which eliminate the assumption that the state or level of deterioration of the system is known exactly. This research investigates a two state partially observable Markov chain in which only deterioration can occur and for which the only actions possible are to replace or to leave alone. The goal of this research is to develop a new jump algorithm which has the potential for solving system problems dealing with continuous state space Markov chains.

  • PDF

Valuation of European and American Option Prices Under the Levy Processes with a Markov Chain Approximation

  • Han, Gyu-Sik
    • Management Science and Financial Engineering
    • /
    • v.19 no.2
    • /
    • pp.37-42
    • /
    • 2013
  • This paper suggests a numerical method for valuation of European and American options under the two L$\acute{e}$vy Processes, Normal Inverse Gaussian Model and the Variance Gamma model. The method is based on approximation of underlying asset price using a finite-state, time-homogeneous Markov chain. We examine the effectiveness of the proposed method with simulation results, which are compared with those from the existing numerical method, the lattice-based method.

Queueing System Operating in Random Environment as a Model of a Cell Operation

  • Kim, Chesoong;Dudin, Alexander;Dudina, Olga;Kim, Jiseung
    • Industrial Engineering and Management Systems
    • /
    • v.15 no.2
    • /
    • pp.131-142
    • /
    • 2016
  • We consider a multi-server queueing system without buffer and with two types of customers as a model of operation of a mobile network cell. Customers arrive at the system in the marked Markovian arrival flow. The service times of customers are exponentially distributed with parameters depending on the type of customer. A part of the available servers is reserved exclusively for service of first type customers. Customers who do not receive service upon arrival, can make repeated attempts. The system operation is influenced by random factors, leading to a change of the system parameters, including the total number of servers and the number of reserved servers. The behavior of the system is described by the multi-dimensional Markov chain. The generator of this Markov chain is constructed and the ergodicity condition is derived. Formulas for computation of the main performance measures of the system based on the stationary distribution of the Markov chain are derived. Numerical examples are presented.

Performance Evaluation of the WiMAX Network Based on Combining the 2D Markov Chain and MMPP Traffic Model

  • Saha, Tonmoy;Shufean, Md. Abu;Alam, Mahbubul;Islam, Md. Imdadul
    • Journal of Information Processing Systems
    • /
    • v.7 no.4
    • /
    • pp.653-678
    • /
    • 2011
  • WiMAX is intended for fourth generation wireless mobile communications where a group of users are provided with a connection and a fixed length queue. In present literature traffic of such network is analyzed based on the generator matrix of the Markov Arrival Process (MAP). In this paper a simple analytical technique of the two dimensional Markov chain is used to obtain the trajectory of the congestion of the network as a function of a traffic parameter. Finally, a two state phase dependent arrival process is considered to evaluate probability states. The entire analysis is kept independent of modulation and coding schemes.

A M-TYPE RISK MODEL WITH MARKOV-MODULATED PREMIUM RATE

  • Yu, Wen-Guang
    • Journal of applied mathematics & informatics
    • /
    • v.27 no.5_6
    • /
    • pp.1033-1047
    • /
    • 2009
  • In this paper, we consider a m-type risk model with Markov-modulated premium rate. A integral equation for the conditional ruin probability is obtained. A recursive inequality for the ruin probability with the stationary initial distribution and the upper bound for the ruin probability with no initial reserve are given. A system of Laplace transforms of non-ruin probabilities, given the initial environment state, is established from a system of integro-differential equations. In the two-state model, explicit formulas for non-ruin probabilities are obtained when the initial reserve is zero or when both claim size distributions belong to the $K_n$-family, n $\in$ $N^+$ One example is given with claim sizes that have exponential distributions.

  • PDF

Throughput of Coded DS CDMA/Unslotted ALOHA Networks with Variable Length Data Traffic and Two User Classes in Rayleigh Fading FSMC Model

  • Tseng, Shu-Ming;Chiang, Li-Hsin;Wang, Yung-Chung
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.8 no.12
    • /
    • pp.4324-4342
    • /
    • 2014
  • Previous papers analyzed the throughput performance of the CDMA ALOHA system in Rayleigh fading channel, but they assume that the channel coefficient of Rayleigh fading was the same in the whole packet, which is not realistic. We recently proposed the finite-state Markov channel (FSMC) model to the throughput analysis of DS uncoded CDMA/unslotted ALOHA networks for fixed length data traffic in the mobile environment. We now propose the FSMC model to the throughput analysis of coded DS CDMA/unslotted ALOHA networks with variable length data traffic and one or two user classes in the mobile environment. The proposed DS CDMA/unslotted ALOHA wireless networks for two user classes with access control can maintain maximum throughput for the high priority user class under high message arrival per packet duration.

The Probabilistic Analysis of Fatigue Damage Accumulation Behavior Using Markov Chain Model in CFRP Composites (Markov Chain Model을 이용한 CFRP 복합재료의 피로손상누적거동에 대한 확률적 해석)

  • Kim, Do-Sik;Kim, In-Bai;Kim, Jung-Kyu
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.20 no.4
    • /
    • pp.1241-1250
    • /
    • 1996
  • The characteristics of fatigue cumulative damage and fatigue life of 8-harness satin woven CFRP composites with a circular hole under constant amplitude and 2-level block loading are estimated by Stochastic Makov chain model. It is found in this study that the fatigue damage accumulation behavior is very random and the fatigue damage is accumulated as two regions under constant amplitude fatigue loading. In constant amplitude fatigue loading the predicted mean number of cycles to a specified damage state by Markov chain model shows a good agreement with the test result. The predicted distribution of the fatigue cumulative damage by Markov chain model is similar to the test result. The fatigue life predictions under 2-level block loading by Markov chain model revised are good fitted to the test result more than by 2-parameter Weibull distribution function using percent failure rule.

Markov Chain Model for Synthetic Generation by Classification of Daily Precipitation Amount into Multi-State (강수계열의 상태분류에 의한 Markov 연쇄 모의발생 모형)

  • Kim, Ju-Hwan;Park, Chan-Yeong;Kang, Kwan-Won
    • Water for future
    • /
    • v.29 no.6
    • /
    • pp.179-188
    • /
    • 1996
  • The chronical sequences of daily precipitation are of great practical importance in the planning and operational processes of water resources system. A sequence of days with alternate dry day and wet day can be generated by two state Markov chain model that establish the subsequent daily state as wet or dry by previously calculated vconditional probabilities depending on the state of previous day. In this study, a synthetic generation model for obtaining the daily precipitation series is presented by classifying the precipitation amount in wet days into multi-states. To apply multi-state Markov chain model, the daily precipitation amounts for wet day are rearranged by grouping into thirty states with intervals for each state. Conditional probabilities as transition probability matrix are estimated from the computational scheme for stepping from the precipitation on one day to that on the following day. Statistical comparisons were made between the historical and synthesized chracteristics of daily precipitation series. From the results, it is shown that the proposed method is available to generate and simulate the daily precipitation series with fair accuracy and conserve the general statistical properties of historical precipitation series.

  • PDF