• 제목/요약/키워드: a Markov chain

검색결과 767건 처리시간 0.03초

On Weak Convergence of Some Rescaled Transition Probabilities of a Higher Order Stationary Markov Chain

  • Yun, Seok-Hoon
    • Journal of the Korean Statistical Society
    • /
    • 제25권3호
    • /
    • pp.313-336
    • /
    • 1996
  • In this paper we consider weak convergence of some rescaled transi-tion probabilities of a real-valued, k-th order (k $\geq$ 1) stationary Markov chain. Under the assumption that the joint distribution of K + 1 consecutive variables belongs to the domain of attraction of a multivariate extreme value distribution, the paper gives a sufficient condition for the weak convergence and characterizes the limiting distribution via the multivariate extreme value distribution.

  • PDF

Queueing System Operating in Random Environment as a Model of a Cell Operation

  • Kim, Chesoong;Dudin, Alexander;Dudina, Olga;Kim, Jiseung
    • Industrial Engineering and Management Systems
    • /
    • 제15권2호
    • /
    • pp.131-142
    • /
    • 2016
  • We consider a multi-server queueing system without buffer and with two types of customers as a model of operation of a mobile network cell. Customers arrive at the system in the marked Markovian arrival flow. The service times of customers are exponentially distributed with parameters depending on the type of customer. A part of the available servers is reserved exclusively for service of first type customers. Customers who do not receive service upon arrival, can make repeated attempts. The system operation is influenced by random factors, leading to a change of the system parameters, including the total number of servers and the number of reserved servers. The behavior of the system is described by the multi-dimensional Markov chain. The generator of this Markov chain is constructed and the ergodicity condition is derived. Formulas for computation of the main performance measures of the system based on the stationary distribution of the Markov chain are derived. Numerical examples are presented.

GENERALIZED DOMINOES TILING'S MARKOV CHAIN MIXES FAST

  • KAYIBI, K.K.;SAMEE, U.;MERAJUDDIN, MERAJUDDIN;PIRZADA, S.
    • Journal of applied mathematics & informatics
    • /
    • 제37권5_6호
    • /
    • pp.469-480
    • /
    • 2019
  • A generalized tiling is defined as a generalization of the properties of tiling a region of ${\mathbb{Z}}^2$ with dominoes, and comprises tiling with rhombus and any other tilings that admits height functions which can be ordered into a distributive lattice. By using properties of the distributive lattice, we prove that the Markov chain consisting of moving from one height function to the next by a flip is fast mixing and the mixing time ${\tau}({\epsilon})$ is given by ${\tau}({\epsilon}){\leq}(kmn)^3(mn\;{\ln}\;k+{\ln}\;{\epsilon}^{-1})$, where mn is the area of the grid ${\Gamma}$ that is a k-regular polycell. This result generalizes the result of the authors (T-tetromino tiling Markov chain is fast mixing, Theor. Comp. Sci. (2018)) and improves on the mixing time obtained by using coupling arguments by N. Destainville and by M. Luby, D. Randall, A. Sinclair.

이중 지수 점프확산 모형하에서의 마코브 체인을 이용한 아메리칸 옵션 가격 측정 (Valuation of American Option Prices Under the Double Exponential Jump Diffusion Model with a Markov Chain Approximation)

  • 한규식
    • 대한산업공학회지
    • /
    • 제38권4호
    • /
    • pp.249-253
    • /
    • 2012
  • This paper suggests a numerical method for valuation of American options under the Kou model (double exponential jump diffusion model). The method is based on approximation of underlying asset price using a finite-state, time-homogeneous Markov chain. We examine the effectiveness of the proposed method with simulation results, which are compared with those from the conventional numerical method, the finite difference method for PIDE (partial integro-differential equation).

A Repair Process with Embedded Markov Chain

  • Lee, Eui-Yong;Munsup Seoh
    • Journal of the Korean Statistical Society
    • /
    • 제28권4호
    • /
    • pp.515-522
    • /
    • 1999
  • A repair process of a system consisting of both perfect repairs and minimal repairs is introduced. The type of repair, when the system fails, is determined by an embedded two state Markov chain. We study several stochastic properties of the process including the preservation of ageing properties and the monotonicities of the time between successive repairs. After assigning repair costs to the process, we also show that an optimal repair policy uniquely exists, if the underlying life distribution of the system has DMRL.

  • PDF

Valuation of European and American Option Prices Under the Levy Processes with a Markov Chain Approximation

  • Han, Gyu-Sik
    • Management Science and Financial Engineering
    • /
    • 제19권2호
    • /
    • pp.37-42
    • /
    • 2013
  • This paper suggests a numerical method for valuation of European and American options under the two L$\acute{e}$vy Processes, Normal Inverse Gaussian Model and the Variance Gamma model. The method is based on approximation of underlying asset price using a finite-state, time-homogeneous Markov chain. We examine the effectiveness of the proposed method with simulation results, which are compared with those from the existing numerical method, the lattice-based method.

CHAIN DEPENDENCE AND STATIONARITY TEST FOR TRANSITION PROBABILITIES OF MARKOV CHAIN UNDER LOGISTIC REGRESSION MODEL

  • Sinha Narayan Chandra;Islam M. Ataharul;Ahmed Kazi Saleh
    • Journal of the Korean Statistical Society
    • /
    • 제35권4호
    • /
    • pp.355-376
    • /
    • 2006
  • To identify whether the sequence of observations follows a chain dependent process and whether the chain dependent or repeated observations follow stationary process or not, alternative procedures are suggested in this paper. These test procedures are formulated on the basis of logistic regression model under the likelihood ratio test criterion and applied to the daily rainfall occurrence data of Bangladesh for selected stations. These test procedures indicate that the daily rainfall occurrences follow a chain dependent process, and the different types of transition probabilities and overall transition probabilities of Markov chain for the occurrences of rainfall follow a stationary process in the Mymensingh and Rajshahi areas, and non-stationary process in the Chittagong, Faridpur and Satkhira areas.

추이확률의 추정을 위한 확장된 Markov Chain 모형 (An extension of Markov chain models for estimating transition probabilities)

  • 강정혁
    • 경영과학
    • /
    • 제10권2호
    • /
    • pp.27-42
    • /
    • 1993
  • Markov chain models can be used to predict the state of the system in the future. We extend the existing Markov chain models in two ways. For the stationary model, we propose a procedure that obtains the transition probabilities by appling the empirical Bayes method, in which the parameters of the prior distribution in the Bayes estimator are obtained on the collaternal micro data. For non-stationary model, we suggest a procedure that obtains a time-varying transition probabilities as a function of the exogenous variables. To illustrate the effectiveness of our extended models, the models are applied to the macro and micro time-series data generated from actual survey. Our stationary model yields reliable parameter values of the prior distribution. And our non-stationary model can predict the variable transition probabilities effectively.

  • PDF

불연속 Pareto 분포를 활용한 강수 모의발생 모델 개발 (A Development of Rainfall Simulation Model Using Piecewise Generalize Pareto Distribution)

  • 권현한;소병진;김태웅
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2011년도 학술발표회
    • /
    • pp.88-88
    • /
    • 2011
  • 수자원에서 일강수량 모의기법은 다양한 목적으로 활용되고 있으며 기본적으로 수공구조물 설계 및 수자원계획을 수립하기 위한 입력 자료로서 이용된다. 수자원계획은 장기적인 목적을 가지고 수행되는 것이 일반적이며 우리가 목표로 하는 장기간의 일강수량자료의 획득이 어렵기 때문에 단기간의 일강수량자료를 장기 모의하여 이용하게 된다. 일강수량을 모의하는데 있어서 강수계열의 단기간의 기억(memory)을 활용한 Markov Chain 모형이 가장 일반적이며, 기존 Markov Chain 모형을 통한 일강수량 모의에서 발생하는 가장 큰 문제점은 극치강수량을 재현하기 어렵다는 점이다. 이러한 문제점으로 인해 수자원 계획을 수립하는데 있어서 불확실성을 가중시키고 있다. 특히 일강수량 모의기법을 통해서 추정되는 빈도강수량의 과소추정으로 인해 수공구조물 설계 시에 신뢰성을 확보하는 데 문제점이 있다. 이러한 점에서 본 연구에서는 기존 Markov Chain 모형에서 일강수량에 평균적인 특성과 극치특성을 동시에 재현할 수 있도록 불연속 Kernel-Pareto Distribution 기반에 일강수량모의기법을 개발하였다. 한강유역의 3개 강수지점에 대해서 기존 Markov Chain 모형과 본 연구에서 제안한 방법을 적용한 결과 여름의 일강수량 모의 시 1차모멘트인 평균과 2-3차 모멘트 모두 효과적으로 재현하지 못하는 문제점이 나타났다. 그러나 본 연구에서 제안한 불연속 Kernel-Pareto 분포형 기반 Markov Chain 모형은 여름의 일강수량 모의 시 강수계열의 평균적인 특성뿐만 아니라 표준편차 및 왜곡도의 경우에도 관측치의 통계특성을 매우 효과적으로 재현하는 것으로 나타났다. 본 연구에서 제시한 방법론은 전체적으로 기존 Markov Chain 모형에 비해 극치강수량을 재현하는데 유리한 기법으로 판단되며, 또한 극치강수량을 일반강수량으로부터 분리하여 모의함으로서 평균 및 중간값 등 낮은 차수에 모멘트 등 일강수량에 전체적인 분포특성을 더욱 효과적으로 모의할 수 장점을 확인하였다.

  • PDF

마르코프 연쇄를 이용한 한국 프로야구 경기 분석 (Analysis of the Korean Baseball League using a Markov Chain Model)

  • 문형우;우용태;신양우
    • 응용통계연구
    • /
    • 제26권4호
    • /
    • pp.649-659
    • /
    • 2013
  • 본 논문에서는 마르코프 연쇄로 모형을 이용하여 한국프로야구의 경기결과를 예측하고 분석하였다. 타자의 타격결과와 주자상태를 나타내는 확률과정을 구체적으로 정의하여 경기진행 상황을 동적으로 반영한 프로야구 경기를 마르코프 연쇄를 구성하여 실제 데이터를 바탕으로 주자 상태를 고려한 진루행렬과 각 선수별 타격 확률을 구하여 경기당 득점 분포와 타석에 서는 타자 수의 분포를 구하였다.