• Title/Summary/Keyword: Markov Processes

Search Result 143, Processing Time 0.018 seconds

Semiparametric Bayesian multiple comparisons for Poisson Populations

  • Cho, Jang Sik;Kim, Dal Ho;Kang, Sang Gil
    • Communications for Statistical Applications and Methods
    • /
    • v.8 no.2
    • /
    • pp.427-434
    • /
    • 2001
  • In this paper, we consider the nonparametric Bayesian approach to the multiple comparisons problem for I Poisson populations using Dirichlet process priors. We describe Gibbs sampling algorithm for calculating posterior probabilities for the hypotheses and calculate posterior probabilities for the hypotheses using Markov chain Monte Carlo. Also we provide a numerical example to illustrate the developed numerical technique.

  • PDF

UNSLOTTED CSMA/CD PROTOCOL WITH THE THRESHOLD CONTROL POLICY

  • KYUNG HYUNE RHEE
    • Journal of applied mathematics & informatics
    • /
    • v.1 no.1
    • /
    • pp.1-12
    • /
    • 1994
  • We consider a single channel CSMA/CD system with D homogeneous stations and impeded buffer of infinite size. We find a sufficient condition for the model to be stable under the threshold control policy and derive the limiting distri-bution of the number of messages in the system at the moment of service completion. We also derive the limiting distributing of the number of messages in the system size at arbitrary time by using Markov regenerative processes. Some numerical examples and special cases are also treated.

STABILITY OF A CLASS OF $_p$TH-ORDER NONLINEAR AUTOREGRESSIVE PROCESSES

  • Lee, Chan-Ho
    • Bulletin of the Korean Mathematical Society
    • /
    • v.35 no.2
    • /
    • pp.227-234
    • /
    • 1998
  • Criteria are derived for the existence of a unique invariant oprobability distribution of a class of nonlinear pth-order autoregressive oprocesses, which reformulate those of Tweedie's. It will be shown that the criteria in this paper are easily applicable to the linear or piecewise linear case so that some of the earlier results are immediate consequences of our main results.

  • PDF

SOME NECESSARY CONDITIONS FOR ERGODICITY OF NONLINEAR FIRST ORDER AUTOREGRESSIVE MODELS

  • Lee, Chan-Ho
    • Journal of the Korean Mathematical Society
    • /
    • v.33 no.2
    • /
    • pp.227-234
    • /
    • 1996
  • Consider nonlinear autoregressive processes of order 1 defined by the random iteration $$ (1) X_{n + 1} = f(X_n) + \epsilon_{n + 1} (n \geq 0) $$ where f is real-valued Borel measurable functin on $R^1, {\epsilon_n : n \geq 1}$ is an i.i.d.sequence whose common distribution F has a non-zero absolutely continuous component with a positive density, $E$\mid$\epsilon_n$\mid$ < \infty$, and the initial $X_0$ is independent of ${\epsilon_n : n > \geq 1}$.

  • PDF

THE APPLICATION OF STOCHASTIC ANALYSIS TO COUNTABLE ALLELIC DIFFUSION MODEL

  • Choi, Won
    • Bulletin of the Korean Mathematical Society
    • /
    • v.41 no.2
    • /
    • pp.337-345
    • /
    • 2004
  • In allelic model X = ($\chi_1\chi$_2ㆍㆍㆍ, \chi_d$), M_f(t) = f(p(t)) - ${{\int^t}_0}\;Lf(p(t))ds$ is a P-martingale for diffusion operator L under the certain conditions. In this note, we can show existence and uniqueness of solution for stochastic differential equation and martingale problem associated with mean vector. Also, we examine that if the operator related to this martingale problem is connected with Markov processes under certain circumstance, then this operator must satisfy the maximum principle.

Analysis of MMPP/M/1 Queue with several homogeneous two-state MMPP sources (여러개의 two-state MMPP 입력을 갖는 대기체계에 대한 계산방법)

  • 이계민;안수한;전종우
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.24 no.9A
    • /
    • pp.1354-1358
    • /
    • 1999
  • In this paper, we suggest a simple computational algorithm to obtain the queue length distribution in the finite queue, where the input process consists of several homogeneous two-state Markov modulated Poisson processes. With comparison to the conventional algorithm, is more practical, in particular, when a large number of input sources are loaded to the system.

  • PDF

ON THE EXISTENCE OF A UNIQUE INVARIANT PROBABILITY FOR A CLASS OF MARKOV PROCESSES

  • Lee, Oesook
    • Bulletin of the Korean Mathematical Society
    • /
    • v.30 no.1
    • /
    • pp.91-97
    • /
    • 1993
  • In this article, we consider the case that S is a topologically complete subspace of $R^{k}$ , and that .GAMMA. is a set of monotone functions on S into S. It is obtained the sugficient condition for the existence of a unique invariant probability to which $P^{(n}$/(x,dy) converges exponentially fast in a metric stronger than the Kolmogorov's distance. This extends the earlier results of Bhattacharya and Lee (1988) who considered the case .GAMMA. a set of nondecreasing functions.tions.

  • PDF

Structural Aspects in the Theory of Random Walk

  • Heyer, H.
    • Journal of the Korean Statistical Society
    • /
    • v.11 no.2
    • /
    • pp.118-130
    • /
    • 1982
  • Random walks as specia Markov stochastic processes have received particular attention in recent years. Not only the applicability of the theory already developed but also its extension within the frame work of probability measures on algebraic-topological structures such as semigroups, groups and linear spaces became a new challenge for research work in the field. At the same time new insights into classical problems were obtained which in various cases lead to a more efficient presentation of the subject. Consequently the teaching of random walks at all levels should profit from the recent development.

  • PDF

Stereo Vision Neural Networks with Competition and Cooperation for Phoneme Recognition

  • Kim, Sung-Ill;Chung, Hyun-Yeol
    • The Journal of the Acoustical Society of Korea
    • /
    • v.22 no.1E
    • /
    • pp.3-10
    • /
    • 2003
  • This paper describes two kinds of neural networks for stereoscopic vision, which have been applied to an identification of human speech. In speech recognition based on the stereoscopic vision neural networks (SVNN), the similarities are first obtained by comparing input vocal signals with standard models. They are then given to a dynamic process in which both competitive and cooperative processes are conducted among neighboring similarities. Through the dynamic processes, only one winner neuron is finally detected. In a comparative study, with, the average phoneme recognition accuracy on the two-layered SVNN was 7.7% higher than the Hidden Markov Model (HMM) recognizer with the structure of a single mixture and three states, and the three-layered was 6.6% higher. Therefore, it was noticed that SVNN outperformed the existing HMM recognizer in phoneme recognition.

무작위 초 보유 자원을 이용한 신뢰성 모델

  • Kim, Songkyoo
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2001.10a
    • /
    • pp.199-202
    • /
    • 2001
  • This article deals with stochastic reliability systems that include a repair facility and unreliable machines: the main facility of working and an auxiliary facility of "super-reserve" machines. The number of super-reserve machines are random number with a arbitrarily distribution and working machines break down exponentially. Defective machines line up for repair, whose durations are arbitrarily distributed. Refurbished machines return to the main facility. If the main facility is restored to its original quantity, the repair facility leaves on routine maintenance until all of super-reserve machines are exhausted. Then, the busy period is regenerated. The whole system also falls into the category of closed queues, with more options than those of basic models. The techniques include two-variate Markov and semi-regenerative processes, and a duality principle, to find the probability distribution of the number of intact machines. Explicit formulas obtained demonstrate a relatively effortless use of functionals of the main stochastic characteristics (such as expenses due to repair, maintenance, waiting, and rewards for higher reliability) and optimization of their objective function. Applications include computer networking, human resources, and manufacturing processes.

  • PDF