• 제목/요약/키워드: strong Markov property

Search Result 3, Processing Time 0.016 seconds

Sensitivity of Conditions for Lumping Finite Markov Chains

  • Suh, Moon-Taek
    • Journal of the military operations research society of Korea
    • /
    • v.11 no.1
    • /
    • pp.111-129
    • /
    • 1985
  • Markov chains with large transition probability matrices occur in many applications such as manpowr models. Under certain conditions the state space of a stationary discrete parameter finite Markov chain may be partitioned into subsets, each of which may be treated as a single state of a smaller chain that retains the Markov property. Such a chain is said to be 'lumpable' and the resulting lumped chain is a special case of more general functions of Markov chains. There are several reasons why one might wish to lump. First, there may be analytical benefits, including relative simplicity of the reduced model and development of a new model which inherits known or assumed strong properties of the original model (the Markov property). Second, there may be statistical benefits, such as increased robustness of the smaller chain as well as improved estimates of transition probabilities. Finally, the identification of lumps may provide new insights about the process under investigation.

  • PDF

A SHARP BOUND FOR ITO PROCESSES

  • Choi, Chang-Sun
    • Journal of the Korean Mathematical Society
    • /
    • v.35 no.3
    • /
    • pp.713-725
    • /
    • 1998
  • Let X and Y be Ito processes with dX$_{s}$ = $\phi$$_{s}$dB$_{s}$$\psi$$_{s}$ds and dY$_{s}$ = (equation omitted)dB$_{s}$ + ξ$_{s}$ds. Burkholder obtained a sharp bound on the distribution of the maximal function of Y under the assumption that │Y$_{0}$$\leq$│X$_{0}$│,│ζ│$\leq$$\phi$│, │ξ│$\leq$$\psi$│ and that X is a nonnegative local submartingale. In this paper we consider a wider class of Ito processes, replace the assumption │ξ│$\leq$$\psi$│ by a more general one │ξ│$\leq$$\alpha$$\psi$│ , where a $\geq$ 0 is a constant, and get a weak-type inequality between X and the maximal function of Y. This inequality, being sharp for all a $\geq$ 0, extends the work by Burkholder.der.urkholder.der.

  • PDF

FIRST PASSAGE PROBLEM FOR WIENER PATHS CROSSING DIFFERENTIABLE CURVES

  • Jang, Yu-Seon;Kim, Sung-Lai;Kim, Sung-Kyun
    • Journal of applied mathematics & informatics
    • /
    • v.19 no.1_2
    • /
    • pp.475-484
    • /
    • 2005
  • Let W(t) be a Wiener path, let $\xi\;:\;[0,\;{\infty})\;\to\;\mathbb{R}$ be a continuous and increasing function satisfying $\xi$(0) > 0, let $$T_{/xi}=inf\{t{\geq}0\;:\;W(t){\geq}\xi(t)\}$$ be the first-passage time of W over $\xi$, and let F denote the distribution function of $T_{\xi}$. Then the first passage problem has a unique continuous solution as following $$F(t)=u(t)+{\sum_{n=1}^\infty}\int_0^t\;H_n(t,s)u(s)ds$$, where $$u(t)=2\Psi(\xi(t)/\sqrt{t})\;and\;H_1(t,s)=d\Phi\;(\{\xi(t)-\xi(s)\}/\sqrt{t-s})/ds\;for\;0\;{\leq}\;s.