• Title/Summary/Keyword: a Markov chain

Search Result 768, Processing Time 0.024 seconds

Analysis of Real-time Error for Remote Estimation Based on Binary Markov Chain Model (이진 마르코프 연쇄 모형 기반 실시간 원격 추정값의 오차 분석)

  • Lee, Yutae
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.26 no.2
    • /
    • pp.317-320
    • /
    • 2022
  • This paper studies real-time error in the context of monitoring a symmetric binary information source over a delay system. To obtain the average real-time error, the delay system is modeled and analyzed as a discrete time Markov chain with a finite state space. Numerical analysis is performed on various system parameters such as state transition probabilities of information source, transmission times, and transmission frequencies. Given state transition probabilities and transmission times, we investigate the relationship between the transmission frequency and the average real-time error. The results can be used to investigate the relationship between real-time errors and age of information.

Introduction to Subsurface Inversion Using Reversible Jump Markov-chain Monte Carlo (가역 도약 마르코프 연쇄 몬테 카를로 방법을 이용한 물성 역산 기술 소개)

  • Hyunggu, Jun;Yongchae, Cho
    • Geophysics and Geophysical Exploration
    • /
    • v.25 no.4
    • /
    • pp.252-265
    • /
    • 2022
  • Subsurface velocity is critical for the accurate resolution geological structures. The estimation of acoustic impedance is also critical, as it provides key information regarding the reservoir properties. Therefore, researchers have developed various inversion approaches for the estimation of reservoir properties. The Markov chain Monte Carlo method, which is a stochastic method, has advantages over the deterministic method, as the stochastic method enables us to attenuate the local minima problem and quantify the uncertainty of inversion results. Therefore, the Markov chain Monte Carlo inversion method has been applied to various kinds of geophysical inversion problems. However, studies on the Markov chain Monte Carlo inversion are still very few compared with deterministic approaches. In this study, we reviewed various types of reversible jump Markov chain Monte Carlo applications and explained the key concept of each application. Furthermore, we discussed future applications of the stochastic method.

Thermal Transfer Analysis of Micro Flow Sensor using by Markov Chain MCM (Markov 연쇄 MCM을 이용한 마이크로 흐름센서 열전달 해석)

  • Cha, Kyung-Hwan;Kim, Tae-Yong
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.12 no.12
    • /
    • pp.2253-2258
    • /
    • 2008
  • To design micro flow sensor varying depending on temperature of driving heater in the detector of Oxide semiconductor, Markov chain MCM(MCMCM), which is a kind of stochastic and microscopic method, was introduced. The formulation for the thermal transfer equation based on the FDM to obtain the MCMCM solution was performed and investigated, in steady state case. MCMCM simulation was successfully applied, so that its application can be expanded to a three-dimensional model with inhomogeneous material and complicated boundary.

A Study on Character Recognition using HMM and the Mason's Theorem

  • Lee Sang-kyu;Hur Jung-youn
    • Proceedings of the IEEK Conference
    • /
    • summer
    • /
    • pp.259-262
    • /
    • 2004
  • In most of the character recognition systems, the method of template matching or statistical method using hidden Markov model is used to extract and recognize feature shapes. In this paper, we used modified chain-code which has 8-directions but 4-codes, and made the chain-code of hand-written character, after that, converted it into transition chain-code by applying to HMM(Hidden Markov Model). The transition chain code by HMM is analyzed as signal flow graph by Mason's theory which is generally used to calculate forward gain at automatic control system. If the specific forward gain and feedback gain is properly set, the forward gain of transition chain-code using Mason's theory can be distinguished depending on each object for recognition. This data of the gain is reorganized as tree structure, hence making it possible to distinguish different hand-written characters. With this method, $91\%$ recognition rate was acquired.

  • PDF

Text Steganography Based on Ci-poetry Generation Using Markov Chain Model

  • Luo, Yubo;Huang, Yongfeng;Li, Fufang;Chang, Chinchen
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.9
    • /
    • pp.4568-4584
    • /
    • 2016
  • Steganography based on text generation has become a hot research topic in recent years. However, current text-generation methods which generate texts of normal style have either semantic or syntactic flaws. Note that texts of special genre, such as poem, have much simpler language model, less grammar rules, and lower demand for naturalness. Motivated by this observation, in this paper, we propose a text steganography that utilizes Markov chain model to generate Ci-poetry, a classic Chinese poem style. Since all Ci poems have fixed tone patterns, the generation process is to select proper words based on a chosen tone pattern. Markov chain model can obtain a state transfer matrix which simulates the language model of Ci-poetry by learning from a given corpus. To begin with an initial word, we can hide secret message when we use the state transfer matrix to choose a next word, and iterating until the end of the whole Ci poem. Extensive experiments are conducted and both machine and human evaluation results show that our method can generate Ci-poetry with higher naturalness than former researches and achieve competitive embedding rate.

A Development of Generalized Coupled Markov Chain Model for Stochastic Prediction on Two-Dimensional Space (수정 연쇄 말콥체인을 이용한 2차원 공간의 추계론적 예측기법의 개발)

  • Park Eun-Gyu
    • Journal of Soil and Groundwater Environment
    • /
    • v.10 no.5
    • /
    • pp.52-60
    • /
    • 2005
  • The conceptual model of under-sampled study area will include a great amount of uncertainty. In this study, we investigate the applicability of Markov chain model in a spatial domain as a tool for minimizing the uncertainty arose from the lack of data. A new formulation is developed to generalize the previous two-dimensional coupled Markov chain model, which has more versatility to fit any computational sequence. Furthermore, the computational algorithm is improved to utilize more conditioning information and reduce the artifacts, such as the artificial parcel inclination, caused by sequential computation. A generalized 20 coupled Markov chain (GCMC) is tested through applying a hypothetical soil map to evaluate the appropriateness as a substituting model for conventional geostatistical models. Comparing to sequential indicator model (SIS), the simulation results from GCMC shows lower entropy at the boundaries of indicators which is closer to real soil maps. For under-sampled indicators, however, GCMC under-estimates the presence of the indicators, which is a common aspect of all other geostatistical models. To improve this under-estimation, further study on data fusion (or assimilation) inclusion in the GCMC is required.

A Study on the Forecasting of the Number of End of Life Vehicles in Korea using Markov Chain (Markov Chain을 이용한 국내 폐차발생량 예측)

  • Lee, Eun-A;Choi, Hoe-Ryeon;Lee, Hong-Chul
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.38 no.3
    • /
    • pp.208-219
    • /
    • 2012
  • As the number of end-of-life vehicles (ELVs) has kept increasing, the management of ELV has also become one of the academic research focuses and European Union recently adopted the directive on ELVs. For the stakeholders has become a principle agent of dealing with all about ELVs, it is relevant investment decision to set up and to decide high-cost ELVs entity locations and to forecast future ELVs' amount in advance. In this paper, transition probability matrixes between months are made by using Markov Chain and the number of ELVs is predicted with them. This study will perform a great role as a fundamental material in Korea where just started having interests about recycling resources and studies related to the topic. Moreover, the forecasting method developed for this research can be adopted for other enhancements in different but comparable situations.

Numerical Analysis of Caching Performance in Content Centric Networks Using Markov Chain (마코프체인을 이용한 콘텐츠 중심 네트워크의 캐싱 성능 분석)

  • Yang, Won Seok
    • The Journal of the Korea Contents Association
    • /
    • v.16 no.4
    • /
    • pp.224-230
    • /
    • 2016
  • Recently, CCN(Content Centric Network) has been extensively interested in the literature to transfer data traffic efficiently according to the rapid growth of multimedia services on the Internet. CCN is a new networking paradigm to deliver contents efficiently based on the named content not the named or addressed host. This paper presents a mathematical approach for analyzing CCN-caching systems with two routers. Considering the stochastic characteristics of communication networks, the caching system is modeled as a two dimensional Markov chain. This paper analyzes the structural feature of the transition rate matrix in the Markov chain and presents a numerical solution for the CCN-caching performance of the two router system. In addition, various numerical examples are presented.

Prediction of Marine Accident Frequency Using Markov Chain Process (마코프 체인 프로세스를 적용한 해양사고 발생 예측)

  • Jang, Eun-Jin;Yim, Jeong-Bin
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2019.11a
    • /
    • pp.266-266
    • /
    • 2019
  • Marine accidents are increasing year by year, and various accidents occur such as engine failure, collision, stranding, and fire. These marine accidents present a risk of large casualties. It is important to prevent accidents beforehand. In this study, we propose a modeling to predict the occurrence of marine accidents by applying the Markov Chain Process that can predict the future based on past data. Applying the proposed modeling, the probability of future marine accidents was calculated and compared with the actual frequency. Through this, a probabilistic model was proposed to prepare a prediction system for marine accidents, and it is expected to contribute to predicting various marine accidents.

  • PDF