• Title/Summary/Keyword: Markov Analysis

Search Result 760, Processing Time 0.025 seconds

Markov Decision Process for Curling Strategies (MDP에 의한 컬링 전략 선정)

  • Bae, Kiwook;Park, Dong Hyun;Kim, Dong Hyun;Shin, Hayong
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.42 no.1
    • /
    • pp.65-72
    • /
    • 2016
  • Curling is compared to the Chess because of variety and importance of strategies. For winning the Curling game, selecting optimal strategies at decision making points are important. However, there is lack of research on optimal strategies for Curling. 'Aggressive' and 'Conservative' strategies are common strategies of Curling; nevertheless, even those two strategies have never been studied before. In this study, Markov Decision Process would be applied for Curling strategy analysis. Those two strategies are defined as actions of Markov Decision Process. By solving the model, the optimal strategy could be found at any in-game states.

Identification Method based on q-Markov (q-Markov Cover에 기초한 동정법)

  • Bae, Jong-Il;Lee, Dong-Cheol
    • Proceedings of the KIEE Conference
    • /
    • 2005.07d
    • /
    • pp.2522-2524
    • /
    • 2005
  • We need build a mathematical to apply the system theory to real system, phenomenon analysis, prediction, control, simulation and so on. Especially system identification is building a model from input and output data. This study shows q-Markov Cover based system identification. When we do this, in order to make the identification possible under more general conditions with estimation of the system order, Markov parameters and covariance parameters from input and douput data, 1 suggest the way we can get an optimal model by estimating and Identifying of covariance matrix of observation noises repeatedly.

  • PDF

Reliability Analysis of Multi-Component System Considering Preventive Maintenance: Application of Markov Chain Model (예방정비를 고려한 복수 부품 시스템의 신뢰성 분석: 마코프 체인 모형의 응용)

  • Kim, Hun Gil;Kim, Woo-Sung
    • Journal of Applied Reliability
    • /
    • v.16 no.4
    • /
    • pp.313-322
    • /
    • 2016
  • Purpose: We introduce ways to employ Markov chain model to evaluate the effect of preventive maintenance process. While the preventive maintenance process decreases the failure rate of each subsystems, it increases the downtime of the system because the system can not work during the maintenance process. The goal of this paper is to introduce ways to analyze this trade-off. Methods: Markov chain models are employed. We derive the availability of the system consisting of N repairable subsystems by the methods under various maintenance policies. Results: To validate our methods, we apply our models to the real maintenance data reports of military truck. The error between the model and the data was about 1%. Conclusion: The models developed in this paper fit real data well. These techniques can be applied to calculate the availability under various preventive maintenance policies.

Analysis of the Korean Baseball League using a Markov Chain Model (마르코프 연쇄를 이용한 한국 프로야구 경기 분석)

  • Moon, Hyung Woo;Woo, Yong Tae;Shin, Yang Woo
    • The Korean Journal of Applied Statistics
    • /
    • v.26 no.4
    • /
    • pp.649-659
    • /
    • 2013
  • We use a Markov chain model to analyze the Korean Baseball League. We derive the distributions of the number of runs scored and the number of batters that complete their turn at bat in a baseball game using the time inhomogeneous Markov chain. The model is tested with real data produced from the 2011 Korean Baseball League.

Reliability Evaluation of AGT Vehicle System Using Markov Chains (마코프 체인을 이용한 고무차륜 AGT 차량 시스템의 신뢰성 평가)

  • Ha Chen-Soo;Han Seok-Youn
    • Proceedings of the KSR Conference
    • /
    • 2004.10a
    • /
    • pp.539-544
    • /
    • 2004
  • In this paper, we present reliability modeling and analysis method of the Automated Guideway Transit(AGT) vehicle system using analytical models, based on Markov Chains. The Markov model can express state transition of the AGT vehicle sys. that is considered to be in one of four states, such as basic operating (0), minor delay(1), major delay(2) and non-operating(3) state. The proposed Markov model is illustrated with a numerical example and cases to find a steady state availability, MTBF(mean time between failures), and MTTR(mean time to repair) under specified failure and repair rate arc demonstrated.

  • PDF

A Hidden Markov Model Imbedding Multiword Units for Part-of-Speech Tagging

  • Kim, Jae-Hoon;Jungyun Seo
    • Journal of Electrical Engineering and information Science
    • /
    • v.2 no.6
    • /
    • pp.7-13
    • /
    • 1997
  • Morphological Analysis of Korean has known to be a very complicated problem. Especially, the degree of part-of-speech(POS) ambiguity is much higher than English. Many researchers have tried to use a hidden Markov model(HMM) to solve the POS tagging problem and showed arround 95% correctness ratio. However, the lack of lexical information involves a hidden Markov model for POS tagging in lots of difficulties in improving the performance. To alleviate the burden, this paper proposes a method for combining multiword units, which are types of lexical information, into a hidden Markov model for POS tagging. This paper also proposes a method for extracting multiword units from POS tagged corpus. In this paper, a multiword unit is defined as a unit which consists of more than one word. We found that these multiword units are the major source of POS tagging errors. Our experiment shows that the error reduction rate of the proposed method is about 13%.

  • PDF

Repair policies of failure detection equipments and system availability

  • Na, Seongryong;Bang, Sung-Hwan
    • Communications for Statistical Applications and Methods
    • /
    • v.29 no.2
    • /
    • pp.151-160
    • /
    • 2022
  • The total system is composed of the main system (MS) and the failure detection equipment (FDE) which detects failures of MS. The analysis of system reliability is performed when the failure of FDE is possible. Several repair policies are considered to determine the order of repair of failed systems, which are sequential repair (SQ), priority repair (PR), independent repair (ID), and simultaneous repair (SM). The states of MS-FDE systems are represented by Markov models according to repair policies and the main purpose of this paper is to derive the system availabilities of the Markov models. Analytical solutions of the stationary equations are derived for the Markov models and the system availabilities are immediately determined using the stationary solutions. A simple illustrative example is discussed for the comparison of availability values of the repair policies considered in this paper.

Daily Rainfall Simulation by Rainfall Frequency and State Model of Markov Chain (강우 빈도와 마코프 연쇄의 상태모형에 의한 일 강우량 모의)

  • Jung, Young-Hun;Kim, Buyng-Sik;Kim, Hung Soo;Shim, Myung-Pil
    • Journal of Wetlands Research
    • /
    • v.5 no.2
    • /
    • pp.1-13
    • /
    • 2003
  • In Korea, most of the rainfalls have been concentrated in the flood season and the flood study has received more attention than low flow analysis. One of the reasons that the analysis of low flows has less attention is the lacks of the required data like daily rainfall and so we have used the stochastic processes such as pulse noise, exponential distribution, and state model of Markov chain for the rainfall simulation in short term such as daily. Especially this study will pay attention to the state model of Markov chain. The previous study had performed the simulation study by the state model without considerations of the flood and non-flood periods and without consideration of the frequency of rainfall for the period of a state. Therefore this study considers afore mentioned two cases and compares the results with the known state model. As the results, the RMSEs of the suggested and known models represent the similar results. However, the PRE(relative percentage error) shows the suggested model is better results.

  • PDF

Anlaysis of Eukaryotic Sequence Pattern using GenScan (GenScan을 이용한 진핵생물의 서열 패턴 분석)

  • Jung, Yong-Gyu;Lim, I-Suel;Cha, Byung-Heun
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.11 no.4
    • /
    • pp.113-118
    • /
    • 2011
  • Sequence homology analysis in the substances in the phenomenon of life is to create database by sorting and indexing and to demonstrate the usefulness of informatics. In this paper, Markov models are used in GenScan program to convert the pattern of complex eukaryotic protein sequences. It becomes impossible to navigate the minimum distance, complexity increases exponentially as the exact calculation. It is used scorecard in amino acid substitutions between similar amino acid substitutions to have a differential effect score, and is applied the Markov models sophisticated concealment of the transition probability model. As providing superior method to translate sequences homologous sequences in analysis using blast p, Markov models. is secreted protein structure of sequence translations.

The Conformity Effect in Online Product Rating: The Pattern Recognition Approach

  • Kim, Hyung Jun;Kim, Songmi;Kim, Wonjoon
    • International Journal of Contents
    • /
    • v.13 no.4
    • /
    • pp.80-87
    • /
    • 2017
  • Since the advent of the Internet, and the development of smart devices, people have begun to spend more time in online platforms; this phenomenon has created a large number of online Words of Mouth (WOM) daily. Under these changes, one of the important aspects to consider is the conformity effect in online WOM; that is, whether an individual's own opinion would be influenced by the majority opinion of other people. This study, therefore, investigates whether there is the conformity effect in online product ratings for Amazon.com using the method called Markov Chain analysis. Markov Chain analysis considers the stochastic process that satisfies the Markov property, and we assume that the generation of online product ratings follows the process. Under the assumption that people are usually independent when they express their opinion in online platforms, we analyze the interdependency among rating sequences, and we find weak evidence that there exists the conformity effect in online product rating. This suggests that people who leave online product ratings consider others' opinions.