• Title/Summary/Keyword: Markov process model

Search Result 371, Processing Time 0.025 seconds

Reliability Analysis of Multi-Component System Considering Preventive Maintenance: Application of Markov Chain Model (예방정비를 고려한 복수 부품 시스템의 신뢰성 분석: 마코프 체인 모형의 응용)

  • Kim, Hun Gil;Kim, Woo-Sung
    • Journal of Applied Reliability
    • /
    • v.16 no.4
    • /
    • pp.313-322
    • /
    • 2016
  • Purpose: We introduce ways to employ Markov chain model to evaluate the effect of preventive maintenance process. While the preventive maintenance process decreases the failure rate of each subsystems, it increases the downtime of the system because the system can not work during the maintenance process. The goal of this paper is to introduce ways to analyze this trade-off. Methods: Markov chain models are employed. We derive the availability of the system consisting of N repairable subsystems by the methods under various maintenance policies. Results: To validate our methods, we apply our models to the real maintenance data reports of military truck. The error between the model and the data was about 1%. Conclusion: The models developed in this paper fit real data well. These techniques can be applied to calculate the availability under various preventive maintenance policies.

On The Mathematical Structure of Markov Process and Markovian Sequential Decision Process (Markov 과정(過程)의 수리적(數理的) 구조(構造)와 그 축차결정과정(逐次決定過程))

  • Kim, Yu-Song
    • Journal of Korean Society for Quality Management
    • /
    • v.11 no.2
    • /
    • pp.2-9
    • /
    • 1983
  • As will be seen, this paper is tries that the research on the mathematical structure of Markov process and Markovian sequential decision process (the policy improvement iteration method,) moreover, that it analyze the logic and the characteristic of behavior of mathematical model of Markov process. Therefore firstly, it classify, on research of mathematical structure of Markov process, the forward equation and backward equation of Chapman-kolmogorov equation and of kolmogorov differential equation, and then have survey on logic of equation systems or on the question of uniqueness and existence of solution of the equation. Secondly, it classify, at the Markovian sequential decision process, the case of discrete time parameter and the continuous time parameter, and then it explore the logic system of characteristic of the behavior, the value determination operation and the policy improvement routine.

  • PDF

Performance Evaluation of the WiMAX Network Based on Combining the 2D Markov Chain and MMPP Traffic Model

  • Saha, Tonmoy;Shufean, Md. Abu;Alam, Mahbubul;Islam, Md. Imdadul
    • Journal of Information Processing Systems
    • /
    • v.7 no.4
    • /
    • pp.653-678
    • /
    • 2011
  • WiMAX is intended for fourth generation wireless mobile communications where a group of users are provided with a connection and a fixed length queue. In present literature traffic of such network is analyzed based on the generator matrix of the Markov Arrival Process (MAP). In this paper a simple analytical technique of the two dimensional Markov chain is used to obtain the trajectory of the congestion of the network as a function of a traffic parameter. Finally, a two state phase dependent arrival process is considered to evaluate probability states. The entire analysis is kept independent of modulation and coding schemes.

Decision-Tree-Based Markov Model for Phrase Break Prediction

  • Kim, Sang-Hun;Oh, Seung-Shin
    • ETRI Journal
    • /
    • v.29 no.4
    • /
    • pp.527-529
    • /
    • 2007
  • In this paper, a decision-tree-based Markov model for phrase break prediction is proposed. The model takes advantage of the non-homogeneous-features-based classification ability of decision tree and temporal break sequence modeling based on the Markov process. For this experiment, a text corpus tagged with parts-of-speech and three break strength levels is prepared and evaluated. The complex feature set, textual conditions, and prior knowledge are utilized; and chunking rules are applied to the search results. The proposed model shows an error reduction rate of about 11.6% compared to the conventional classification model.

  • PDF

Development of Stochastic Markov Process Model for Maintenance of Armor Units of Rubble-Mound Breakwaters (경사제 피복재의 유지관리를 위한 추계학적 Markov 확률모형의 개발)

  • Lee, Cheol-Eung
    • Journal of Korean Society of Coastal and Ocean Engineers
    • /
    • v.25 no.2
    • /
    • pp.52-62
    • /
    • 2013
  • A stochastic Markov process (MP) model has been developed for evaluating the probability of failure of the armor unit of rubble-mound breakwaters as a function of time. The mathematical MP model could have been formulated by combining the counting process or renewal process (CP/RP) on the load occurrences with the damage process (DP) on the cumulative damage events, and applied to the armor units of rubble-mound breakwaters. Transition probabilities have been estimated by Monte-Carlo simulation (MCS) technique with the definition of damage level of armor units, and very well satisfies some conditions constrained in the probabilistic and physical views. The probabilities of failure have been also compared and investigated in process of time which have been calculated according to the variations of return period and safety factor being the important variables related to design of armor units of rubble-mound breakwater. In particular, it can be quantitatively found how the prior damage levels can effect on the sequent probabilities of failure. Finally, two types of methodology have been in this study proposed to evaluate straightforwardly the repair times which are indispensable to the maintenance of armor units of rubble-mound breakwaters and shown several simulation results including the cost analyses.

Network Security Situation Assessment Method Based on Markov Game Model

  • Li, Xi;Lu, Yu;Liu, Sen;Nie, Wei
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.5
    • /
    • pp.2414-2428
    • /
    • 2018
  • In order to solve the problem that the current network security situation assessment methods just focus on the attack behaviors, this paper proposes a kind of network security situation assessment method based on Markov Decision Process and Game theory. The method takes the Markov Game model as the core, and uses the 4 levels data fusion to realize the evaluation of the network security situation. In this process, the Nash equilibrium point of the game is used to determine the impact on the network security. Experiments show that the results of this method are basically consistent with the expert evaluation data. As the method takes full account of the interaction between the attackers and defenders, it is closer to reality, and can accurately assess network security situation.

A Dynamic Rain Attenuation Model for Adaptive Satellite Communication Systems (적응형 위성통신 시스템 설계를 위한 동적 강우 감쇠 모델)

  • Zhang, Meixiang;Kim, Soo-Young;Pack, Jeong-Ki
    • Journal of Satellite, Information and Communications
    • /
    • v.6 no.1
    • /
    • pp.12-18
    • /
    • 2011
  • Signal fading due to rain is one of the most significant factors degrading link quality in satellite communication systems. Adaptive transmission is considered to be the most efficient means to countermeasure the rain attenuation. In order to develop and design a good adaptive transmission system, we need a dynamic rain attenuation model which can synthesize time series of rain attenuation. In this paper, we present a modeling technique for dynamic rain attenuation using a Markov process. We derive statistical fading properties of the rain attenuation data measured in second time interval and define four states in the Markov process. We synthesize the rain attenuation data using the 4-state Markov process, and compare statistical properties of the simulated data to those of the measured data.

Scheduling of Preventive Maintenance for Generating Unit Considering Condition of System (시스템의 상태를 고려한 발전설비의 예방 유지보수 계획 수립)

  • Shin, Jun-Seok;Byeon, Yoong-Tae;Kim, Jin-O;Kim, Hyung-Chul
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.57 no.8
    • /
    • pp.1305-1310
    • /
    • 2008
  • Traditional maintenance planning is based on a constant maintenance interval for equipment life. In order to consider economic aspect for time based preventive maintenance, preventive maintenance is desirable to be scheduled by RCM(Reliability-Centered Maintenance) evaluation. The main objective of RCM is to reduce the maintenance cost, by focusing on the most important functions of the system and avoiding or removing maintenance actions that are not strictly necessary. So, Markov state model is utilized considering stochastic state in RCM. In this paper, a Markov state model which can be used for scheduling and optimization of maintenance is presented. The deterioration process of system condition is modeled by the stepwise Markov model in detail. Also, because the system is not continuously monitored, the inspection is considered. In case study, simulation results about RCM will be shown using the real historical data of combustion turbine generating unit in Korean power systems.

Application Markov State Model for the RCM of Combustion turbine Generating Unit (Markov State Model을 이용한 복합화력 발전설비의 최적의 유지보수계획 수립)

  • Shin, Jun-Seok;Lee, Seung-Hyuk;Kim, Jin-O
    • Proceedings of the KIEE Conference
    • /
    • 2006.11a
    • /
    • pp.357-359
    • /
    • 2006
  • Traditional time based preventive maintenance is used to constant maintenance interval for equipment life. In order to consider economic aspect for time based preventive maintenance, preventive maintenance is scheduled by RCM(Reliability-Centered Maintenance) evaluation. So, Markov state model is utilized considering stochastic state in RCM. In this paper, a Markov state model which can be used for scheduling and optimization of maintenance is presented. The deterioration process of system condition is modeled by a Markov model. In case study, simulation results about RCM are used to the real historical data of combustion turbine generating units in Korean power systems.

  • PDF