• Journal of the Korean Operations Research and Management Science Society
• /
• v.32 no.1
• /
• pp.147-160
• /
• 2007

In this paper, the optimal decision making strategy for resource management is viewed in terms of a combined strategy of planting and producing time. A model which can be used to determine the optimal management strategy is developed, and focuses on how to design the operation of a Markov chain so as to optimize its performance. This study estimated a dynamic stochastic model to compare alternative production style and used the net present value of returns to evaluate the scenarios. The managers in this study may be able to increase economic returns by delaying produce in order to market larder, more valuable commodities.

• Proceedings of the Korean Reliability Society Conference
• /
• 2000.04a
• /
• pp.213-222
• /
• 2000

In present study, a stochastic model is developed for the low cycle fatigue life prediction and reliability assessment of 316L stainless steel under variable multiaxial loading. In the proposed model, fatigue phenomenon is considered as a Markov process, and damage vector and reliability are defined on every plane. Any low cycle fatigue damage evaluating method can be included in the proposed model. The model enables calculation of statistical reliability and crack initiation direction under variable multiaxial loading, which are generally not available. In present study, a critical plane method proposed by Kandil et al., maximum tensile strain range, and von Mises equivalent strain range are used to calculate fatigue damage. When the critical plane method is chosen, the effect of multiple critical planes is also included in the proposed model. Maximum tensile strain and von Mises strain methods are used for the demonstration of the generality of the proposed model. The material properties and the stochastic model parameters are obtained from uniaxial tests only. The stochastic model made of the parameters obtained from the uniaxial tests is applied to the life prediction and reliability assessment of 316L stainless steel under variable multiaxial loading. The predicted results show good accordance with experimental results.

• Transactions on Control, Automation and Systems Engineering
• /
• v.2 no.1
• /
• pp.40-46
• /
• 2000

In this paper, a transient identification based on a Hidden Markov Model (HMM) has been suggested and evaluated experimentally for the classification of transients in the dynamic process. The transient can be identified by its unique time dependent patterns related to the principal variables. The HMM, a double stochastic process, can be applied to transient identification which is a spatial and temporal classification problem under a statistical pattern recognition framework. The HMM is created for each transient from a set of training data by the maximum-likelihood estimation method. The transient identification is determined by calculating which model has the highest probability for the given test data. Several experimental tests have been performed with normalization methods, clustering algorithms, and a number of states in HMM. Several experimental tests have been performed including superimposing random noise, adding systematic error, and untrained transients. The proposed real-time transient identification system has many advantages, however, there are still a lot of problems that should be solved to apply to a real dynamic process. Further efforts are being made to improve the system performance and robustness to demonstrate reliability and accuracy to the required level.

• Journal of the Korean Data and Information Science Society
• /
• v.26 no.4
• /
• pp.813-826
• /
• 2015

This research deals with an estimation method for kinetic reaction model. The kinetic reaction model is a model to explain spread or changing process based on interaction between species on the Biochemical area. This model can be applied to a model for disease spreading as well as a model for system Biology. In the search, we assumed that the spread of species is stochastic and we construct the reaction model based on stochastic movement. We utilized Gillespie algorithm in order to construct likelihood function. We introduced a Bayesian estimation method using Markov chain Monte Carlo methods that produces more stable results. We applied the Bayesian estimation method to the Lotka-Volterra model and gene transcription model and had more stable estimation results.

• Journal of Korean Society on Water Environment
• /
• v.36 no.5
• /
• pp.353-363
• /
• 2020

Hydrologic models can be classified into two types: those for understanding physical processes and those for predicting hydrologic quantities. This study deals with how to use the model to predict today's stream flow based on the system's knowledge of yesterday's state and the model parameters. In this regard, for the model to generate accurate predictions, the uncertainty of the parameters and appropriate estimates of the state variables are required. In this study, a relatively simple hydrologic partitioning model is proposed that can explicitly implement the hydrologic partitioning process, and the posterior distribution of the parameters of the proposed model is estimated using the Markov chain Monte Carlo approach. Further, the application method of the ensemble Kalman filter is proposed for updating the normalized soil moisture, which is the state variable of the model, by linking the information on the posterior distribution of the parameters and by assimilating the observed steam flow data. The stochastically and recursively estimated stream flows using the data assimilation technique revealed better representation of the observed data than the stream flows predicted using the deterministic model. Therefore, the ensemble Kalman filter in conjunction with the Markov chain Monte Carlo approach could be a reliable and effective method for forecasting daily stream flow, and it could also be a suitable method for routinely updating and monitoring the watershed-averaged soil moisture.

• IE interfaces
• /
• v.12 no.2
• /
• pp.312-318
• /
• 1999

This paper considers the cell loss probability(CLP) in a multiplexer with the superposition of heterogeneous ON/OFF sources. The input traffic is composed of k classes. Traffic of class i is the superposition of M_(i) ON/OFF sources. Recently, the method based on the Markov modulated deterministic process(MMDP) is presented. Basically, it is the discretized model of stochastic fluid flow process(SFFP) and gives the CLP very fast, but under-estimates the CLP especially when the value of estimated CLP is very low. This paper develops the discretized model of Markov modulated Poisson process(MMPP). It is a special type of switched batch Bernoulli process(SBBP). Combining the transition probability matrix of MMDP and SBBP according to the state which is characterized by the arrival rate, this paper presents hybrid algorithm. The hybrid algorithm gives better estimate of CLP than that of MMDP and faster than SBBP.

• Proceedings of the Korean Institute of IIIuminating and Electrical Installation Engineers Conference
• /
• 2007.05a
• /
• pp.328-333
• /
• 2007

Traditional maintenance planning is based on a constant maintenance interval for equipment life. In order to consider economic aspect for tm based preventive maintenance, preventive maintenance is desirable to be scheduled by RCM(Reliability-Centered Maintenance) evaluation. The main objective of RCM is to reduce the maintenance cost, by focusing on the most important functions of the system and avoiding or removing maintenance actions that are not strictly necessary. So, Markov state model is utilized considering stochastic state in RCM In this paper, a Markov state model much can be used for scheduling and optimization of maintenance is presented. The deterioration process of system condition is modeled by the stepwise Markov model in detail. Also, because the system is not continuously monitored, the inspection is considered. In case study, simulation results about RCM will be shown using the real historical data of combustion turbine generating unit in Korean power systems.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.1B
• /
• pp.50-58
• /
• 2012

The objective of this study is to develop the theoretical model of the telecommunication system service availability from the user perspective. We assume non-homogeneous Poisson process for the call arrival process and continuous time Markov chain for the system state. The proposed model effectively describes the user model of the user-perceived service reliability by including the time-varying call arrival rate. We also include the operational failure state where the user cannot receive any service even though the system is functioning.

• Nuclear Engineering and Technology
• /
• v.25 no.4
• /
• pp.539-547
• /
• 1993

A stochastic approach using continuous time Markov process is presented to model the one-dimensional nuclide transport in fractured rock media as a further extension for previous works［1-3］. Nuclide transport of decay chain of arbitrary length in the single planar fractured rock media in the vicinity of the radioactive waste repository is modeled using a continuous time Markov process. While most of analytical solutions for nuclide transport of decay chain deal with the limited length of decay chain, do not consider the case of having rock matrix diffusion, and have very complicated solution form, the present model offers rather a simplified solution in the form of expectance and its variance resulted from a stochastic modeling. As another deterministic way, even numerical models of decay chain transport, in most cases, show very complicated procedure to get the solution and large discrepancy for the exact solution as opposed to the stochastic model developed in this study. To demonstrate the use of the present model and to verify the model by comparing with the deterministic model, a specific illustration was made for the transport of a chain of three member in single fractured rock medium with constant groundwater flow rate in the fracture, which ignores the rock matrix diffusion and shows good capability to model the fractured media around the repository.

• Proceedings of the KIEE Conference
• /
• 2006.10c
• /
• pp.181-183
• /
• 2006

This paper proposes an intelligent decision framework for update of the environment model using GSPN(generalized stochastic petri nets). The GSPN has several advantages over direct use of the Markov Process. The modeling, analysis, and performance evaluation are conducted on the mathematical basis. By adopting the probabilistic approach, our decision framework helps the robot to decide the time to update the map. The robot navigates autonomously for a long time in dynamic environments. Experimental results show that the proposed scheme is useful for service robots which work semi-permanently and improves dependability of navigation in dynamic environments.