• Proceedings of the Korea Multimedia Society Conference
• /
• 2001.06a
• /
• pp.533-536
• /
• 2001

CRM에서 고객에 대한 10g등의 고객 정보를 통해 효율적인 서비스의 필요성이 강조되고 있다. 기존의 서비스는 대상 고객의 관심도와 성향 분석을 통한 것이라기 보다는 무조건적으로 제공되는 구체이고 체계적인 지식이 결여된 상태이므로 고개의 요구에 정확한 정보의 제공이 어려웠다. 그러므로, 본 논문에서는 고객이 원하는 정보를 정확하게 제공하기 위해 고객이 필요한 정보를 자동적으로 수집, 분류할 수 있는 마코브 모델을 통해서 통계와 분석을 수행하여 고객 정보의 분류와 획득에 의한 정보 서비스를 제공하고자 한다.

• Proceedings of the Korean Information Science Society Conference
• /
• 2004.04a
• /
• pp.502-504
• /
• 2004

이동성이 중요시되는 네트워크에서 특정 프로토콜의 성능 평가를 위해서는 노드의 이동패턴을 정확하게 표현할 수 있는 Mobility Model이 필요하다. 노드의 연속적인 이동패턴을 필요로 하는 Mobile Ad-hoc 네트워크를 위해선 Markov process 기반의 Gauss-Markov Mobility Model이 적절하다. 그러나 맵의 엣지 부근에서 노드 이동의 부적절한 처리로 인해, 기존의 Gauss-Markov Model은 편중된 이동 패턴을 야기한다. 본 논문은 엣지 부근의 평균 이동각도를 랜덤하게 조정함으로써 기존의 모델이 가진 문제를 해결하고, 시뮬레이션을 통해서 이를 검증한다.

• Nuclear Engineering and Technology
• /
• v.25 no.1
• /
• pp.154-165
• /
• 1993

A stochastic method using continuous time Markov process is presented to model the one-dimensional convective nuclide transport in geologic media, which have usually heterogeneous feature in physical/geochemical parameters such as velocity, dispersion coefficient, and retardation factor resulting poor description by conventional deterministic advection-dispersion model. The primary desired quantities from a stochastic model are the mean values and variance of the state variables as a function of time. The time-dependent probability distributions of nuclides are presented for each discretized compartment given the volumetric groundwater flux and the intensity of transition. Since this model is discrete in medium space, physical/geochemical parameters which affect nuclide transport can be easily incorporated for the heterogeneous media as well as remarkably layered media having spatially varied parameters. Even though the Markov process model developed in this study was shown to be sensitive to the number of discretized compartments showing numerical dispersion as the number of compartments are increased, this could be easily calibrated by comparing with the analytical deterministic model.

• The Journal of the Acoustical Society of Korea
• /
• v.27 no.3
• /
• pp.119-128
• /
• 2008

This paper analyzes the relationship between two representative statistical methods for bandwidth extension (BWE): Gaussian Mixture Model (GMM) and Hidden Markov Model (HMM) ones, and compares their performances. The HMM method is a memory-based system which was developed to take advantage of the inter-frame dependency of speech signals. Therefore, it could be expected to estimate better the transitional information of the original spectra from frame to frame. To verify it, a dynamic measure that is an approximation of the 1st-order derivative of spectral function over time was introduced in addition to a static measure. The comparison result shows that the two methods are similar in the static measure, while, in the dynamic measure, the HMM method outperforms explicitly the GMM one. Moreover, this difference increases in proportion to the number of states of HMM model. This indicates that the HMM method would be more appropriate at least for the 'blind BWE' problem. On the other hand, nevertheless, the GMM method could be treated as a preferable alternative of the HMM one in some applications where the static performance and algorithm complexity are critical.

• Proceedings of the Korea Inteligent Information System Society Conference
• /
• 2007.11a
• /
• pp.294-302
• /
• 2007

멀티 에이전트 강화학습에서 중요한 이슈 중의 하나는 자신의 성능에 영향을 미칠 수 있는 다른 에이전트들이 존재하는 동적 환경에서 어떻게 최적의 행동 정책을 학습하느냐 하는 것이다. 멀티 에이전트 강화 학습을 위한 기존 연구들은 대부분 단일 에이전트 강화 학습기법들을 큰 변화 없이 그대로 적용하거나 비록 다른 에이전트에 관한 별도의 모델을 이용하더라도 현실적이지 못한 가정들을 요구한다. 본 논문에서는 상대 에이전트에 대한RBFN기반의 행동 정책 모델을 소개한 뒤, 이것을 이용한 강화 학습 방법을 설명한다. 본 논문에서는 제안하는 멀티 에이전트 강화학습 방법은 기존의 멀티 에이전트 강화 학습 연구들과는 달리 상대 에이전트의 Q 평가 함수 모델이 아니라 RBFN 기반의 행동 정책 모델을 학습한다. 또한, 표현력은 풍부하나 학습에 시간과 노력이 많이 요구되는 유한 상태 오토마타나 마코프 체인과 같은 행동 정책 모델들에 비해 비교적 간단한 형태의 행동 정책 모델을 이용함으로써 학습의 효율성을 높였다. 본 논문에서는 대표적이 절대적 멀티 에이전트 환경인 고양이와 쥐 게임을 소개한 뒤, 이 게임을 테스트 베드 삼아 실험들을 전개함으로써 제안하는 RBFN 기반의 정책 모델의 효과를 분석해본다.

• Journal of KIISE:Computing Practices and Letters
• /
• v.15 no.7
• /
• pp.500-504
• /
• 2009

A reliability of software is a type of nonfunctional requirement. Traditionally, a validation of the reliability is processed at the integration phase in software development life cycle. However, it increases the cost and the risk for the development. In this paper, we propose reliability analysis method based on mathematical analytic model at the architecture design phase of the development process as follows. First, we propose the software modeling methodology for reliability analysis using Hierarchical combined Queueing Petri Nets(HQPN). Second, we derive the Markov Reward Model from the HQPN based model. We apply our approach to the video conference system to verify the usefulness of our approach. Our approach supports quantitative evaluation of the reliability.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.44 no.1
• /
• pp.40-48
• /
• 2007

This paper presents a novel texture segmentation method using multilayer perceptron (MLP) networks and Markov random fields in multiscale Bayesian framework. Multiscale wavelet coefficients are used as input for the neural networks. The output of the neural network is modeled as a posterior probability. Texture classification at each scale is performed by the posterior probabilities from MLP networks and MAP (maximum a posterior) classification. Then, in order to obtain the more improved segmentation result at the finest scale, our proposed method fuses the multiscale MAP classifications sequentially from coarse to fine scales. This process is done by computing the MAP classification given the classification at one scale and a priori knowledge regarding contextual information which is extracted from the adjacent coarser scale classification. In this fusion process, the MRF (Markov random field) prior distribution and Gibbs sampler are used, where the MRF model serves as the smoothness constraint and the Gibbs sampler acts as the MAP classifier. The proposed segmentation method shows better performance than texture segmentation using the HMT (Hidden Markov trees) model and HMTseg.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.40 no.10
• /
• pp.895-900
• /
• 2016

Remaining useful life (RUL) estimation of the Li-ion battery has gained great interest because it is necessary for quality assurance, operation planning, and determination of the exchange period. This paper presents the RUL estimation of an Li-ion battery for an energy storage system using exponential function for the degradation model and Markov Chain Monte Carlo (MCMC) approach for parameter estimation. The MCMC approach is dependent upon information such as model initial parameters and input setting parameters which highly affect the estimation result. To overcome this difficulty, this paper offers a guideline for model initial parameters based on the regression result, and MCMC input parameters derived by comparisons with a thorough search of theoretical results.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.54 no.1
• /
• pp.121-128
• /
• 2017

In this paper, we propose a dual-channel acoustic event detection (AED) method using nonnegative tensor factorization (NTF) and hidden Markov model (HMM) in order to improve detection accuracy of AED in multisource environments. The proposed method first detects multiple acoustic events by utilizing channel gains obtained from the NTF technique applied to dual-channel input signals. After that, an HMM-based likelihood ratio test is carried out to verify the detected events by using channel gains. The detection accuracy of the proposed method is measured by F-measures under 9 different multisource conditions. Then, it is also compared with those of conventional AED methods such as Gaussian mixture model and nonnegative matrix factorization. It is shown from the experiments that the proposed method outperforms the convectional methods under all the multisource conditions.

• The Journal of the Acoustical Society of Korea
• /
• v.21 no.1
• /
• pp.11-18
• /
• 2002

In this paper, a gain-adapted speech recognition method in noise is developed in the time domain. Noise is assumed to be colored. To cope with the notable nonstationary nature of speech signals such as fricative, glides, liquids, and transition region between phones, the nonstationary autoregressive (NAR) hidden Markov model (HMM) is used. The nonstationary AR process is represented by using polynomial functions with a linear combination of M known basis functions. When only noisy signals are available, the estimation problem of noise inevitably arises. By using multiple Kalman filters, the estimation of noise model and gain contour of speech is performed. Noise estimation of the proposed method can eliminate noise from noisy speech to get an enhanced speech signal. Compared to the conventional ARHMM with noise estimation, our proposed NAR-HMM with noise estimation improves the recognition performance about 2-3%.