• Title/Summary/Keyword: Posterior probability

Search Result 224, Processing Time 0.022 seconds

A Novel Posterior Probability Estimation Method for Multi-label Naive Bayes Classification

  • Kim, Hae-Cheon;Lee, Jaesung
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.6
    • /
    • pp.1-7
    • /
    • 2018
  • A multi-label classification is to find multiple labels associated with the input pattern. Multi-label classification can be achieved by extending conventional single-label classification. Common extension techniques are known as Binary relevance, Label powerset, and Classifier chains. However, most of the extended multi-label naive bayes classifier has not been able to accurately estimate posterior probabilities because it does not reflect the label dependency. And the remaining extended multi-label naive bayes classifier has a problem that it is unstable to estimate posterior probability according to the label selection order. To estimate posterior probability well, we propose a new posterior probability estimation method that reflects the probability between all labels and labels efficiently. The proposed method reflects the correlation between labels. And we have confirmed through experiments that the extended multi-label naive bayes classifier using the proposed method has higher accuracy then the existing multi-label naive bayes classifiers.

Verification and estimation of a posterior probability and probability density function using vector quantization and neural network (신경회로망과 벡터양자화에 의한 사후확률과 확률 밀도함수 추정 및 검증)

  • 고희석;김현덕;이광석
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.45 no.2
    • /
    • pp.325-328
    • /
    • 1996
  • In this paper, we proposed an estimation method of a posterior probability and PDF(Probability density function) using a feed forward neural network and code books of VQ(vector quantization). In this study, We estimates a posterior probability and probability density function, which compose a new parameter with well-known Mel cepstrum and verificate the performance for the five vowels taking from syllables by NN(neural network) and PNN(probabilistic neural network). In case of new parameter, showed the best result by probabilistic neural network and recognition rates are average 83.02%.

  • PDF

A Study on Noninformative Priors of Intraclass Correlation Coefficients in Familial Data

  • Jin, Bong-Soo;Kim, Byung-Hwee
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.2
    • /
    • pp.395-411
    • /
    • 2005
  • In this paper, we develop the Jeffreys' prior, reference prior and the the probability matching priors for the difference of intraclass correlation coefficients in familial data. e prove the sufficient condition for propriety of posterior distributions. Using marginal posterior distributions under those noninformative priors, we compare posterior quantiles and frequentist coverage probability.

Reference Priors in a Two-Way Mixed-Effects Analysis of Variance Model

  • Chang, In-Hong;Kim, Byung-Hwee
    • Journal of the Korean Data and Information Science Society
    • /
    • v.13 no.2
    • /
    • pp.317-328
    • /
    • 2002
  • We first derive group ordering reference priors in a two-way mixed-effects analysis of variance (ANOVA) model. We show that posterior distributions are proper and provide marginal posterior distributions under reference priors. We also examine whether the reference priors satisfy the probability matching criterion. Finally, the reference prior satisfying the probability matching criterion is shown to be good in the sense of frequentist coverage probability of the posterior quantile.

  • PDF

Clustering Algorithm for Data Mining using Posterior Probability-based Information Entropy (데이터마이닝을 위한 사후확률 정보엔트로피 기반 군집화알고리즘)

  • Park, In-Kyoo
    • Journal of Digital Convergence
    • /
    • v.12 no.12
    • /
    • pp.293-301
    • /
    • 2014
  • In this paper, we propose a new measure based on the confidence of Bayesian posterior probability so as to reduce unimportant information in the clustering process. Because the performance of clustering is up to selecting the important degree of attributes within the databases, the concept of information entropy is added to posterior probability for attributes discernibility. Hence, The same value of attributes in the confidence of the proposed measure is considerably much less due to the natural logarithm. Therefore posterior probability-based clustering algorithm selects the minimum of attribute reducts and improves the efficiency of clustering. Analysis of the validation of the proposed algorithms compared with others shows their discernibility as well as ability of clustering to handle uncertainty with ACME categorical data.

Improvement of location positioning using KNN, Local Map Classification and Bayes Filter for indoor location recognition system

  • Oh, Seung-Hoon;Maeng, Ju-Hyun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.6
    • /
    • pp.29-35
    • /
    • 2021
  • In this paper, we propose a method that combines KNN(K-Nearest Neighbor), Local Map Classification and Bayes Filter as a way to increase the accuracy of location positioning. First, in this technique, Local Map Classification divides the actual map into several clusters, and then classifies the clusters by KNN. And posterior probability is calculated through the probability of each cluster acquired by Bayes Filter. With this posterior probability, the cluster where the robot is located is searched. For performance evaluation, the results of location positioning obtained by applying KNN, Local Map Classification, and Bayes Filter were analyzed. As a result of the analysis, it was confirmed that even if the RSSI signal changes, the location information is fixed to one cluster, and the accuracy of location positioning increases.

A Study on Structural Change in the Multivariate Regression Model (다원회귀(多元回歸) MODEL에 있어서 구조변화(構造變化)에 관한 연구(硏究))

  • Jo, Am
    • Journal of Korean Society for Quality Management
    • /
    • v.13 no.1
    • /
    • pp.20-25
    • /
    • 1985
  • There are several approaches for dealing with the structural change in regression model, but by introducing a concept of Spline, the structural change can be expressed more clearly. This makes it possible not only to know the location where the structural change happens and the total number, but also to derive posterior distribution from anterior-posterior distribution when the probability of the judgement anterior for entire combination was given to each model, by which, the model that has the highest posterior probability is the method which realizes the structural change. The purpose of this study is to find a peculiarity of the posterior probability on the occasion of anterior information acquired and of not acquired with Baysian approach.

  • PDF

Estimation of Geometric Mean for k Exponential Parameters Using a Probability Matching Prior

  • Kim, Hea-Jung;Kim, Dae Hwang
    • Communications for Statistical Applications and Methods
    • /
    • v.10 no.1
    • /
    • pp.1-9
    • /
    • 2003
  • In this article, we consider a Bayesian estimation method for the geometric mean of $textsc{k}$ exponential parameters, Using the Tibshirani's orthogonal parameterization, we suggest an invariant prior distribution of the $textsc{k}$ parameters. It is seen that the prior, probability matching prior, is better than the uniform prior in the sense of correct frequentist coverage probability of the posterior quantile. Then a weighted Monte Carlo method is developed to approximate the posterior distribution of the mean. The method is easily implemented and provides posterior mean and HPD(Highest Posterior Density) interval for the geometric mean. A simulation study is given to illustrates the efficiency of the method.

Posterior density estimation for structural parameters using improved differential evolution adaptive Metropolis algorithm

  • Zhou, Jin;Mita, Akira;Mei, Liu
    • Smart Structures and Systems
    • /
    • v.15 no.3
    • /
    • pp.735-749
    • /
    • 2015
  • The major difficulty of using Bayesian probabilistic inference for system identification is to obtain the posterior probability density of parameters conditioned by the measured response. The posterior density of structural parameters indicates how plausible each model is when considering the uncertainty of prediction errors. The Markov chain Monte Carlo (MCMC) method is a widespread medium for posterior inference but its convergence is often slow. The differential evolution adaptive Metropolis-Hasting (DREAM) algorithm boasts a population-based mechanism, which nms multiple different Markov chains simultaneously, and a global optimum exploration ability. This paper proposes an improved differential evolution adaptive Metropolis-Hasting algorithm (IDREAM) strategy to estimate the posterior density of structural parameters. The main benefit of IDREAM is its efficient MCMC simulation through its use of the adaptive Metropolis (AM) method with a mutation strategy for ensuring quick convergence and robust solutions. Its effectiveness was demonstrated in simulations on identifying the structural parameters with limited output data and noise polluted measurements.

A Study on Analysis of Likelihood Principle and its Educational Implications (우도원리에 대한 분석과 그에 따른 교육적 시사점에 대한 연구)

  • Park, Sun Yong;Yoon, Hyoung Seok
    • The Mathematical Education
    • /
    • v.55 no.2
    • /
    • pp.193-208
    • /
    • 2016
  • This study analyzes the likelihood principle and elicits an educational implication. As a result of analysis, this study shows that Frequentist and Bayesian interpret the principle differently by assigning different role to that principle from each other. While frequentist regards the principle as 'the principle forming a basis for statistical inference using the likelihood ratio' through considering the likelihood as a direct tool for statistical inference, Bayesian looks upon the principle as 'the principle providing a basis for statistical inference using the posterior probability' by looking at the likelihood as a means for updating. Despite this distinction between two methods of statistical inference, two statistics schools get clues to compromise in a regard of using frequency prior probability. According to this result, this study suggests the statistics education that is a help to building of students' critical eye by their comparing inferences based on likelihood and posterior probability in the learning and teaching of updating process from frequency prior probability to posterior probability.