• 제목/요약/키워드: Posterior inference

검색결과 90건 처리시간 0.02초

Derivation of the Fisher Information Matrix for 4-Parameter Generalized Gamma Distribution Using Mathematica

  • Park, Tae Ryong
    • 통합자연과학논문집
    • /
    • 제7권2호
    • /
    • pp.138-144
    • /
    • 2014
  • Fisher information matrix plays an important role in statistical inference of unknown parameters. Especially, it is used in objective Bayesian inference where we calculate the posterior distribution using a noninformative prior distribution, and also in an example of metric functions in geometry. To estimate parameters in a distribution, we can use the Fisher information matrix. The more the number of parameters increases, the more its matrix form gets complicated. In this paper, by using Mathematica programs we derive the Fisher information matrix for 4-parameter generalized gamma distribution which is used in reliability theory.

음이항분포 정보를 가진 베이지안 소프트웨어 신뢰도 성장모형에 관한 연구 (Bayesian Analysis of Software Reliability Growth Model with Negative Binomial Information)

  • 김희철;박종구;이병수
    • 한국정보처리학회논문지
    • /
    • 제7권3호
    • /
    • pp.852-861
    • /
    • 2000
  • Software reliability growth models are used in testing stages of software development to model the error content and time intervals betwewn software failures. In this paper, using priors for the number of fault with the negative binomial distribution nd the error rate with gamma distribution, Bayesian inference and model selection method for Jelinski-Moranda and Goel-Okumoto and Schick-Wolverton models in software reliability. For model selection, we explored the sum of the relative error, Braun statistic and median variation. In Bayesian computation process, we could avoid the multiple integration by the use of Gibbs sampling, which is a kind of Markov Chain Monte Carolo method to compute the posterior distribution. Using simulated data, Bayesian inference and model selection is studied.

  • PDF

VS3-NET: Neural variational inference model for machine-reading comprehension

  • Park, Cheoneum;Lee, Changki;Song, Heejun
    • ETRI Journal
    • /
    • 제41권6호
    • /
    • pp.771-781
    • /
    • 2019
  • We propose the VS3-NET model to solve the task of question answering questions with machine-reading comprehension that searches for an appropriate answer in a given context. VS3-NET is a model that trains latent variables for each question using variational inferences based on a model of a simple recurrent unit-based sentences and self-matching networks. The types of questions vary, and the answers depend on the type of question. To perform efficient inference and learning, we introduce neural question-type models to approximate the prior and posterior distributions of the latent variables, and we use these approximated distributions to optimize a reparameterized variational lower bound. The context given in machine-reading comprehension usually comprises several sentences, leading to performance degradation caused by context length. Therefore, we model a hierarchical structure using sentence encoding, in which as the context becomes longer, the performance degrades. Experimental results show that the proposed VS3-NET model has an exact-match score of 76.8% and an F1 score of 84.5% on the SQuAD test set.

간편 간접추론 방식의 퍼지논리에 의한 확장 칼만필터의 성능 향상 (Performance Improvement of an Extended Kalman Filter Using Simplified Indirect Inference Method Fuzzy Logic)

  • 채창현
    • 한국기계가공학회지
    • /
    • 제15권2호
    • /
    • pp.131-138
    • /
    • 2016
  • In order to improve the performance of an extended Kalman filter, a simplified indirect inference method (SIIM) fuzzy logic system (FLS) is proposed. The proposed FLS is composed of two fuzzy input variables, four fuzzy rules and one fuzzy output. Two normalized fuzzy input variables are the variance between the trace of a prior and a posterior covariance matrix, and the residual error of a Kalman algorithm. One fuzzy output variable is the weighting factor to adjust for the Kalman gain. There is no need to decide the number and the membership function of input variables, because we employ the normalized monotone increasing/decreasing function. The single parameter to be determined is the magnitude of a universe of discourse in the output variable. The structure of the proposed FLS is simple and easy to apply to various nonlinear state estimation problems. The simulation results show that the proposed FLS has strong adaptability to estimate the states of the incoming/outgoing moving objects, and outperforms the conventional extended Kalman filter algorithm by providing solutions that are more accurate.

휴대폰에서의 경량 상황추론을 위한 모듈형 베이지안 네트워크의 선택적 추론 (Selective Inference in Modular Bayesian Networks for Lightweight Context Inference in Cell Phones)

  • 이승현;임성수;조성배
    • 한국정보과학회논문지:소프트웨어및응용
    • /
    • 제37권10호
    • /
    • pp.736-744
    • /
    • 2010
  • 모바일 기기에서 얻을 수 있는 로그 데이터는 다수의 유의미한 정보를 담고 있다. 그러나 모바일 기기의 연산능력 제약과 정보 분석 자체의 어려움 등으로 상황정보를 활용한 모바일 에이전트의 구현이 쉽지 않다. 본 논문에서는 제한적인 모바일 플랫폼에서 효율적인 상황인지를 위한 베이지안 네트워크 용용 기법을 제안한다. 베이지안 네트워크는 다수의 세부 모듈로 구성되며, 모듈간 인과성은 가상증거를 통해 보존된다. 각 모듈은 이전 증거값과 추론결과를 저장하고, 현재 증거값과 비교하여 전체 네트워크에 변화를 주는 경우에만 선택적으로 추론을 수행한다. 다양한 수집 주기의 모바일 데이터를 이용한 추론결과의 신뢰성을 높이기 위해 기억감소함수를 이용하여 결과를 보정하는 방법을 살펴본다. 마지막으로 실제 모바일 환경에서의 실험을 통해 제안하는 방법의 유용성을 확인한다.

Bayesian Inferences for Software Reliability Models Based on Beta-Mixture Mean Value Functions

  • Nam, Seung-Min;Kim, Ki-Woong;Cho, Sin-Sup;Yeo, In-Kwon
    • 응용통계연구
    • /
    • 제21권5호
    • /
    • pp.835-843
    • /
    • 2008
  • In this paper, we investigate a Bayesian inference for software reliability models based on mean value functions which take the form of the mixture of beta distribution functions. The posterior simulation via the Markov chain Monte Carlo approach is used to produce estimates of posterior properties. Its applicability is illustrated with two real data sets. We compute the predictive distribution and the marginal likelihood of various models to compare the performance of them. The model comparison results show that the model based on the beta-mixture performs better than other models.

Bayesian inference in finite population sampling under measurement error model

  • Goo, You Mee;Kim, Dal Ho
    • Journal of the Korean Data and Information Science Society
    • /
    • 제23권6호
    • /
    • pp.1241-1247
    • /
    • 2012
  • The paper considers empirical Bayes (EB) and hierarchical Bayes (HB) predictors of the finite population mean under a linear regression model with measurement errors We discuss how to calculate the mean squared prediction errors of the EB predictors using jackknife methods and the posterior standard deviations of the HB predictors based on the Markov Chain Monte Carlo methods. A simulation study is provided to illustrate the results of the preceding sections and compare the performances of the proposed procedures.

Bayesian Analysis for Heat Effects on Mortality

  • Jo, Young-In;Lim, Youn-Hee;Kim, Ho;Lee, Jae-Yong
    • Communications for Statistical Applications and Methods
    • /
    • 제19권5호
    • /
    • pp.705-720
    • /
    • 2012
  • In this paper, we introduce a hierarchical Bayesian model to simultaneously estimate the thresholds of each 6 cities. It was noted in the literature there was a dramatic increases in the number of deaths if the mean temperature passes a certain value (that we call a threshold). We estimate the difference of mortality before and after the threshold. For the hierarchical Bayesian analysis, some proper prior distribution of parameters and hyper-parameters are assumed. By combining the Gibbs and Metropolis-Hastings algorithm, we constructed a Markov chain Monte Carlo algorithm and the posterior inference was based on the posterior sample. The analysis shows that the estimates of the threshold are located at $25^{\circ}C{\sim}29^{\circ}C$ and the mortality around the threshold changes from -1% to 2~13%.

Generative probabilistic model with Dirichlet prior distribution for similarity analysis of research topic

  • Milyahilu, John;Kim, Jong Nam
    • 한국멀티미디어학회논문지
    • /
    • 제23권4호
    • /
    • pp.595-602
    • /
    • 2020
  • We propose a generative probabilistic model with Dirichlet prior distribution for topic modeling and text similarity analysis. It assigns a topic and calculates text correlation between documents within a corpus. It also provides posterior probabilities that are assigned to each topic of a document based on the prior distribution in the corpus. We then present a Gibbs sampling algorithm for inference about the posterior distribution and compute text correlation among 50 abstracts from the papers published by IEEE. We also conduct a supervised learning to set a benchmark that justifies the performance of the LDA (Latent Dirichlet Allocation). The experiments show that the accuracy for topic assignment to a certain document is 76% for LDA. The results for supervised learning show the accuracy of 61%, the precision of 93% and the f1-score of 96%. A discussion for experimental results indicates a thorough justification based on probabilities, distributions, evaluation metrics and correlation coefficients with respect to topic assignment.

베타-이항 분포에서 Gibbs sampler를 이용한 평가 일치도의 사후 분포 추정 (Posterior density estimation of Kappa via Gibbs sampler in the beta-binomial model)

  • 엄종석;최일수;안윤기
    • 응용통계연구
    • /
    • 제7권2호
    • /
    • pp.9-19
    • /
    • 1994
  • 평가자간 평가 일치도(measure of agreement)를 나타내는 모수 $\kappa$와 양성 반응 비율 $\mu$를 지닌 베타-이항 분포 모형은 심리학 분야에서 많이 다루어지는 모형이다. 이 모형에서 $\kappa$에 대한 추정은 $\mu$가 0에 가까운 값을 가질 때 우도함수를 이용한 전통적 추론 방법의 적용이 어렵다. 본 논문에서는 이러한 문제를 Gibbs sampler를 이용한 Bayesian 분석 방법을 적용시켜 주변 사후 밀도 함수를 추정하였으며 이를 이용하여 Bayesian 추정값도 구하였다.

  • PDF