• Title/Summary/Keyword: Likelihood Inference

Search Result 158, Processing Time 0.02 seconds

Recent advances in Bayesian inference of isolation-with-migration models

  • Chung, Yujin
    • Genomics & Informatics
    • /
    • v.17 no.4
    • /
    • pp.37.1-37.8
    • /
    • 2019
  • Isolation-with-migration (IM) models have become popular for explaining population divergence in the presence of migrations. Bayesian methods are commonly used to estimate IM models, but they are limited to small data analysis or simple model inference. Recently three methods, IMa3, MIST, and AIM, resolved these limitations. Here, we describe the major problems addressed by these three software and compare differences among their inference methods, despite their use of the same standard likelihood function.

Test of Local Restriction on a Multinomial Parameter

  • Oh, Myongsik
    • Communications for Statistical Applications and Methods
    • /
    • v.10 no.2
    • /
    • pp.525-534
    • /
    • 2003
  • If a restriction is imposed only to a (proper) subset of parameters of interest, we call it a local restriction. Statistical inference under a local restriction in multinomial setting is studied. The maximum likelihood estimation under a local restriction and likelihood ratio tests for and against a local restriction are discussed. A real data is analyzed for illustrative purpose.

Second-Order REML for Random Effects Models

  • Ha, Il-Do;Cho, Geon-Ho
    • Journal of the Korean Data and Information Science Society
    • /
    • v.12 no.1
    • /
    • pp.19-25
    • /
    • 2001
  • Random effects models which describe the dependence via random effects in various correlated data have recently received considerable attention in the biomedical literature. They include mixed linear models (MLMs), generatized linear mixed models (GLMMS) and hierarchical generalized linear models (HGLMs). For the inference Lee and Nelder (2000) proposed the first-and second-order REML (restricted maximum likelihood) methods based on hierarchical-likelihood of tee and Welder (1996). In this paper, for Poisson-gamma HGLMs the new methods are theoretically compared with marginal likelihood methods and both methods are illustrated by two practical examples.

  • PDF

Envelope empirical likelihood ratio for the difference of two location parameters with constraints of symmetry

  • Kim, Kyoung-Mi;Zhou, Mai
    • 한국데이터정보과학회:학술대회논문집
    • /
    • 2002.06a
    • /
    • pp.51-73
    • /
    • 2002
  • Empirical likelihood ratio method is a new technique in nonparametric inference developed by A. Owen (1988, 2001). Sometimes empirical likelihood has difficulties to define itself. As such a case in point, we discuss the way to define a modified empirical likelihood for the location of symmetry using well-known points of symmetry as a side conditions. The side condition of symmetry is defined through a finite subset of the infinite set of constraints. The modified empirical likelihood under symmetry studied in this paper is to construct a constrained parameter space $\theta+$ of distributions imposing known symmetry as side information. We show that the usual asymptotic theory (Wilks theorem) still hold for the empirical likelihood ratio on the constrained parameter space and the asymptotic distribution of the empirical NPMLE of difference of two symmetric points is obtained.

  • PDF

Restricted maximum likelihood estimation of a censored random effects panel regression model

  • Lee, Minah;Lee, Seung-Chun
    • Communications for Statistical Applications and Methods
    • /
    • v.26 no.4
    • /
    • pp.371-383
    • /
    • 2019
  • Panel data sets have been developed in various areas, and many recent studies have analyzed panel, or longitudinal data sets. Maximum likelihood (ML) may be the most common statistical method for analyzing panel data models; however, the inference based on the ML estimate will have an inflated Type I error because the ML method tends to give a downwardly biased estimate of variance components when the sample size is small. The under estimation could be severe when data is incomplete. This paper proposes the restricted maximum likelihood (REML) method for a random effects panel data model with a censored dependent variable. Note that the likelihood function of the model is complex in that it includes a multidimensional integral. Many authors proposed to use integral approximation methods for the computation of likelihood function; however, it is well known that integral approximation methods are inadequate for high dimensional integrals in practice. This paper introduces to use the moments of truncated multivariate normal random vector for the calculation of multidimensional integral. In addition, a proper asymptotic standard error of REML estimate is given.

Variational Expectation-Maximization Algorithm in Posterior Distribution of a Latent Dirichlet Allocation Model for Research Topic Analysis

  • Kim, Jong Nam
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.7
    • /
    • pp.883-890
    • /
    • 2020
  • In this paper, we propose a variational expectation-maximization algorithm that computes posterior probabilities from Latent Dirichlet Allocation (LDA) model. The algorithm approximates the intractable posterior distribution of a document term matrix generated from a corpus made up by 50 papers. It approximates the posterior by searching the local optima using lower bound of the true posterior distribution. Moreover, it maximizes the lower bound of the log-likelihood of the true posterior by minimizing the relative entropy of the prior and the posterior distribution known as KL-Divergence. The experimental results indicate that documents clustered to image classification and segmentation are correlated at 0.79 while those clustered to object detection and image segmentation are highly correlated at 0.96. The proposed variational inference algorithm performs efficiently and faster than Gibbs sampling at a computational time of 0.029s.

Noninformative Priors for Fieller-Creasy Problem using Unbalanced Data

  • Kim, Dal-Ho;Lee, Woo-Dong;Kang, Sang-Gil
    • 한국데이터정보과학회:학술대회논문집
    • /
    • 2005.10a
    • /
    • pp.71-84
    • /
    • 2005
  • The Fieller-Creasy problem involves statistical inference about the ratio of two independent normal means. It is difficult problem from either a frequentist or a likelihood perspective. As an alternatives, a Bayesian analysis with noninformative priors may provide a solution to this problem. In this paper, we extend the results of Yin and Ghosh (2001) to unbalanced sample case. We find various noninformative priors such as first and second order matching priors, reference and Jeffreys' priors. The posterior propriety under the proposed noninformative priors will be given. Using real data, we provide illustrative examples. Through simulation study, we compute the frequentist coverage probabilities for probability matching and reference priors. Some simulation results will be given.

  • PDF

Inference Based on Generalized Doubly Type-II Hybrid Censored Sample from a Half Logistic Distribution

  • Lee, Kyeong-Jun;Park, Chan-Keun;Cho, Young-Seuk
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.5
    • /
    • pp.645-655
    • /
    • 2011
  • Chandrasekar et al. (2004) introduced a generalized Type-II hybrid censoring. In this paper, we propose generalized doubly Type-II hybrid censoring. In addition, this paper presents the statistical inference on the scale parameter for the half logistic distribution when samples are generalized doubly Type-II hybrid censoring. The approximate maximum likelihood(AMLE) method is developed to estimate the unknown parameter. The scale parameter is estimated by the AMLE method using two di erent Taylor series expansion types. We compar the AMLEs in the sense of the mean square error(MSE). The simulation procedure is repeated 10,000 times for the sample size n = 20; 30; 40 and various censored samples. The $AMLE_I$ is better than $AMLE_{II}$ in the sense of the MSE.

Objective Bayesian inference based on upper record values from Rayleigh distribution

  • Seo, Jung In;Kim, Yongku
    • Communications for Statistical Applications and Methods
    • /
    • v.25 no.4
    • /
    • pp.411-430
    • /
    • 2018
  • The Bayesian approach is a suitable alternative in constructing appropriate models for observed record values because the number of these values is small. This paper provides an objective Bayesian analysis method for upper record values arising from the Rayleigh distribution. For the objective Bayesian analysis, the Fisher information matrix for unknown parameters is derived in terms of the second derivative of the log-likelihood function by using Leibniz's rule; subsequently, objective priors are provided, resulting in proper posterior distributions. We examine if these priors are the PMPs. In a simulation study, inference results under the provided priors are compared through Monte Carlo simulations. Through real data analysis, we reveal a limitation of the appropriate confidence interval based on the maximum likelihood estimator for the scale parameter and evaluate the models under the provided priors.

Design-based and model-based Inferences in Survey Sampling (표본조사에서 설계기반추론과 모형기반추론)

  • Kim Kyu-Seong
    • The Korean Journal of Applied Statistics
    • /
    • v.18 no.3
    • /
    • pp.673-687
    • /
    • 2005
  • We investigate both the design-based and model-based inferences, which are usual inferential methods in survey sampling. While the design-based inference is on the basis of randomization principle, The motel-based inference is based on likelihood principle as well as conditionality principle. There have been some disputes between two inferences for a long time and those have not yet been determined. In this paper we reviewed some issues on two inferences and compared their advantages and disadvantages in some viewpoints.