Communications for Statistical Applications and Methods

  • 제16권3호
  • /
  • Pages.479-485
  • /
  • 2009
  • /
  • 2287-7843(pISSN)
  • /
  • 2383-4757(eISSN)
한국통계학회 (The Korean Statistical Society)
권호 표지
DOI QR코드

DOI QR Code

Efficiency and Robustness of Fully Adaptive Simulated Maximum Likelihood Method

  • Oh, Man-Suk (Department of Statistics, Ewha Womans University) ;
  • Kim, Dai-Gyoung (Department of Applied Mathematics, Hanyang University)
  • 발행 : 2009.05.31
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

When a part of data is unobserved the marginal likelihood of parameters given the observed data often involves analytically intractable high dimensional integral and hence it is hard to find the maximum likelihood estimate of the parameters. Simulated maximum likelihood(SML) method which estimates the marginal likelihood via Monte Carlo importance sampling and optimize the estimated marginal likelihood has been used in many applications. A key issue in SML is to find a good proposal density from which Monte Carlo samples are generated. The optimal proposal density is the conditional density of the unobserved data given the parameters and the observed data, and attempts have been given to find a good approximation to the optimal proposal density. Algorithms which adaptively improve the proposal density have been widely used due to its simplicity and efficiency. In this paper, we describe a fully adaptive algorithm which has been used by some practitioners but has not been well recognized in statistical literature, and evaluate its estimation performance and robustness via a simulation study. The simulation study shows a great improvement in the order of magnitudes in the mean squared error, compared to non-adaptive or partially adaptive SML methods. Also, it is shown that the fully adaptive SML is robust in a sense that it is insensitive to the starting points in the optimization routine.

키워드

참고문헌

  1. Brinch, C. N. (2008). Simulated maximum likelihood using tilted importance sampling, Statistics Norway, Research Department, Discussion papers No. 540
  2. Crepon, B. and Duguet, E. (1997). Research and development, competition and innovation pseudo-maximum likelihood and simulated maximum likelihood methods applied to count data models with heterogeneity, Journal of Econometrics, 79, 355-378 https://doi.org/10.1016/S0304-4076(97)00027-4
  3. Danielsson, J. (1994). Stochastic volatility in asset prices estimation with simulated maximum likeli-hood, Journal of Econometrics, 64, 375-400 https://doi.org/10.1016/0304-4076(94)90070-1
  4. Durbin, J. and Koopman, S. J. (1997). Monte Carlo maximum likelihood estimation for non-Gaussian state space models, Biometrika, 84, 669-684 https://doi.org/10.1093/biomet/84.3.669
  5. Durbin, J. and Koopman, S. J. (2000). Time series analysis of non-Gaussian observations based on state space models from both classical and Bayesian perspectives, Journal of the Royal Statistical Society, Series B, 62, 3-56 https://doi.org/10.1111/1467-9868.00218
  6. Hurn, A. S., Lindsay, K. A. and Martin, V. L. (2003). On the efficacy of simulated maximum like-lihood for estimating the parameters of stochastic differential equations, Journal of Time Series Analysis, 24, 45-63 https://doi.org/10.1111/1467-9892.00292
  7. IMSL (1989). User's Manual, IMSL, Houston, Texas
  8. Jank, W. (2006). Efficient simulated maximum likelihood with an application to online retailing, Satistics and Computing, 16, 111-124 https://doi.org/10.1007/s11222-006-6890-9
  9. Jank, W. and Booth, J. (2003). Efficiency of Monte Carlo EM and simulated maximum likelihood in two-stage hierarchical models, Journal of Computational and Graphical Statistics, 12, 214-229 https://doi.org/10.1198/1061860031338
  10. Kao, C., Lee, L. F. and Pitt, M. M. (2001). Simulated maximum likelihood estimation of the linear expenditure system with binding non-negativity constraints, Annals of Economics and Finance, 2, 203-223
  11. Lee, L. F. (1995). Asymptotic bias in simulated maximum likelihood estimation of discrete choice models, Econometric Theory, 11, 437-483 https://doi.org/10.1017/S0266466600009361
  12. Lee, L. F. (1997). Simulated maximum likelihood estimation of dynamic discrete choice statistical models some Monte Carlo results, Journal of Econometrics, 82, 1-35 https://doi.org/10.1016/S0304-4076(97)00014-6
  13. McCulloch, C. E. (1997). Maximum likelihood algorithms for generalized linear mixed models, Journal of the American Statistical Association, 92, 162-170 https://doi.org/10.2307/2291460
  14. Munkin, M. K. and Trivedi, P. K. (1999). Simulated maximum likelihood estimation of multivariate mixed-Poisson regression models, with application, Econometrics Journal, 2, 29-48 https://doi.org/10.1111/1368-423X.00019
  15. Oh, M. S. and Berger, J. O. (1992). Adaptive importance sampling in monte carlo integration, Journal of Statistical Computation and Simulation, 41, 143-168 https://doi.org/10.1080/00949659208810398
  16. Richard, J. F. and Zhang, W. (2007). Efficient high-dimensional importance sampling, Journal of Econometrics, 141, 1385-1411 https://doi.org/10.1016/j.jeconom.2007.02.007
  17. Stern, S. (1997). Simulation-based estimation, Journal of Econometric Literature, 35, 2006-2039
  18. Zhang, P. (1996). Nonparametric importance sampling, Journal of the American Statistical Association, 91, 1245-1253 https://doi.org/10.2307/2291743