A Bayesian Variable Selection Method for Binary Response Probit Regression

  • Published : 1999.06.01

Abstract

This article is concerned with the selection of subsets of predictor variables to be included in building the binary response probit regression model. It is based on a Bayesian approach, intended to propose and develop a procedure that uses probabilistic considerations for selecting promising subsets. This procedure reformulates the probit regression setup in a hierarchical normal mixture model by introducing a set of hyperparameters that will be used to identify subset choices. The appropriate posterior probability of each subset of predictor variables is obtained through the Gibbs sampler, which samples indirectly from the multinomial posterior distribution on the set of possible subset choices. Thus, in this procedure, the most promising subset of predictors can be identified as the one with highest posterior probability. To highlight the merit of this procedure a couple of illustrative numerical examples are given.

Keywords

References

  1. Journal of the American Statististical Association v.88 Bayesian analysis of binary and polychotomous response data Albert, J. H.;Chib, S.
  2. Bayesian theory Bernardo, J. M.;Smith, A. F. M.
  3. Annals of Institute of Statistical Mathematics v.43 Bayaesian image restoration, with two applications in spatial statistics Besag, J. E.;York, J.;Mollie
  4. CODA; Convergence diagnosis and output analysis software for Gibbs sampling output version 0.30 Best, N.;Cowles, M. K.;Vines, K.
  5. American Statistician v.46 Explaining the Gibbs sampler Casella, G.;George, E. I.
  6. Journal of the American Statististical Association v.90 Marginal likelihood from the Gibbs output Chib, S.
  7. Modelling binary data Collett, D.
  8. Journal of the American Statististical Association v.91 Markov chain Monte Carlo convergence diagnostics: a comparative review Cowles, M. K.;Carlin, B. P.
  9. Non-uniform random generation Devroye, L.
  10. Statistical Science v.7 Inference from iterative simulation using multiple sequences (with discussion) Gelman, A.;Rubin, D. B.
  11. Journal of the American Statististical Association v.88 Variable selection via Gibbs sampling George, E. I.;McCulloch, R. E.
  12. Journal of the American Statististical Association v.83 Bayesian variable selection in linear regression (with discussion) Mitchell, T. J.;Beauchamp, J. J.
  13. Generalized linear models Nelder, J. A.;McCullagh, P.
  14. Journal of the Royal Statistical Society, B v.55 Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods Smith, A. F. M.;Roberts, G. O.
  15. An Introduction to Bayaesian Inference in Econometrics Zellner, A.
  16. Bayesian Inference and Decision Techniques On assessing prior distributions and Bayesian Regression Analysis with g prior distributions Zellner, A.;P. Goel(ed.);A. Zellner(ed.)