Communications for Statistical Applications and Methods

The Korean Statistical Society (한국통계학회)
권호 표지
DOI QR코드

DOI QR Code

Bayesian hierarchical model for the estimation of proper receiver operating characteristic curves using stochastic ordering

  • Jang, Eun Jin (Department of Information Statistics, Andong National University) ;
  • Kim, Dal Ho (Department of Statistics, Kyungpook National University)
  • Received : 2018.11.23
  • Accepted : 2019.02.07
  • Published : 2019.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

Diagnostic tests in medical fields detect or diagnose a disease with results measured by continuous or discrete ordinal data. The performance of a diagnostic test is summarized using the receiver operating characteristic (ROC) curve and the area under the curve (AUC). The diagnostic test is considered clinically useful if the outcomes in actually-positive cases are higher than actually-negative cases and the ROC curve is concave. In this study, we apply the stochastic ordering method in a Bayesian hierarchical model to estimate the proper ROC curve and AUC when the diagnostic test results are measured in discrete ordinal data. We compare the conventional binormal model and binormal model under stochastic ordering. The simulation results and real data analysis for breast cancer indicate that the binormal model under stochastic ordering can be used to estimate the proper ROC curve with a small bias even though the sample sizes were small or the sample size of actually-negative cases varied from actually-positive cases. Therefore, it is appropriate to consider the binormal model under stochastic ordering in the presence of large differences for a sample size between actually-negative and actually-positive groups.

Keywords

References

  1. Guo B, and Gur D (2017). Estimating the area under ROC curve when the fitted binormal curves demonstrate improper shape, Academic Radiology, 24, 209-219. https://doi.org/10.1016/j.acra.2016.09.020
  2. Bhattacharya B and Nandram B (1996). Bayesian inference for multinomial population under stochastic ordering, Journal of Statistical Computation and Simulation, 54, 145-163. https://doi.org/10.1080/00949659608811725
  3. Dorfman DD and Alf E (1969). Maximum likelihood estimation of parameters of signal detection theory and determination of confidence intervals: rating method data, Journal of Mathematical Psychology, 6, 487-496. https://doi.org/10.1016/0022-2496(69)90019-4
  4. Dorfman DD, Berbaum KS, Metz CE, Lenth RV, Hanley JA, and Abu Dagga H (1996). Proper receiver operating characteristic analysis: the bigamma model, Academic Radiology, 4, 138-149. https://doi.org/10.1016/S1076-6332(97)80013-X
  5. Gelfand AE and Kottas A (2001). Nonparametric Bayesian modeling for stochastic order, Annals of the Institute of Statistical Mathematics, 53, 865-876. https://doi.org/10.1023/A:1014629724913
  6. Gelman A (2006). Prior distribution for variance parameters in hierarchical models, Bayesian Analysis, 1, 515-533. https://doi.org/10.1214/06-BA117A
  7. Gelman A, Jakulin A, Pittau MG, and Su YS (2008). A weakly informative default prior distribution for logistic and other regression models, The Annals of Applied Statistics, 2, 1360-1383. https://doi.org/10.1214/08-AOAS191
  8. Geweke J (1992). Evaluating the accuracy of sampling-based approaches to calculating posterior moments. In Bernardo, JM, Berger, J, Dawid, AP and Smith, JFM (Eds.), Bayesian Statistics (Vol 4, pp. 169-194), Claredon Press, Oxford.
  9. Goncalves L, Subtil A, Oliveira MR, and Bermudez PDZ (2014). ROC curve estimation: An overview, REVSTAT-Statistical Journal, 12, 1-20.
  10. Hanley JA (1988). The robustness of the "binormal" assumptions used in fitting ROC curves, Medical Decision Making, 8, 197-203. https://doi.org/10.1177/0272989X8800800308
  11. Hanson TE, Kottas A, and Branscum AJ (2008). Modelling stochastic order in the analysis of receiver operating characteristic data: Bayesian non-parametric approaches, Journal of Applied Statistics, 57, 207-225.
  12. Hidiroglou MA and You Y (2016). Comparison of unit level and area level small area estimators, Survey Methodology, 42, 41-61.
  13. Hughes G and Bhattacharya B (2013). Symmetry properties of bi-normal and bi-gamma receiver operating characteristic curves are described by Kullback-Leibler divergences, Entropy, 15, 1342-1356. https://doi.org/10.3390/e15041342
  14. Hwang BS and Chen Z (2015). An integrated Bayesian nonparametric approach for stochastic and variability orders in ROC curve estimation: an application to endometriosis diagnosis, Journal of the American Statistical Association, 110, 923-934. https://doi.org/10.1080/01621459.2015.1023806
  15. Ishwaran H and Gatsonis AC (2000). A general class of hierarchical ordinal regression models with applications to correlated ROC analysis, The Canadian Journal of Statistics, 28, 731-750. https://doi.org/10.2307/3315913
  16. Johnson TD and Johnson VE (2006). A Bayesian hierarchical approach to multirater correlated ROC analysis, Statistics in Medicine, 25, 1858-1871. https://doi.org/10.1002/sim.2314
  17. Lee D, Nandram B, and Kim D (2017). Bayesian predictive inference of a proportion under a two-fold small area model with heterogeneous correlations, Survey Methodology, 17, 69-92.
  18. Metz CE (1989). Some practical issues of experimental design and data analysis in radiological ROC studies, Investigative Radiology, 24, 243-245.
  19. Metz CE, Herman BA, and Shen J (1998). Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data, Statistics in Medicine, 17, 1033-1053. https://doi.org/10.1002/(SICI)1097-0258(19980515)17:9<1033::AID-SIM784>3.0.CO;2-Z
  20. Metz CE and Pan X (1999). "Proper" binormal ROC curves: theory and maximum-likelihood estimation, Journal of Mathematical Psychology, 43, 1-33. https://doi.org/10.1006/jmps.1998.1218
  21. Molina I, Nandram B, and Rao JNK (2014). Small area estimation of general parameters with application to poverty indicators: a hierarchical Bayes approach, The Annals of Applied Statistics, 8, 852-885. https://doi.org/10.1214/13-AOAS702
  22. Mossman D and Peng H (2016). Using dual beta distributions to create "Proper" ROC curves based on rating category data, Medical Decision Making, 36, 349-365. https://doi.org/10.1177/0272989X15582210
  23. Nandram B, Bhatta D, Bhadra D, and Shen G (2013). Bayesian predictive inference of a finite population proportion under selection bias, Statistical Methodology, 11, 1-21. https://doi.org/10.1016/j.stamet.2012.08.003
  24. Nandram B and Peiris TB (2018). Bayesian analysis of a ROC curve for categorical data using a skew-binormal model, Statistics and Its Interface, 11, 369-384. https://doi.org/10.4310/SII.2018.v11.n2.a13
  25. Nandram B, Toto MCS, and Choi JW (2011). A Bayesian benchmarking of the Scott-Smith model for small areas, Journal of Statistical Computation and Simulation, 81, 1593-1608. https://doi.org/10.1080/00949655.2010.496726
  26. Nandram B and Yin J (2016). A nonparametric Bayesian prediction interval for a finite population mean, Journal of Statistical Computation and Simulation, 86, 1-17. https://doi.org/10.1080/00949655.2014.991930
  27. Peng F and Hall WJ (1996). Bayesian analysis of ROC curves using Markov-chain Monte Carlo methods, Medical Decision Making, 16, 404-411. https://doi.org/10.1177/0272989X9601600411
  28. Pesce LL, Metz CE, and Berbaum KS (2010). On the convexity of ROC curves estimated from radiological test results, Academic Radiology, 17, 960-968. https://doi.org/10.1016/j.acra.2010.04.001
  29. Pisano ED, Hendrick E, Yaffe M, et al. (2005). Diagnostic performance of digital versus film mammography for breast-cancer screening, The New England Journal of Medicine, 353, 1773-1783. https://doi.org/10.1056/NEJMoa052911
  30. Swets JA (1986). Form of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement of performance, Psychological Bulletin, 99, 181-198. https://doi.org/10.1037/0033-2909.99.2.181
  31. Wang C, Turnbull BW, Grohn YT, and Nielsen SS (2007). Nonparametric estimation of ROC curves based on Bayesian models when the true disease state is unknown, Journal of Agricultural, Biological, and Environmental Statistics, 12, 128-146. https://doi.org/10.1198/108571107X178095