Communications for Statistical Applications and Methods

The Korean Statistical Society (한국통계학회)
권호 표지
DOI QR코드

DOI QR Code

A Comparison of the Interval Estimations for the Difference in Paired Areas under the ROC Curves

대응표본에서 AUC차이에 대한 신뢰구간 추정에 관한 고찰

  • Received : 20091200
  • Accepted : 20100300
  • Published : 2010.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

Receiver operating characteristic(ROC) curves can be used to assess the accuracy of tests measured on ordinal or continuous scales. The most commonly used measure for the overall diagnostic accuracy of diagnostic tests is the area under the ROC curve(AUC). When two ROC curves are constructed based on two tests performed on the same individuals, statistical analysis on differences between AUCs must take into account the correlated nature of the data. This article focuses on confidence interval estimation of the difference between paired AUCs. We compare nonparametric, maximum likelihood, bootstrap and generalized pivotal quantity methods, and conduct a monte carlo simulation to investigate the probability coverage and expected length of the four methods.

동일 환자에게 적용된 2가지 진단검사의 정확성을 비교하기 위한 방법들 중에서 두개의 ROC곡선 아래 면적(AUC; Area Under Curve)의 차이는 주요한 잣대 중 하나이다. 본 연구에서는 AUC의 차이를 추정하는 방법으로 비모수적방법, 최대가능도법, 일반화추축량에 의한 방법, 붓스트랩방법의 4가지를 포함확률(coverage probability), 기대길이 (expected length) 측면에서 모의실험을 통하여 비교하였다.

Keywords

Acknowledgement

Supported by : 한국학술진흥재단

References

  1. Bandos, A. I. Rockette, H. E., and Gur, D. (2007). Exact bootstrap variances of the area under ROC courve, Communications in Statistics-Theroy and Methods, 36, 2443-2461. https://doi.org/10.1080/03610920701215811
  2. DeLong, E. R, DeLong, D. M., and Clarke-Pearson, D. L. (1988). Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach, Biometrics, 44, 837-845. https://doi.org/10.2307/2531595
  3. Hanning, J., Iyer H. K., and Patterson, P. (2006). Fiducial generalized confidence intervals, Journal of the American Statistical Association, 101, 254-269. https://doi.org/10.1198/016214505000000736
  4. Li, C. R., Liao, C. T., and Liu, J. P. (2008). On the exact interval estimation for the difference in paired areas under the ROC curves, Statistics in Medicine, 27, 224-242. https://doi.org/10.1002/sim.2760
  5. McClish, D. K. (1989). Analyzing a portion of the ROC curve, Medical Decision Making, 9, 190-195. https://doi.org/10.1177/0272989X8900900307