Work

Comparing ROC curves derived from regression models

Year: 2012

Type: article

Abstract: In constructing predictive models, investigators frequently assess the incremental value of a predictive marker by comparing the ROC curve generated from the predictive model including the new marker with the ROC curve from the model excluding the new marker. Many commentators have noticed empirically that a test of the two ROC areas often produces a non-significant result when a corresponding Wald test from the underlying regression model is significant. A recent article showed using simulations that the widely used ROC area test produces exceptionally conservative test size and extremely low power. In this article, we demonstrate that both the test statistic and its estimated variance are seriously biased when predictions from nested regression models are used as data inputs for the test, and we examine in detail the reasons for these problems. Although it is possible to create a test reference distribution by resampling that removes these biases, Wald or likelihood ratio tests remain the preferred approach for testing the incremental contribution of a new marker.

Source: Statistics in Medicine

DOI: 10.1002/sim.5648

Authors: Venkatraman E. Seshan, Mithat Gönen, Colin B. Begg

Institution: Memorial Sloan Kettering Cancer Center

Language: English

Topic: Statistical Methods in Epidemiology

Subfield: Statistics and Probability

Field: Mathematics

Domain: Physical Sciences

Open Access status: green

Funder: National Cancer Institute

Awards: G1565781412, G1845544172, G8346865101, Cancer Center Support Grant