Determining a Range of False-positive Rates for Which ROC Curves Differ

Medical Decision MakingPublished 1 December 1990

Donna K. McClish

DOI10.1177/0272989x9001000406

Source URL

Citations21

SJR quartileQ1

SJR score1.48

SNIP1.35

TL;DR

The author presents a method for directly comparing true-positive rates for two diagnostic, screening or prognostic tools, determining over what range of false-positive values the tests differ.

Abstract

Many indices have been proposed for summarizing the information contained in the ROC curve. When comparing two ROC curves, though, there are times when global summary measures are either not optimal or not appropriate. The author presents a method for directly comparing true-positive rates for two diagnostic, screening or prognostic tools, determining over what range of false-positive values the tests differ. The method is applicable for independent or dependent samples. An example concerning gallium citrate imaging is presented, as well as an example using a prognostic index for severity of illness in the ICU. The range of false-positive rates for which the ROC curves differ is determined for each example.

Keywords

Medicine

Seminars in Nuclear MedicineBasic principles of ROC analysis

5,991 Citations1978Charles E. Metz

ROC analysis is shown to be related in a direct and natural way to cost/benefit analysis of diagnostic decision making and the concepts of "average diagnostic cost" and "average net benefit" are developed and used to identify the optimal compromise among various kinds of diagnostic error.

Critical Care MedicineAPACHE—acute physiology and chronic health evaluation: a physiologically based classification system

2,173 Citations1981William A. Knaus, Jack E. Zimmerman +3 more

The development and initial validation of acute physiology and chronic health evaluation (APACHE), a physiologically based classification system for measuring severity of illness in groups of critically ill patients, is described.

Journal of Mathematical PsychologyMaximum-likelihood estimation of parameters of signal-detection theory and determination of confidence intervals—Rating-method data

878 Citations1969Donald D. Dorfman, Edward F. Alf

Medical Decision MakingAnalyzing a Portion of the ROC Curve

719 Citations1989Donna K. McClish

The area under the ROC curve is a common index summarizing the information contained in the curve when comparing two ROC curves, though, problems arise when interest does not lie in the entire range of false-positive rates.

Investigative RadiologyROC Analysis Applied to the Evaluation of Medical Imaging Techniques

696 Citations1979John A. Swets

This paper presents a brief description of the ROC, and shows how it provides a measure of diagnostic accuracy that is free of judgmental bias.

Medical Decision MakingStatistical Approaches to the Analysis of Receiver Operating Characteristic (ROC) Curves

558 Citations1984Barbara J. McNeil, James A. Hanley

This article shows how to calculate confidence limits around any point on the curve and shows, using the conventional Dorfman and Alf program and the jackknifing technique, how to calculated these confidence limits for multiple curves derived from the same sample of patients.

Information Processing in Medical ImagingA New Approach for Testing the Significance of Differences Between ROC Curves Measured from Correlated Data

361 Citations1984Charles E. Metz, Pu-Lan Wang +1 more

Receiver Operating Characteristic analysis is now generally recognized as the most appropriate methodology for evaluating the diagnostic performance of medical imaging procedures and its theory and experimental methodology have been developed in considerable detail.

Medical Decision MakingThe Robustness of the "Binormal" Assumptions Used in Fitting ROC Curves

313 Citations1988James A. Hanley

The binormal form is the most common model used to formally fit ROC curves to the data from signal detection studies that employ the "rating" method, but the small lack of fit is unlikely to be demonstrated in practice, and the small number of rating categories used does not permit seemingly very different models to be distinguished from one another.

PsychometrikaOn the Johnson-Neyman Technique and Some Extensions Thereof

175 Citations1964Richard F. Potthoff

Critical Care MedicineClinical characteristics and resource utilization of ICU patients

99 Citations1987Robert J. Henning, Donna K. McClish +4 more

Consideration should be given to the organization of ICUs according to the patient's severity of illness, as determined by the admission, maximal, and average acute physiology scores (APS).