Guidelines for Meta-analyses Evaluating Diagnostic Tests
Annals of Internal MedicinePublished 15 April 1994
Les Irwig, Anna N. A. Tosteson, Constantine Gatsonis, Joseph Lau, Graham Colditz, Thomas C. Chalmers
Citations760
SJR quartileQ1
SJR score3.38
SNIP3.27
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
These guidelines are used to review 11 journal articles published from January 1990 through December 1991 whose primary purpose was to assess the accuracy of a diagnostic test against a concurrent reference standard using meta-analysis, and the guidelines are based on current concepts of how to assess diagnostic tests and conduct meta-analyses.
Abstract
Meta-analysis is potentially important in the assessment of diagnostic tests. Those reading meta-analyses evaluating diagnostic tests should critically appraise them; those doing meta-analyses should apply recently developed methods. The conduct and reporting of primary studies on which meta-analyses are based require improvement.
Keywords
Decision SciencesEconomics, Econometrics and Finance
The LancetPublication bias in clinical research
3,095 Citations1991Philippa Easterbrook, Radha Gopalan +2 more
The presence of publication bias in a cohort of clinical research studies is confirmed and it is suggested that conclusions based only on a review of published data should be interpreted cautiously, especially for observational studies.
New England Journal of MedicineProblems of Spectrum and Bias in Evaluating the Efficacy of Diagnostic Tests
1,732 Citations1978David F. Ransohoff, Alvan R. Feinstein
To determine why many diagnostic tests have proved to be valueless after optimistic introduction into medical practice, a series of investigations and identified two major problems that can cause erroneous statistical results for the "sensitivity" and "specificity" indexes of diagnostic efficacy.
Epidemiologic ReviewsQUANTITATIVE METHODS IN THE REVIEW OF EPIDEMIOLOGIC LITERATURE1
1,655 Citations1987Sander Greenland
Statistics in MedicineCombining independent studies of a diagnostic test into a summary roc curve: Data‐analytic approaches and some additional considerations
1,425 Citations1993Lincoln E. Moses, David E. Shapiro +1 more
To avoid model-dependent extrapolation from irrelevant regions of ROC space, this work proposes defining a priori a value of FPR so large that the test simply would not be used at that FPR, and avalue of TPR so low that theTestWould not be use at that TPR.
Annals of Internal MedicineMeta-Analysis in Clinical Research
1,280 Citations1987Kristan A. L'Abbé, ALLAN S. DETSKY +1 more
Important design and statistical issues of this process of combining study results that can be used to draw conclusions about therapeutic effectiveness or to plan new studies are reviewed.
New England Journal of MedicineMeta-Analyses of Randomized Controlled Trials
1,268 Citations1987Henry S. Sacks, Jayne Berrier +3 more
New England Journal of MedicineCumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
1,141 Citations1992Joseph Lau, Elliott M. Antman +4 more
Cumulative meta-analysis of therapeutic trials facilitates the determination of clinical efficacy and harm and may be helpful in tracking trials, planning future trials, and making clinical recommendations for therapy.
Annals of Internal MedicineA Consumer's Guide to Subgroup Analyses
905 Citations1992Andrew D Oxman, Gordon H. Guyatt
Guidelines are provided in this paper that will assist clinicians in making decisions regarding whether to base a treatment decision on overall results or on the results of a subgroup analysis.
Journal of Clinical EpidemiologyValidation of an index of the quality of review articles
789 Citations1991Andrew D Oxman, Gordon Guyatt
The OQAQ is a valid measure of the quality of research overviews and the primary shortcoming noted was the need for judgement in applying the index.
Medical Decision MakingAnalyzing a Portion of the ROC Curve
719 Citations1989Donna K. McClish
The area under the ROC curve is a common index summarizing the information contained in the curve when comparing two ROC curves, though, problems arise when interest does not lie in the entire range of false-positive rates.
PubMedReceiver operating characteristic (ROC) methodology: the state of the art.
689 Citations1989James A. Hanley
The nature of the data generated by ROC studies is described, the choices of summary indices of performance (accuracy) are evaluated, and the data-analytic techniques used are outlined, including how to incorporate data from multiple observers and multiple "readings".
BiometricsAssessment of Diagnostic Tests When Disease Verification is Subject to Selection Bias
673 Citations1983Colin B. Begg, Robert A. Greenes
In the assessment of the statistical properties of a diagnostic test, for example the sensitivity and specificity of the test, it is common to derive estimates from a sample limited to those cases for whom subsequent definitive disease verification is obtained.
International Journal of Technology Assessment in Health CareSome Statistical Methods for Combining Experimental Results
573 Citations1990Nan M. Laird, Frederick Mosteller
The steps an assessor might take in combining data from different studies are delineated and references are provided to provide references for topics not discussed in detail.
Statistics in MedicineHow study design affects outcomes in comparisons of therapy. I: Medical
527 Citations1989Graham A. Colditz, James N. Miller +1 more
Any evaluation of an innovation may include both bias and the true efficacy of the new therapy, therefore any evaluation of a new therapy may consider making adjustments for the average bias associated with a study design.
Statistics in MedicineBiases in the assessment of diagnostic tests
502 Citations1987Colin B. Begg
In this paper the various potential problems are described with reference to examples from the diagnostic literature and have implications for the design of diagnostic test evaluations, and the choice of suitable measures of test efficacy.
JNCI Journal of the National Cancer InstitutePublication Bias and Dissemination of Clinical Research
443 Citations1989Colin B. Begg, Jesse A. Berlin
Empiric studies have demonstrated that the induced bias is large and can have a serious impact on meta-analyses, in which data from several studies are aggregated, as well as on informal reviews.
Statistics in MedicineA comparison of statistical methods for combining event rates from clinical trials
427 Citations1989Jesse A. Berlin, Nan M. Laird +2 more
Two statistical methods for combining event rates from several studies are compared and the presence of heterogeneity influences the conclusion that the DerSimonian and Laird modified Cochran method tends to be more conservative.
Journal of Clinical EpidemiologyMeta-analysis in epidemiology, with special reference to studies of the association between exposure to environmental tobacco smoke and lung cancer: A critique
407 Citations1991Joseph L. Fleiss, Alan J. Gross
It is demonstrated that hastily or improperly designed meta-analyses can lead to results that may not be scientifically valid, as demonstrated by the 1986 report of the National Research Council concerning exposure to environmental tobacco smoke and the risk of lung cancer.
BiometrikaA family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data
351 Citations1989Sam Wieand, Mitchell H. Gail +2 more
Medical Decision MakingA General Regression Methodology for ROC Curve Estimation
272 Citations1988Anna N.A. Tosteson, Colin B. Begg
The new method provides a mechanism for pinpointing the effect that interobserver variability has on the ROC curve, and allows for the adjustment of ROC curves for temporal variation and case mix, and provides a way to assess the incremental diagnostic value of a test.
Annals of Internal MedicineSpectrum Bias in the Evaluation of Diagnostic Tests: Lessons from the Rapid Dipstick Test for Urinary Tract Infection
262 Citations1992Mark S. Lachs, Irving Nachamkin +4 more
The leukocyte esterase and bacterial nitrite rapid dipstick test for UTI is susceptible to spectrum bias, which may be responsible for differences in the test's sensitivity reported in previous studies.
Controlled Clinical TrialsAn empirical study of the possible relation of treatment differences to quality scores in controlled randomized clinical trials
246 Citations1990John D. Emerson, Elisabeth Burdick +3 more
In an empirical study of the relation of quality scores to treatment differences in published meta-analyses of 7 groups of controlled randomized clinical trials comprising 107 primary studies, it is found no relation between treatment difference and overall quality score.
JAMAMinimizing the Three Stages of Publication Bias
225 Citations1990Thomas C. Chalmers
Bias can be minimized by insisting on high-quality research and thorough literature reviews, eliminating the double standard concerning peer review and informed consent applied to clinical research and practice, and publishing legitimate trials regardless of their results.
PubMedA framework for clinical evaluation of diagnostic technologies.
197 Citations1986Gordon Guyatt, Peter Tugwell +3 more
Diagnostic technologies should be disseminated only if they are less expensive, produce fewer untoward effects and are at least as accurate as existing methods, if they eliminate the need for other investigations without loss of accuracy, or if they lead to institution of effective therapy.
American Review of Respiratory DiseaseComputed Tomography to Stage Lung Cancer: Approaching a Controversy Using Meta-analysis
178 Citations1990Robert Dales, Ryan M. Stark +1 more
Significant advances in the noninvasive detection of lymph node metastases must await an approach fundamentally different from CT-determined node size, as random variation of individual study results around an overall mean accuracy of only 0.79, which is marginally improved by advances in CT technology and methods.
American Journal of Clinical PathologyThe Diagnostic Accuracy of Rapid Dipstick Tests to Predict Urinary Tract Infection
178 Citations1991Terry A. Hurlbut, Benjamin Littenberg
This study summarizes the diagnostic accuracy data for dipstick nitrite and/or leukocyte esterase tests as predictors of bacterial urinary tract infection as defined by quantitative culture and revealed that the disjunctive pair is the most accurate index test.
Journal of Clinical EpidemiologyMeta-analysis in medicine Where we are and where we want to go
144 Citations1989Milos Jenicek
The greatest challenge of meta-analysis in medicine lies in the integration of the qualitative and quantitative assessment of given information (scoring of quality, weighing of the effect size by quality score, etc.).
Journal of Clinical EpidemiologyThe influence of referral patterns on the characteristics of diagnostic tests
142 Citations1992J. AndréKnorrnerus, Pieer Leffers
A general representation is given for the evaluation of the direction of change of the likelihood ratio as a function of referral probabilities, and the shape of receiver-operating characteristic curves is less sensitive to bias, but at the level of specific cut-off points considerable changes may occur.
Medical Decision MakingAn Evaluation of Methods for Estimating the Area Under the Receiver Operating Characteristic (ROC) Curve
139 Citations1985Robert M. Centor, Jean-Charles Schwartz
Generally, the nonparametric method yields lower area estimates than the maximum-likelihood-estimation technique, however, these differences generally were small, particularly with ROC curves derived from five or more cutoff points.
PubMedOn the use and computation of likelihood ratios in clinical chemistry.
129 Citations1982Adelin Albert
CHEST JournalAdenosine Deaminase in the Diagnosis of Tuberculous Pleural Effusions
127 Citations1991José L. Bañales, Pedro R. Pineda +4 more
The results indicated that in a population with a relatively high prevalence of tuberculosis, the analysis of ADA levels in pleural effusions constitutes a useful marker for the diagnosis which, in addition, can be made quickly and cheaply.
The American Journal of MedicineFactors affecting sensitivity and specificity of a diagnostic test: the exercise thallium scintigram
121 Citations1988Robert Detrano, András Jánosi +4 more
The reported sensitivity of thallium scintigraphy is higher and the specificity lower than that expected in clinical practice because of the presence of workup bias and the inappropriate inclusion of post-infarct patients.
Annals of Internal MedicineDiagnostic Strategies for Common Medical Problems.
105 Citations1991
Diagnostic Strategies for Common Medical Problems, second edition, presents the best diagnostic strategies for 51 of the most common patient presentations you're likely to see in a clinical setting, allowing you to get the information you need quickly and easily.
MedicineTHE TRANSAMINASE TESTS IN LIVER DISEASE
93 Citations1967Richard J. Clermont, Thomas C. Chalmers
Journal of General Internal MedicineAssessing quality of a diagnostic test evaluation
80 Citations1989Cynthia D. Mulrow, William D. Linn +2 more
A 19-item weighted scale is proposed as a useful instrument for readers, investigators, reviewers, and editors, because it represents an updated synthesis of important criteria to consider when evaluating diagnostic tests.
Methods of Information in MedicineComparative Diagnostic Performance of Three Radiological Procedures for the Detection of Lumbar Disk Herniation
73 Citations1990J. W. P. F. Kardaun, O. Kardaun
Based on the available, retrospective data, phlebography appears to have the highest performance in visualizing an LDH, followed by myelography and CT, and homogeneity of sensitivity turns out to be much more likely than a common odds ratio.
CancerIntraoperative pathologic diagnosis of thyroid neoplasms. Report on experience with 504 specimens
63 Citations1990Yale Rosen, Philip Rosenblatt +1 more
The inability to diagnose follicular carcinoma intraoperatively with FS is the most significant factor accounting for the relatively low sensitivity of FS diagnosis of malignant thyroid neoplasms.
Medical Decision MakingTesting for Fetal Pulmonary Maturity
59 Citations1990M. G. Myriam Hunink, Douglas K. Richardson +2 more
The lecithin/sphingomyelin ratio (US) and the measured value of saturated phosphatidyl choline (SPC), amniotic fluid determinations obtained to assess fetal pulmonary maturity, were evaluated with receiver operating characteristic (ROC) curve analysis.
The American Journal of CardiologyComparison of SPECT using technetium-99m agents and thallium-201 and PET for the assessment of myocardial perfusion and viability
45 Citations1990Daniel S. Berman, Hosen Kiat +4 more
The combination of high image quality and first-pass exercise capabilities may lead to a choice of this agent over TI-201 for assessment of chronic CAD, and the combination of minimal redistribution of Tc-99m sestamibi and high count rates makes gated SPECT imaging feasible.
SpineDiagnostic Accuracy and Clinical Utility of Thermography for Lumbar Radiculopathy
40 Citations1991Richard M. Hoffman, Daniel Kent +1 more
Thermography cannot be recommended currently for routine clinical use in evaluating low-back pain and Rigorous clinical research is required to establish its diagnostic accuracy and clinical utility.
American Heart JournalCardiac fluoroscopy for the diagnosis of coronary artery disease: A meta analytic review
38 Citations1990R Gianrossi, Robert Detrano +2 more
Sensitivity and specificity for predicting serious coronary disease compare quite well with those from the literature on the exercise ECG and the exercise thallium scintigram, and sensitivity is paradoxically lower in laboratories testing patients with more severe disease.
Journal of Thoracic and Cardiovascular SurgeryDiagnostic significance of carcinoembryonic antigen in the differential diagnosis of malignant mesothelioma
35 Citations1990J. Mezger, R. Lamerz +1 more
Together with identification of the antigen in serum, pleural fluid, or ascitic fluid, immunohistochemical and immunocytochemical techniques for detecting carcinoembryonic antigen provide a valuable aid for distinguishing malignant mesothelioma from metastatic carcinomas.
Acta PaediatricaThe Predictive Value of a Normal Ultrasound Scan in the Preterm Baby–a Meta‐Analysis
25 Citations1990P C Ng, P R Dear
In order to determine the predictive value for normal development of consistently normal cranial ultrasound scans in the preterm baby, a meta‐analysis on all the published reports in the English language which provide follow‐up data on such cases is performed.
Medical Decision MakingDetermining a Range of False-positive Rates for Which ROC Curves Differ
21 Citations1990Donna K. McClish
The author presents a method for directly comparing true-positive rates for two diagnostic, screening or prognostic tools, determining over what range of false-positive values the tests differ.
PubMedTechnetium-99m-RBC venography in the diagnosis of deep venous thrombosis of the lower extremity: a systematic review of the literature.
19 Citations1991Andy G. Pinson, Daniel M. Becker +2 more
Although 99mTc-RBC venography is a promising technique, future studies with larger numbers of patients and closer adherence to methodologic standards are required.
Journal of Clinical EpidemiologyThe use of meta-analysis in technology assessment: A meta-analysis of the enzyme immunosorbent assay human immunodeficiency virus antibody test*1
11 Citations1991Katharine A. Phillips
It is demonstrated that meta-analysis can be used to synthesize literature on technologies, and that regression analysis can beused to examine the sources of variation thatMeta-analysis uncovers, and for studies of test performance to use standardized research procedures and to fully report their methods and results.
PubMedMeta-analysis of the reliability of noninvasive carotid studies.
8 Citations1992James Reed
A meta-analysis showed that when two tests are concordant, the test degree of certainty is greatly improved, with anatomic and physiologic information that often matches or surpasses that afforded by the more invasive percutaneous carotid arteriography.