Effect of reporting bias on meta-analyses of drug trials: reanalysis of meta-analyses
BMJPublished 3 January 2012Open access
Benjamin Hart, Andreas Lundh, Lisa Bero
Citations242
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The effect of including unpublished trial outcome data obtained from the Food and Drug Administration on the results of meta-analyses of drug trials varies by drug and outcome.
Abstract
The effect of including unpublished FDA trial outcome data varies by drug and outcome. Unpublished FDA trial outcome data should be available and included in meta-analysis. Making these data easily accessible is particularly important because the effects of including unpublished data vary.
Keywords
Decision SciencesMathematicsPharmacology, Toxicology and Pharmaceutics
New England Journal of MedicineSelective Publication of Antidepressant Trials and Its Influence on Apparent Efficacy
2,426 Citations2008Erick H. Turner, Annette M. Matthews +3 more
A systematic literature search found that among 74 FDA-registered studies, 31%, accounting for 3449 study participants, were not published, and the increase in effect size ranged from 11 to 69% for individual drugs and was 32% overall.
JAMAEmpirical Evidence for Selective Reporting of Outcomes in Randomized Trials
1,806 Citations2004An‐Wen Chan, Asbjørn Hróbjartsson +3 more
The reporting of trial outcomes is not only frequently incomplete but also biased and inconsistent with protocols and Published articles, as well as reviews that incorporate them, may therefore be unreliable and overestimate the benefits of an intervention.
PLoS ONESystematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
1,506 Citations2008Kerry Dwan, Douglas G. Altman +12 more
There is strong evidence of an association between significant results and publication; studies that report positive or significant results are more likely to be published and outcomes that are statistically significant have higher odds of being fully reported.
BMJThe impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews
1,114 Citations2010Jamie J Kirkham, Kerry Dwan +5 more
Outcome reporting bias is an under-recognised problem that affects the conclusions in a substantial proportion of Cochrane reviews and individuals conducting systematic reviews need to address explicitly the issue of missing outcome data for their review to be considered a reliable source of evidence.
Cochrane Database of Systematic ReviewsPublication bias in clinical trials due to statistical significance or direction of trial results
887 Citations2009Sally Hopewell, Kirsty Loudon +3 more
To assess the extent to which publication of a cohort of clinical trials is influenced by the statistical significance, perceived importance, or direction of their results, five studies were included and found no significant association between either funding mechanism, investigator rank, or sex and publication.
BMJEvidence b(i)ased medicine—selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications
639 Citations2003Hans Melander, Jane Ahlqvist-Rastad +2 more
Any attempt to recommend a specific selective serotonin reuptake inhibitor from the publicly available data only is likely to be based on biased evidence.
BMJReboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials
575 Citations2010Dirk Eyding, M. Lelgemann +7 more
Reboxetine is, overall, an ineffective and potentially harmful antidepressant and Published evidence is affected by publication bias, underlining the urgent need for mandatory publication of trial data.
TrialsReporting bias in medical research - a narrative review
455 Citations2010Natalie McGauran, Beate Wieseler +4 more
Canadian Medical Association JournalOutcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research
446 Citations2004A.-W. Chan
Whether outcome reporting bias would be present in a cohort of government-funded trials subjected to rigorous peer review and whether primary outcomes specified in trial protocols were compared with those reported in publications is compared.
BMJOptimal search strategies for retrieving systematic reviews from Medline: analytical survey
416 Citations2004Víctor M. Montori, Nancy L Wilczynski +2 more
Systematic reviews can be retrieved from Medline with close to perfect sensitivity or specificity, or with high precision, by using empirical search strategies.
New England Journal of MedicineOutcome Reporting in Industry-Sponsored Trials of Gabapentin for Off-Label Use
362 Citations2009S. Swaroop Vedula, Lisa Bero +2 more
Examination of reporting practices for trials of gabapentin funded by Pfizer and Warner-Lambert's subsidiary, Parke-Davis for off-label indications found selective outcome reporting threatens the validity of evidence for the effectiveness of off- label interventions.
JAMAShould unpublished data be included in meta-analyses? Current convictions and controversies
336 Citations1993D. J. Cook
PLoS MedicineReporting Bias in Drug Trials Submitted to the Food and Drug Administration: Review of Publication and Presentation
322 Citations2008Kristin L. Rising, Peter Bacchetti +1 more
The publication rate of efficacy trials submitted to the Food and Drug Administration in approved New Drug Applications (NDAs) is determined and the trial characteristics as reported by the FDA with those reported in publications are compared.
BIBSYS Brage (BIBSYS (Norway))Improving the Use of Research Evidence in Guideline Development
261 Citations2007Andrew D Oxman, Holger J. Schünemann +4 more
The series of articles being published in Health Research Policy and Systems, which examine the methods used by WHO and other organisations to formulate recommendations about health, is part of the background documentation SURE has produced to inform ACHR's advice to WHO.
BMJPreparing raw clinical data for publication: guidance for journal editors, authors, and peer reviewers
148 Citations2010Iain Hrynaszkiewicz, Melissa Norton +2 more
The LancetScience as a public enterprise: the case for open data
136 Citations2011Geoffrey Boulton, M. D. Rawlins +2 more
It is the hope that Lancet UK Policy Matters will make a valuable contribution to the debate surrounding the government's current " listening exercise " on NHS modernisation, and faciliate better evidence for better health policy in the future.
Oxford University Research Archive (ORA) (University of Oxford)Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles.
127 Citations2004Chan, AW, Hróbjartsson, A +3 more
Health Research Policy and SystemsImproving the use of research evidence in guideline development: 1. Guidelines for guidelines
126 Citations2006Holger J. Schünemann, Atle Fretheim +1 more
The first of a series of 16 reviews that have been prepared as background for advice from the WHO Advisory Committee on Health Research to WHO on how to achieve this, reviewed the literature on guidelines for the development of guidelines.
Health Research Policy and SystemsImproving the use of research evidence in guideline development: 8. Synthesis and presentation of evidence
117 Citations2006Andrew D Oxman, Holger J. Schünemann +1 more
The literature on the synthesis and presentation of research evidence was reviewed, focusing on four key questions, and the conclusions are based on the available evidence, consideration of what WHO and other organisations are doing and logical arguments.
BMJOpening up data at the European Medicines Agency
105 Citations2011Peter C Gøtzsche, Andreas Jørgensen
Peter Gøtzsche and Anders Jørgensen describe their efforts to get access to unpublished trial reports from the European Medicines Agency.
Journal of Clinical EpidemiologyEMBASE search strategies achieved high sensitivity and specificity for retrieving methodologically sound systematic reviews
100 Citations2006Nancy L Wilczynski, R. Brian Haynes
Empirically derived search strategies can achieve high sensitivity and specificity for retrieving methodologically sound systematic reviews from EMBASE.