Empirical Evidence for Selective Reporting of Outcomes in Randomized Trials
JAMAPublished 25 May 2004
An‐Wen Chan, Asbjørn Hróbjartsson, Mette T. Haahr, Peter C Gøtzsche, Douglas G. Altman
Citations1,806
SJR quartileQ1
SJR score5.35
SNIP10.71
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The reporting of trial outcomes is not only frequently incomplete but also biased and inconsistent with protocols and Published articles, as well as reviews that incorporate them, may therefore be unreliable and overestimate the benefits of an intervention.
Abstract
The reporting of trial outcomes is not only frequently incomplete but also biased and inconsistent with protocols. Published articles, as well as reviews that incorporate them, may therefore be unreliable and overestimate the benefits of an intervention. To ensure transparency, planned trials should be registered and protocols should be made publicly available prior to trial completion.
Keywords
Decision SciencesMathematicsEconomics, Econometrics and Finance
The LancetThe CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials
5,372 Citations2001David Moher, Kenneth F. Schulz +1 more
The revised CONSORT statement presented here incorporates new evidence and addresses some criticisms of the original statement to improve the reporting of an RCT, enabling readers to understand a trial's conduct and to assess the validity of its results.
Annals of Internal MedicineThe Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
3,805 Citations2001D G Altman, Kenneth F. Schulz +7 more
The CONSORT statement (or simply CONSORT) comprises a checklist of essential items that should be included in reports of RCTs and a diagram for documenting the flow of participants through a trial, aimed at first reports of two-group parallel designs.
BMC Medical Research MethodologyThe CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials
2,754 Citations2001David Moher, Kenneth F. Schulz +1 more
The revised CONSORT statement is intended to improve the reporting of an RCT, enabling readers to understand a trial's conduct and to assess the validity of its results.
Statistical Methods for Examining Heterogeneity and Combining Results from Several Studies in Meta‐Analysis
2,137 Citations2001Jonathan J Deeks, Douglas G. Altman +1 more
portal Libraries and the AcademyInstitutional Repositories: Essential Infrastructure For Scholarship In The Digital Age
1,058 Citations2003Clifford A. Lynch
The thinking about digital preservation over the past five years has advanced to the point where the needs are widely recognized and well defined, the technical approaches at least superficially mapped out, and the need for action is now clear.
Meta‐Analysis Of Controlled Clinical Trials
815 Citations2002Anne Whitehead
This paper presents a meta--analysis procedure for estimating the treatment difference in an individual trial by combining estimates of a treatment difference across trials using individual patient data.
Journal of Health Services Research & PolicyStatistical heterogeneity in systematic reviews of clinical trials: a critical appraisal of guidelines and practice
761 Citations2002Julian P. T. Higgins, Simon Thompson +2 more
Recommendations that address practical issues are required to reduce the risk of spurious findings from investigations of heterogeneity, rather than simply adopting a cautious approach to their interpretation, unless a large number of studies is available.
New England Journal of MedicineStatistical Problems in the Reporting of Clinical Trials
669 Citations1987Stuart Pocock, Michael D. Hughes +1 more
Overall, the reporting of clinical trials appears to be biased toward an exaggeration of treatment differences, and more emphasis should be given to the magnitude of treatment Differences and to estimation methods such as confidence intervals.
BMJEvidence b(i)ased medicine—selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications
639 Citations2003Hans Melander, Jane Ahlqvist-Rastad +2 more
Any attempt to recommend a specific selective serotonin reuptake inhibitor from the publicly available data only is likely to be based on biased evidence.
JAMAUnderreporting Research Is Scientific Misconduct
556 Citations1990lain Chalmers
An extended use of prospective registration of trials at inception, as well as benefiting clinical research in other ways, could help people to play their respective roles in reducing underreporting of clinical trials.
Controlled Clinical TrialsMethodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis
336 Citations1989Peter C Gøtzsche
Important design aspects were decreasingly reported in NSAID trials over the years, whereas the quality of statistical analysis improved, and it is not obvious how a reliable meta-analysis could be done in these trials.
BMJBad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group
315 Citations2004Heloisa P. Soares, Stephanie Daniels +5 more
The reporting of methodological aspects of randomised controlled trials does not necessarily reflect the conduct of the trial and reviewing research protocols and contacting trialists for more information may improve quality assessment.
PubMedHow important is publication bias? A synthesis of available data.
312 Citations1997Kay Dickersin
This article will review the major evidence available regarding publication bias and will suggest measures for overcoming the problem.
Journal of Clinical EpidemiologyBias in meta-analytic research
231 Citations1992David T. Felson
This manuscript reviews specific types of bias which are common at each of the three stages at which bias can be injected into a meta-analysis, finding studies, selection of the identified studies for theMeta-analysis and extraction of data from the selected studies.
BMJMeta-analysis: Unresolved issues and future developments
176 Citations1998George Davey Smith, Matthias Egger
In this final article of the series, some of the topics that are likely to feature in future discussions of the appropriate practice and domain of meta-analysis are addressed.
JAMAPublishing Protocols of Systematic Reviews
168 Citations2002Chris Silagy, Philippa Middleton +1 more
A retrospective comparative study to assess the extent to which the content of published Cochrane reviews had changed compared with their previously published protocols found that a large number of changes were made to Cochrane Reviews.
Statistics in MedicineAssessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies
125 Citations2000Seokyung Hahn, Paula Williamson +3 more
A method of sensitivity analysis is developed that imputes data for the missing subgroups to assess the robustness of the results and the conclusions drawn and indicates that the estimate of effect reported in the review is most likely to overestimate the true effect and the conclusion that benefit is limited to primigravidae may be false.
The LancetHow can medical journals help prevent poor medical research? Some opportunities presented by electronic publishing
113 Citations1999Iain Chalmers, Douglas G. Altman
Journal of Evaluation in Clinical PracticeInvestigation of within‐study selective reporting in clinical research: follow‐up of applications submitted to a local research ethics committee
102 Citations2002Seokyung Hahn, Paula Williamson +1 more
The pilot study has shown that within-study selective reporting may be examined qualitatively by comparing the study report with the study protocol, and suggests that it might well be substantial.
BMJStudy of information submitted by drug companies to licensing authorities.
97 Citations1980Elina Hemminki
This study provides support for those who want to see public disclosure of the reports of trials submitted in licensing applications by drug companies to licensing authorities in Finland and Sweden in four different years.
Arthritis & RheumatismTime for changes in the design, analysis, and reporting of rheumatoid arthritis clinical trials
50 Citations1990David T. Felson, Jennifer J. Anderson +1 more
It is suggested that investigators focus on enumerating which patients improve in a trial, rather than on the mean level of improvement in treated patients versus the control patients, and the reporting of confidence intervals rather than simply stating P values.
Journal of Evaluation in Clinical PracticeIndividual patient data meta‐analysis of randomized anti‐epileptic drug monotherapy trials
47 Citations2000Paula Williamson, Anthony G Marson +3 more
It is demonstrated that IPD meta-analysis is possible in AED research and empirical evidence of the reliability of meta-analyses based on aggregate rather than individual patient data is still lacking.
BMJJournals should see original protocols for clinical trials
12 Citations2001C J Hawkey
Criticism of the editorial in JAMA mentioning celecoxib, an arthritis drug, may be deserved but surely more censure should be reserved for the journal that published the article and its reviewers.