Reporting Quality of Social and Psychological Intervention Trials: A Systematic Review of Reporting Guidelines and Trial Publications
PLoS ONEPublished 29 May 2013Open access
Sean Grant, Evan Mayo‐Wilson, G. J. Meléndez‐Torres, Paul Montgomery
Citations103
SJR quartileQ1
SJR score0.80
SNIP1.07
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A need to develop a CONSORT extension with updated standards for social and psychological intervention trials is demonstrated, as important details are routinely missing from trial publications.
Abstract
Existing reporting guidelines have important limitations in content, development, and/or dissemination. Important details are routinely missing from trial publications; most leading journals in social and behavioural sciences do not ask authors to follow reporting standards. Findings demonstrate a need to develop a CONSORT extension with updated standards for social and psychological intervention trials.
Keywords
Decision SciencesHealth ProfessionsEconomics, Econometrics and Finance
Controlled Clinical TrialsAssessing the quality of reports of randomized clinical trials: Is blinding necessary?
17,565 Citations1996Alejandro R. Jadad, R Andrew Moore +5 more
An instrument to assess the quality of reports of randomized clinical trials (RCTs) in pain research is described and its use to determine the effect of rater blinding on the assessments of quality is described.
BMC MedicineCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
13,537 Citations2010the CONSORT Group, Kenneth F. Schulz +2 more
Cerebrovascular DiseasesAspirin plus Clopidogrel as Secondary Prevention after Stroke or Transient Ischemic Attack: A Systematic Review and Meta-Analysis
11,556 Citations2014Qinghua Zhang, Chao Wang +6 more
Short-term aspirin in combination with clopidogrel is more effective as secondary prevention of stroke or TIA without increasing the risk of hemorrhagic stroke and major bleeding events and the clinical applicability of the findings of this systematic review needs to be confirmed in future clinical trials.
BMJCONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials
9,055 Citations2010David Moher, Sally Hopewell +7 more
BMJCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
8,668 Citations2010K. F Schulz, D. G Altman +2 more
The latest version, CONSORT 2010, which updates the reporting guideline based on new methodological evidence and accumulating experience is described, which updates the reporting guideline based on new methodological evidence and accumulating experience.
PubMedUnderstanding interobserver agreement: the kappa statistic.
7,056 Citations2005Anthony J. Viera, Joanne M. Garrett
Items such as physical exam findings, radiographic interpretations, or other diagnostic tests often rely on some degree of subjective interpretation by observers and studies that measure the agreement between two or more observers should include a statistic that takes into account the fact that observers will sometimes agree or disagree simply by chance.
American Journal of Community PsychologyImplementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation
5,306 Citations2008Joseph A. Durlak, Emily P. DuPre
The collection of implementation data is an essential feature of program evaluations, and more information is needed on which and how various factors influence implementation in different community settings.
Urologia InternationalisEfficacy and Safety of Tadalafil Monotherapy for Lower Urinary Tract Symptoms Secondary to Benign Prostatic Hyperplasia: A Meta-Analysis
4,542 Citations2013Yang Dong, Lin Hao +4 more
Tadalafil showed good efficacy and safety for improving LUTS and erectile dysfunction in men with BPH, and 5 mg of tadalafils significantly improved Qmax.
Implementation research: a synthesis of the literature.
3,784 Citations2005Fixsen Dl, Naoom Sf +2 more
BMJConsort 2010 statement: extension to cluster randomised trials
3,418 Citations2012Marion Campbell, Gilda Piaggio +3 more
This paper provides updated and extended guidance, based on the 2010 version of the CONSORT statement and the 2008consORT statement for the reporting of abstracts, on how to report the results of cluster randomised controlled trials.
American Journal of Public HealthImproving the Reporting Quality of Nonrandomized Evaluations of Behavioral and Public Health Interventions: The TREND Statement
2,575 Citations2004Don C. Des Jarlais, Cynthia M. Lyles +2 more
The initial version of the Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statement is presented, which emphasize the reporting of theories used and descriptions of intervention and comparison conditions, research design, and methods of adjusting for possible biases in evaluation studies that use nonrandomized designs.
BMJCONSORT statement: extension to cluster randomised trials
2,547 Citations2004Marion Campbell, Diana R Elbourne +1 more
New guidance is presented, based on the 2001 revision of the CONSORT statement, on reporting parallel group randomised trials in which individual participants are randomly assigned to study groups.
Enlighten: Publications (The University of Glasgow)Developing and Evaluating Complex Interventions: New Guidance
1,892 Citations2006Peter Craig, Paul Dieppe +4 more
This research highlights the need to understand more fully the rationale behind the continued use of EMMARM, as well as the barriers to doing so, in patients and clinicians.
BMJImproving the reporting of pragmatic trials: an extension of the CONSORT statement
1,829 Citations2008Merrick Zwarenstein, Shaun Treweek +7 more
Eight CONSORT checklist items for reporting of pragmatic trials are recommended, including the background, participants, interventions, outcomes, sample size, blinding, participant flow, and generalisability of the findings.
Annals of Internal MedicineBetter Reporting of Harms in Randomized Trials: An Extension of the CONSORT Statement
1,522 Citations2004John P. A. Ioannidis, Stephen J.W. Evans +6 more
This work searched MEDLINE, EMBASE, Web of Science, and the Cochrane Library using a wide array of terms related to harms and identified pertinent evidence and made recommendations on the appropriate reporting of harms in RCTs.
PLoS MedicineGuidance for Developers of Health Research Reporting Guidelines
1,380 Citations2010David Moher, Kenneth F. Schulz +2 more
David Moher and colleagues from the EQUATOR network offer guidance and recommended steps for developing health research reporting guidelines.
The Medical Journal of AustraliaDoes the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review
853 Citations2006Amy C. Plint, David Moher +5 more
Whether the adoption of the CONSORT checklist is associated with improvement in the quality of reporting of randomised controlled trials (RCTs) is investigated.
Cochrane Database of Systematic ReviewsConsolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals
739 Citations2012Lucy Turner, Larissa Shamseer +8 more
This review updates the earlier systematic review assessing whether journal endorsement of the 1996 and 2001 CONSORT checklists influences the completeness of reporting of RCTs published in medical journals.
American PsychologistReporting standards for research in psychology: Why do we need them? What might they be?
554 Citations2008APA Publications and Communications Board Working Group on Journal Article Reporting Standards
The resulting recommendations contain standards for all journal articles, and more specific standards for reports of studies with experimental manipulations or evaluations of interventions using research designs involving random or nonrandom assignment.
Annals of Internal MedicineMethods and Processes of the CONSORT Group: Example of an Extension for Trials Assessing Nonpharmacologic Treatments
515 Citations2008Isabelle Boutron, David Moher +4 more
The methods and processes used to develop this extension to the CONSORT Statement should improve the quality of reporting randomized, controlled trials assessing nonpharmacologic treatments.
The LancetCONSORT for reporting randomised trials in journal and conference abstracts
437 Citations2008Sally Hopewell, Mike Clarke +5 more
Journals and conference organisers should provide instructions about the key elements of a trial that authors should report, within the space limitations of an abstract (typically, 250–300 words), and preliminary work shows that all the checklist items can be fi tted within such word limits.
Annals of Behavioral MedicineEvidence-based behavioral medicine: What is it and how do we achieve it?
418 Citations2003Karina W. Davidson, Michael G. Goldstein +7 more
Use of these guidelines by clinicians, educators, policymakers, and researchers who design, report, and evaluate or review RCTs will strengthen the research itself and accelerate efforts to apply behavioral medicine research to improve the processes and outcomes of behavioral medicine practice.
PLoS MedicineCan We Systematically Review Studies That Evaluate Complex Interventions?
394 Citations2009Sasha Shepperd, Simon Lewin +6 more
In three Viewpoints, Sasha Shepperd and colleagues, Geoff Wong, and Aziz Sheikh explore various approaches to help systematic reviewers who wish to review complex health interventions.
PLoS MedicineReporting Guidelines for Survey Research: An Analysis of Published Guidance and Reporting Practices
390 Citations2011Carol Bennett, Sara D. Khangura +5 more
There is limited guidance and no consensus on the optimal reporting of survey research, according to Carol Bennett and colleagues, and there is a need for more guidance and consensus on this issue.
Health Technology AssessmentFactors that limit the quality, number and progress of randomised controlled trials.
388 Citations1999Prescott, Counsell +8 more
Implementation ScienceStrengthening evaluation and implementation by specifying components of behaviour change interventions: a study protocol
317 Citations2011Susan Michie, Charles Abraham +4 more
The development of a reliable method of specifying intervention components aimed at changing behaviour will strengthen the scientific basis for developing, evaluating, and reporting complex interventions and improve the precision of evidence syntheses of effectiveness, thus enhancing secondary, as well as primary, research.
JAMAA Proposal for Structured Reporting of Randomized Controlled Trials
310 Citations1994Erik Andrew
A RANDOMIZED controlled trial (RCT) is the most reliable method of assessing the efficacy of health care interventions and reports of RCTs should provide readers with adequate information about what went on in the design, execution, analysis, and interpretation of the trial.
Journal of Chinese Integrative MedicineCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials (Chinese version)
248 Citations2010KF Schulz
The latest version, CONSORT 2010, is described, which updates the reporting guideline based on new methodological evidence and accumulating experience and is freely accessible on bmj.com.
Journal of Epidemiology & Community HealthAlternatives to randomisation in the evaluation of public health interventions: design challenges and solutions: Table 1
228 Citations2009Chris Bonell, James Hargreaves +5 more
Non-randomised trials might provide adequate evidence to inform decisions when interventions are demonstrably feasible and acceptable, and where evidence suggests there is little potential for harm, but caution that such designs may not provide adequateevidence when intervention feasibility or acceptability is doubtful.
Intervention Research: Developing Social Programs
221 Citations2009Mark W. Fräser
This chapter discusses the six stages of intervention research and some of the challenges faced in developing a program theory and then the development of program materials.
PLoS MedicineGuidelines for Reporting Health Research: The EQUATOR Network's Survey of Guideline Authors
216 Citations2008Iveta Simera, Douglas G. Altman +3 more
Iveta Simera and colleagues survey the authors of 37 guidelines on reporting health research to find out who the authors are and what they believe should be done to improve the quality of research.
BMJTaking healthcare interventions from trial to practice
209 Citations2010Paul Glasziou, Iain Chalmers +17 more
Journal of Epidemiology & Community HealthReviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions
205 Citations2008M Egan, Clare Bambra +2 more
Controlled Clinical TrialsReporting standards and research strategies for controlled trials
205 Citations1980Frederick Mosteller, John Gilbert +1 more
Injury Control and Safety PromotionRoad traffic crashes: operationalizing equity in the context of health sector reform
197 Citations2003Tim Evans, Hilary K. Brown
The paper explains the acronym PROGRESS that stands for place of residence, religion, occupation, gender, race/ethnicity, education, socioeconomic status and social networks and capital and highlights the multidimensionality of the distribution of health among population subgroups.
Intervention Research
195 Citations2009Mark W. Fräser, Jack M. Richman +2 more
BMJEndorsement of the CONSORT statement by high impact medical journals: survey of instructions for authors
177 Citations2005Douglas G. Altman
The extent to which leading medical journals had incorporated the CONSORT recommendations into their instructions for authors was found to be low, according to citation impact factors for 2001.
Journal of Public HealthImproving the reporting of public health intervention research: advancing TREND and CONSORT
174 Citations2008Rebecca Armstrong, Elizabeth Waters +5 more
Examining the existing reporting frameworks for research against information sought by users of systematic reviews of public health interventions and suggesting additional items that should be considered are suggested to improve the quality and usefulness of published evidence and increase its impact on public health program planning.
BMJAssessment of generalisability in trials of health interventions: suggested framework and systematic review
158 Citations2006Chris Bonell, Ann Oakley +3 more
Most evaluations of new treatments use highly selected populations, making it difficult to decide whether they would work elsewhere, and systematic evaluation and reporting of applicability is required.
Journal of Clinical EpidemiologyDescribing reporting guidelines for health research: a systematic review
147 Citations2011David Moher, Laura Weeks +9 more
Reporting-guideline developers need to endeavor to maximize the quality of their product and recently developed guidance is likely to facilitate more robust guideline development.
JAMAA proposal for structured reporting of randomized controlled trials. The Standards of Reporting Trials Group
91 Citations1994Erik Andrew, Aslam H. Anis +27 more
Educational ResearcherUsing Google Scholar to Estimate the Impact of Journal Articles in Education
83 Citations2010Jan van Aalst
The potential of Google Scholar as an alternative or complement to the Web of Science and Scopus for measuring the impact of journal articles in education and the promise and pitfalls of using Google Scholar for characterizing the influence of research output are discussed.
Systematic ReviewsGuidelines for randomized clinical trial protocol content: a systematic review
77 Citations2012Jennifer Tetzlaff, An‐Wen Chan +4 more
A systematically developed, evidence-informed guideline for clinical trial protocols is needed, as existing guidelines for RCT protocol content varied substantially in their recommendations.
Canadian Medical Association JournalOpportunities and challenges for improving the quality of reporting clinical research: CONSORT and beyond
77 Citations2004David Moher
Reports of randomized controlled trials (RCTs) are the only tangible evidence of their conduct, and historians may well view the first 50 years of reporting with some surprise.
Journal of Clinical EpidemiologyReviews assessing the quality or the reporting of randomized controlled trials are increasing over time but raised questions about how quality is assessed
74 Citations2010Agnès Dechartres, Pierre Charles +3 more
The number of methodological reviews has dramatically increased in recent years and how quality is assessed still raises important issues, but heterogeneity of criteria used and lack of definition may limit the relevance of these reviews.
Research on Social Work PracticeTreatment Fidelity in Social Work Intervention Research: A Review of Published Studies
66 Citations2010Matthias J. Naleppa, John G. Cagle
Greater attention needs to be paid to fidelity in social work intervention research.
Journal of Pediatric PsychologyClinical Trials in the Journal of Pediatric Psychology: Applying the CONSORT Statement
64 Citations2003Jennifer Stinson
Although many of the items in the CONSORT statement were not adhered to by the two psychological journals, most of the CONSort items can clearly be applied to psychosocial trials.
Contemporary Clinical TrialsThe impact of the CONSORT statement on reporting of randomized clinical trials in psychiatry
61 Citations2008Hans‐Jürgen Möller, Kyung Phil Kwak +6 more
Although the overall quality of reporting on psychiatric RCTs generally improved after publication of the CONSORT statement, reporting the details of randomization, blinding, and obtaining informed consent remain insufficient.
Medical CareMethods of Randomized Controlled Clinical Trials in Health Services Research
54 Citations1995E. Andrew Balas, Suzanne Austin +3 more
The authors conclude that the new quality evaluation tool leads to replicable results and there is an urgent need to improve several study characteristics of clinical trials.
American Journal of Occupational TherapyRandomized Controlled Trials To Investigate Occupational Therapy Research Questions
46 Citations2004David L. Nelson, Virgil Mathiowetz
This paper can help practitioners judge the quality of an RCT, and it can help the profession work toward the development of a cadre of qualified researchers who can adapt the well-established methods of RCTs to the study of occupation-based interventions.
Journal of Experimental CriminologyAre criminologists describing randomized controlled trials in ways that allow us to assess them? Findings from a sample of crime and justice trials
45 Citations2010Amanda Perry, David Weisburd +1 more
British Educational Research JournalA comparison of randomised controlled trials in health and education
35 Citations2005Carole Torgerson, David Torgerson +2 more
Poor quality of trial reporting is more prevalent in educational journals than in health care journals, according to a methodological comparison between health care and educational trials published since 1990.
Addictive BehaviorsImproving the quality of reporting alcohol outcome studies: Effects of the CONSORT statement
33 Citations2010Benjamin O. Ladd, Barbara S. McCrady +2 more
Overall results suggested a non-significant trend for more improvement over time in the quality of reporting for adopter compared to non-adopter journals, but comparison of effects sizes suggested that specific areas of reporting did significantly improve for the adopter journals.
Journal of Experimental CriminologyApplying the Consolidated Standards of Reporting Trials (CONSORT) to studies of mental health provision for juvenile offenders: a research note
32 Citations2008Amanda Perry, Mathew Johnson
The findings showed that some items were fully endorsed whereas other items were not presented in any of the trials, and the overall reporting standard for this sample of trials was, therefore, mixed.
American Journal of Occupational TherapyEvaluating the Quality of Reporting Occupational Therapy Randomized Controlled Trials by Expanding the CONSORT Criteria
31 Citations2006Emily Moberg-Mogren, David L. Nelson
The Nelson-Moberg Expanded CONSORT Instrument shows promise in evaluating the quality of RCTs, given refinements to some items, and the field of occupational therapy needs increased sophistication in conducting and reporting R CTs.
Journal of Epidemiology & Community HealthPublic health evaluation: which designs work, for whom and under what circumstances?
27 Citations2011Laurence Moore, Gary F. Moore
The paper by Bonell and colleagues and its companion paper by Cousens and colleagues provide welcome contributions to this debate, by seeking to delineate circumstances in which RCTs may not be possible and describing various analytical approaches to compensate for the lack of randomisation.
Journal of Experimental CriminologyMissing links: how descriptive validity impacts the policy relevance of randomized controlled trials in criminology
26 Citations2011Charlotte Gill
PubMedEvaluating implementation fidelity in health information technology interventions.
8 Citations2007Eric L. Eisenstein, David F. Lobach +3 more
A framework for evaluation of implementation fidelity that considers health information technologies as complex interventions and makes use of common intervention components as defined in the Oxford Implementation Index is developed.
International Journal of SurgeryWITHDRAWN: Methods and processes of the CONSORT group: Example of an extension for trials assessing nonpharmacologic treatments
3 Citations2010Isabelle Boutron, David Moher +3 more