Evidence Synthesis

Evidence Synthesis

Reviewed byMallik Gaddam

Definition

Evidence synthesis is the process of systematically identifying, evaluating, and combining findings from multiple individual studies to draw broader, more reliable conclusions than any single study can provide. It encompasses a family of methods including systematic reviews, meta analyses, scoping reviews, rapid reviews, umbrella reviews, realist reviews, and qualitative evidence syntheses.[3][6] Each method addresses different types of questions and uses different techniques for identifying, appraising, and integrating evidence. Systematic reviews and meta analyses of well conducted studies are often placed at the top of traditional evidence hierarchies, and evidence syntheses provide the foundation for clinical guidelines, health policy decisions, and research priority setting.

Explore the concept

Many studies, one answer

Follow a review from 8,400 records to one pooled estimate and its certainty, split the result by program length, then match questions to the synthesis method that fits them.

School physical activity programs and childhood obesity (hypothetical)

1. Search

Search widely

A comprehensive search across many sources keeps relevant studies from being missed.

The big idea: Evidence synthesis systematically finds, appraises and combines the studies on a question to reach a more reliable conclusion than any single study. It is a family of methods: the question decides whether to pool, narrate, map or interpret, and the certainty of the result is rated, not assumed.

The worked example is the article's hypothetical review: 8,400 records from eight databases and two registries, 62 trials included, 48 pooled for BMI z score, mean difference βˆ’0.10 (95% CI βˆ’0.14 to βˆ’0.06), subgroups over 12 months βˆ’0.15 and shorter βˆ’0.06, GRADE moderate (downgraded for inconsistency). Methods, tools and reporting guidelines are those named in the article.

Why it matters

Individual studies, however well conducted, provide limited evidence. They are conducted in specific populations, settings, and time periods, and their results are subject to random error and systematic bias. Evidence synthesis addresses these limitations by bringing together evidence across studies, exploring sources of variation in results, and providing a comprehensive picture of what is known and unknown about a research question; when results can be pooled statistically in a meta analysis, it also increases statistical power and improves the precision of effect estimates. Clinical practice guidelines from organizations such as WHO, NICE, and professional societies are based on evidence syntheses. In the US, the FDA issued draft guidance in 2018 on how it evaluates meta analyses of randomized trials used to assess the safety of drugs and biological products. Research funders use evidence syntheses to identify gaps and set priorities. Without evidence synthesis, decision makers would face the impossible task of individually evaluating thousands of primary studies.

How it works

The evidence synthesis process varies by method but shares common elements. A clearly formulated question guides the entire process. A comprehensive search strategy, designed to minimize the risk of missing relevant studies, is conducted across multiple databases and supplementary sources. Studies are screened against predefined eligibility criteria, typically by two independent reviewers.[2] In systematic reviews, included studies are critically appraised for risk of bias using validated tools (such as the Cochrane Risk of Bias tool, RoB 2, for randomized trials, or QUADAS-2 and its successor QUADAS-3, published in February 2026, for diagnostic accuracy studies); scoping reviews, which map the evidence, often omit this step.[2][3][5]

Data are extracted from each study and organized for synthesis. In meta analysis, quantitative data are statistically combined to produce a pooled effect estimate, typically displayed in a forest plot.[1] The I squared statistic and Q test assess statistical heterogeneity.[1][2] Subgroup analyses and meta regression explore sources of variation.[1][2] Sensitivity analyses test the robustness of results to different assumptions and decisions.

When statistical pooling is not appropriate due to excessive heterogeneity or incompatible data, narrative synthesis organizes and interprets findings without pooling. Qualitative evidence synthesis methods, such as meta ethnography and thematic synthesis, integrate findings from qualitative studies using interpretive techniques.[4]

The certainty of the overall body of evidence is assessed using frameworks such as GRADE, which considers risk of bias, inconsistency, indirectness, imprecision, and publication bias.[2] The final report follows a reporting guideline (PRISMA 2020 for systematic reviews, PRISMA-ScR for scoping reviews, MOOSE for meta analyses of observational studies) that supports transparency and reproducibility.

When to use it

Evidence synthesis should be undertaken before conducting a new primary study, to determine what is already known and to identify genuine gaps in the evidence. It is essential for developing clinical guidelines, informing policy decisions, and prioritizing research funding. The choice of synthesis method depends on the question: meta analysis for quantitative pooling of intervention effects, diagnostic test accuracy review for diagnostic questions, qualitative evidence synthesis for understanding experiences and barriers, scoping reviews for mapping the evidence landscape, and rapid reviews when time constraints require an accelerated process. Evidence synthesis is not a substitute for primary research when no primary studies exist; it can only synthesize what has been studied.

Key takeaways

  • Individual studies, however well conducted, provide limited evidence.
  • A clearly formulated question guides the entire process.
  • Evidence synthesis should be undertaken before conducting a new primary study, to determine what is already known and to identify genuine gaps in the evidence.
  • A common error is conducting a meta analysis on studies that are too heterogeneous to be meaningfully combined, producing a pooled estimate that does not represent any real population.

Common mistakes

  • A common error is conducting a meta analysis on studies that are too heterogeneous to be meaningfully combined, producing a pooled estimate that does not represent any real population.[1][2]
  • Another mistake is equating evidence synthesis with meta analysis; many evidence synthesis questions are best addressed through narrative synthesis, qualitative synthesis, or framework based approaches.
  • Failing to search comprehensively (searching only one or two databases) risks missing relevant studies and biasing the synthesis.[2]
  • Using inappropriate quality assessment tools (such as applying a tool designed for RCTs to observational studies) produces invalid risk of bias assessments. Publishing an evidence synthesis without registering the protocol in advance (on PROSPERO or a similar registry) reduces transparency and invites suspicion of selective reporting.
  • Finally, some researchers conduct evidence syntheses without adequate methodological expertise, producing reviews that look comprehensive but contain systematic errors in search strategy, data extraction, or statistical analysis.

Example

In a hypothetical example, a review team synthesizes evidence on the effectiveness of school based physical activity programs for reducing childhood obesity. Their search across eight databases and two trial registries identifies 8,400 records, from which 62 cluster randomized and individually randomized trials meet inclusion criteria. Meta analysis of 48 trials reporting BMI z score shows a pooled mean difference of negative 0.10 (95% CI: negative 0.14 to negative 0.06) favoring the intervention. Subgroup analysis reveals that programs lasting more than 12 months produce larger effects (MD negative 0.15) than shorter programs (MD negative 0.06). GRADE assessment rates the certainty of evidence as moderate, downgraded for inconsistency. Findings like these can inform guidelines on physical activity promotion in schools.

Test your understanding

5 questions that adapt as you go: answer two in a row correctly and they get harder.

Question 1 of 5

Scenario:

In the article's hypothetical example, the pooled mean difference in BMI z score is βˆ’0.10. Programs lasting more than 12 months show a mean difference of βˆ’0.15; shorter programs show βˆ’0.06.

Question:

What does the subgroup analysis add?

Hardness: Interpret

Sources

  1. [1]Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to Meta-Analysis. 2nd ed. Wiley, 2021. ISBN 9781119558354
  2. [2]Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al, editors. Cochrane Handbook for Systematic Reviews of Interventions, version 6.5 (updated August 2024). Cochrane, 2024. https://training.cochrane.org/handbook/current
  3. [3]Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26(2):91-108. doi:10.1111/j.1471-1842.2009.00848.x
  4. [4]Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45. doi:10.1186/1471-2288-8-45
  5. [5]Whiting PF, Tomlinson E, Rutjes AWS, Davenport CF, Yang B, Westwood ME, et al. QUADAS-3: a revised tool for the quality assessment of diagnostic test accuracy studies. Ann Intern Med. 2026;179(4):548-555. doi:10.7326/ANNALS-25-02104
  6. [6]Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review: a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10(Suppl 1):21-34. doi:10.1258/1355819054308530

Cite this term

FullPaperguide. (2026, October 15). Evidence Synthesis. In Paperguide Research Glossary. https://paperguide.ai/research-glossary/evidence-synthesis/
In-text(Paperguide, 2026)

Related terms