Evidence Synthesis

Systematic Review

Reviewed byShrishti Chaudhary

Definition

A systematic review is a rigorous, transparent, and reproducible research method that identifies, evaluates, and synthesizes all available evidence relevant to a clearly formulated research question.[1] Unlike traditional narrative reviews, which may selectively cite literature, a systematic review follows a predefined protocol that specifies the search strategy, inclusion and exclusion criteria, data extraction procedures, quality assessment methods, and approach to evidence synthesis.[1] The methodology is designed to minimize bias at every stage of the review process, producing a comprehensive and balanced summary of what is known about a particular topic. Systematic reviews may or may not include a meta analysis depending on whether the included studies are sufficiently homogeneous for statistical pooling.[1][2]

Explore the concept

A safeguard at every station

Step through an insomnia review station by station to see what each stage guards against, then cut every corner and watch the safeguards fail.

CBT for chronic insomnia in adults

Question and protocol

Guards against

Changing the plan after seeing the results

Question and protocol

The team states a focused PICO question and registers the protocol, so eligibility criteria and outcomes cannot quietly shift later.

The big idea: A systematic review follows a predefined protocol and puts a safeguard against bias at every stage: a registered plan, a comprehensive search, independent dual screening and extraction, risk of bias assessment and a synthesis matched to the studies. Remove the safeguards and it can look the same while giving a biased answer.

The insomnia review and its figures are the article's example (PROSPERO registration, six databases, 4,200 records, 42 trials with 3,800 participants, RoB 2, 38 trials pooled on the PSQI, SMD 1.09 with 95% CI 0.89 to 1.29, GRADE moderate). The shortcuts under 'Cut every corner' are the common mistakes the article lists, shown together for contrast; they are not from that review. The 'Which review?' view follows the article's guidance on when a rapid or a scoping review fits instead.

Why it matters

Systematic reviews sit at the top of most evidence hierarchies because they synthesize the totality of available evidence rather than relying on individual studies, which may produce conflicting results due to differences in design, population, or context. Clinicians, policymakers, and guideline developers depend on systematic reviews to make informed decisions. By using explicit and reproducible methods, systematic reviews allow other researchers to verify the conclusions, update the review as new evidence emerges, and identify gaps in the existing literature. The transparency of the process also makes it possible to assess whether the review itself is at risk of bias, something that is difficult with traditional narrative reviews.

How it works

The systematic review process begins with the formulation of a focused research question, often structured using frameworks such as PICO (Population, Intervention, Comparator, Outcome).[1] A protocol is developed and ideally registered in a public repository such as PROSPERO, specifying all methodological decisions before the review begins. The search strategy involves multiple electronic databases (such as PubMed, Embase, CINAHL, and the Cochrane Library), supplemented by hand searching reference lists, contacting experts, and searching grey literature sources to minimize publication bias. Two or more independent reviewers screen titles and abstracts, then full texts, against predetermined eligibility criteria, resolving disagreements through discussion or a third reviewer.[1] Data extraction follows a standardized form, and the risk of bias in each included study is assessed using established tools such as RoB 2 for randomized trials[4] and ROBINS-I for non randomized studies of interventions (the Newcastle Ottawa Scale is also widely used for observational studies, although its validity has been questioned).[6] Results are synthesized either quantitatively through meta analysis or without meta analysis using structured synthesis methods, reported with the SWiM (Synthesis Without Meta analysis) guideline, depending on the heterogeneity of the included studies.[5][2]

When to use it

Conduct a systematic review when you need a comprehensive and unbiased summary of evidence to answer a specific research question, inform clinical guidelines, identify research gaps, or support policy decisions. Systematic reviews are appropriate when multiple primary studies exist on a topic and when the question is sufficiently focused to define clear eligibility criteria. They are particularly valuable before launching a new primary study, to ensure that the question has not already been answered and to inform the design of the new study. A rapid review is an alternative when time is limited, but it involves methodological compromises that should be explicitly stated; a scoping review serves a different purpose, mapping a broad field rather than answering a focused question.

Key takeaways

  • Systematic reviews sit at the top of most evidence hierarchies because they synthesize the totality of available evidence rather than relying on individual studies, which may produce conflicting results due to differences in design, population, or context.
  • A protocol is developed and ideally registered in a public repository such as PROSPERO, specifying all methodological decisions before the review begins.
  • Conduct a systematic review when you need a comprehensive and unbiased summary of evidence to answer a specific research question, inform clinical guidelines, identify research gaps, or support policy decisions.
  • A common error is conducting a search that is not comprehensive enough, relying on a single database or failing to search for unpublished studies.

Common mistakes

  • A common error is conducting a search that is not comprehensive enough, relying on a single database or failing to search for unpublished studies. This introduces selection bias and may produce conclusions that overestimate treatment effects.
  • Another mistake is failing to register the protocol, which allows post hoc changes to eligibility criteria or outcomes that can bias the review toward desired conclusions.
  • Using only one reviewer for screening or data extraction compromises reliability.[1] Inappropriate meta analysis of highly heterogeneous studies produces a misleading pooled estimate, while failing to assess the risk of publication bias leaves a major threat to validity unexamined (statistical tests for funnel plot asymmetry are generally used only when at least ten studies are pooled).[1]

Example

A team conducts a systematic review of cognitive behavioral therapy (CBT) for chronic insomnia in adults. They register their protocol in PROSPERO, search six databases using a strategy developed with a medical librarian, and screen 4,200 records. After applying inclusion criteria (randomized trials, adults over 18, CBT as the intervention, validated sleep outcome measures), 42 trials with 3,800 participants are included. Two reviewers independently extract data and assess risk of bias using the Cochrane RoB 2 tool. Meta analysis of 38 trials reporting the Pittsburgh Sleep Quality Index shows a standardized mean difference of 1.09 (95% CI: 0.89 to 1.29) favoring CBT over control conditions. Subgroup analyses explore delivery format (group versus individual), treatment duration, and control type. The GRADE assessment rates the overall evidence quality as moderate due to some concerns about blinding.[3] The review concludes that CBT is effective for chronic insomnia and identifies digital delivery as an area needing further research.

Test your understanding

5 questions that adapt as you go: answer two in a row correctly and they get harder.

Question 1 of 5

Scenario:

A team calls its review systematic but searches only PubMed and does not look for unpublished studies.

Question:

What is the main risk of this search?

Hardness: Interpret

Sources

  1. [1]Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al, editors. Cochrane Handbook for Systematic Reviews of Interventions, version 6.5 (updated August 2024). Cochrane, 2024. https://training.cochrane.org/handbook/current
  2. [2]Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to Meta-Analysis. 2nd ed. Wiley, 2021. ISBN 9781119558354
  3. [3]Guyatt GH, Oxman AD, Vist GE, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924-926. doi:10.1136/bmj.39489.470347.AD
  4. [4]Sterne JAC, Savović J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366:l4898. doi:10.1136/bmj.l4898
  5. [5]Campbell M, McKenzie JE, Sowden A, et al. Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline. BMJ. 2020;368:l6890. doi:10.1136/bmj.l6890
  6. [6]Stang A. Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses. European Journal of Epidemiology. 2010;25(9):603-605. doi:10.1007/s10654-010-9491-z

Cite this term

FullPaperguide. (2026, October 16). Systematic Review. In Paperguide Research Glossary. https://paperguide.ai/research-glossary/systematic-review/
In-text(Paperguide, 2026)

Related terms