Comparison of evidence on harms of medical interventions in randomized and nonrandomized studies
Canadian Medical Association JournalPublished 27 February 2006Open access
Panagiotis N. Papanikolaou
Citations230
SJR quartileQ1
SJR score0.92
SNIP1.00
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Evidence from randomized trials is compared with that from epidemiologic studies to determine whether they give different estimates of risk for important harms of medical interventions, and nonrandomized studies are often conservative in estimating absolute risks of harms.
Abstract
Nonrandomized studies are often conservative in estimating absolute risks of harms. It would be useful to compare and scrutinize the evidence on harms obtained from both randomized and nonrandomized studies.
Keywords
Decision SciencesEconomics, Econometrics and FinancePharmacology, Toxicology and Pharmaceutics
CHANCEWhy Most Published Research Findings Are False
4,827 Citations2005John P. A. Ioannidis
Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true.
New England Journal of MedicineRandomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
3,474 Citations2000John Concato, Nirav R. Shah +1 more
The results of well-designed observational studies (with either a cohort or a case-control design) do not systematically overestimate the magnitude of the effects of treatment as compared with those in randomized, controlled trials on the same topic.
The LancetAdverse drug reactions: definitions, diagnosis, and management
2,972 Citations2000I. Ralph Edwards, Jeffrey K Aronson
An adverse drug reaction is an appreciably harmful or unpleasant reaction, resulting from an intervention related to the use of a medicinal product, which predicts hazard from future administration and warrants prevention or specific treatment, or alteration of the dosage regimen, or withdrawal of the product.
Annals of Internal MedicineQuantitative Synthesis in Systematic Reviews
2,477 Citations1997Joseph T. F. Lau, John P.A. Ioannidis +1 more
A stepwise description of the tasks that are performed when statistical methods are used to combine data and the question, Are the results of the different studies similar (homogeneous)?
New England Journal of MedicineA Comparison of Observational Studies and Randomized, Controlled Trials
2,352 Citations2000Kjell Benson, Arthur J. Hartz
Little evidence is found that estimates of treatment effects in observational studies reported after 1984 are either consistently larger than or qualitatively different from those obtained in randomized, controlled trials.
BMJThe number needed to treat: a clinically useful measure of treatment effect
1,872 Citations1995Richard J. Cook, D L Sackett
The relative benefit of an active treatment over a control is usually expressed as the relative risk, the Relative risk reduction, or the odds ratio, but for clinical decision making, it is more meaningful to use the measure "number needed to treat."
Annals of Internal MedicineBetter Reporting of Harms in Randomized Trials: An Extension of the CONSORT Statement
1,522 Citations2004John P. A. Ioannidis, Stephen J.W. Evans +6 more
This work searched MEDLINE, EMBASE, Web of Science, and the Cochrane Library using a wide array of terms related to harms and identified pertinent evidence and made recommendations on the appropriate reporting of harms in RCTs.
JAMAContradicted and Initially Stronger Effects in Highly Cited Clinical Research
1,457 Citations2005John P. A. Ioannidis
Contradiction and initially stronger effects are not unusual in highly cited research of clinical interventions and their outcomes, but the extent to which high citations may provoke contradictions and vice versa needs more study.
New England Journal of MedicineDiscrepancies between Meta-Analyses and Subsequent Large Randomized, Controlled Trials
1,184 Citations1997Jacques LeLorier, Geneviève Grégoire +3 more
The outcomes of the 12 large randomized, controlled trials that were studied were not predicted accurately 35 percent of the time by the meta-analyses published previously on the same topics.
JAMATiming of New Black Box Warnings and Withdrawals for Prescription Medications
1,004 Citations2002Karen E. Lasser
To determine the frequency and timing of discovery of new ADRs described in black box warnings or necessitating withdrawal of the drug from the market, Examination of the Physicians' Desk Reference for all new chemical entities approved by the US Food and Drug Administration between 1975 and 1999 is examined.
JAMAComparison of Evidence of Treatment Effects in Randomized and Nonrandomized Studies
897 Citations2001John P. A. Ioannidis
Despite good correlation between randomized trials and nonrandomized studies-in particular, prospective studies-discrepancies beyond chance do occur and differences in estimated magnitude of treatment effect are very common.
Obesity FactsThe Ethics of Childhood Obesity Treatment - from the Childhood Obesity Task Force (COTF) of European Association for the Study of Obesity (EASO)
593 Citations2014Jens‐Christian Holm, Paulina Nowicka +5 more
This paper aims to demonstrate the efforts towards in-situ applicability of EMMARM, as to provide real-time information about the physical and emotional impacts of EMTs on the immune system.
New England Journal of MedicineFailing the Public Health — Rofecoxib, Merck, and the FDA
589 Citations2004Eric J. Topol
On September 30, 2004, after more than 80 million patients had taken rofecoxib and annual sales had topped $2.5 billion, the company withdrew the drug because of an excess risk of myocardial infarctions and strokes.
PubMedCompleteness of safety reporting in randomized trials: an evaluation of 7 medical areas.
568 Citations2001John P. A. Ioannidis, Joseph Lau
Current standards for safety reporting in randomized trials should be revised to address this inadequacy, as generalizable data on drug safety reporting are sparse and largely inadequate.
The LancetCOX-2 selective non-steroidal anti-inflammatory drugs and risk of serious coronary heart disease
508 Citations2002Wayne A. Ray, Christoph Stein +4 more
A retrospective cohort study of individuals on the expanded Tennessee Medicaid programme (TennCare), in which occurrence of serious coronary heart disease (CHD) in non-users and in users of rofecoxib and other NSAIDs is assessed.
JAMAHepatotoxicity Associated With Isoniazid Preventive Therapy
463 Citations1999Charles M. Nolan, Stefan Goldberg +1 more
The rate of isoniazid hepatotoxicity during clinically monitored preventive therapy was lower than has been reported previously and Clinicians should have greater confidence in the safety of isonianzid preventive therapy.
American Journal of OphthalmologyA comparison of observational studies and randomized, controlled trials
459 Citations2000Kjell Benson, Arthur J. Hartz
Little evidence is found that estimates of treatment effects in observational studies reported after 1984 are either consistently larger than or qualitatively different from those obtained in randomized, controlled trials.
JAMALarge Trials vs Meta-analysis of Smaller Trials
342 Citations1996Joseph C. Cappelleri
Results of smaller studies are usually compatible with the results of large studies, but discrepancies do occur even when the diversity among both large studies and smaller studies is considered.
Archives of Internal MedicineConcurrent Use of Nonsteroidal Anti-inflammatory Drugs and Oral Anticoagulants Places Elderly Persons at High Risk for Hemorrhagic Peptic Ulcer Disease
319 Citations1993Ronald I. Shorr
The nearly 13-fold increase in the risk of developing hemorrhagic peptic ulcer disease in concurrent users of oral anticoagulants and NSAIDs suggests that NSAIDs should be prescribed with extreme caution in patients undergoing anticoageulation therapy.
Archives of Internal MedicineEffect of Selective Cyclooxygenase 2 Inhibitors and Naproxen on Short-term Risk of Acute Myocardial Infarction in the Elderly
284 Citations2003Muhammad Mamdani, Paula A. Rochon +6 more
The findings of this observational study suggest no increase in the short-term risk of AMI among users of selective cyclooxygenase 2 inhibitors as commonly used in clinical practice and do not support a short- term reduced risk ofAMI with naproxen.
JAMAIssues in Comparisons Between Meta-analyses and Large Trials
253 Citations1998John P. A. Ioannidis
To evaluate protocols comparing meta-analyses and large trials in order to understand if and why they disagree on the concordance of these 2 clinical research methods, systematic comparison of protocol designs, study selection, definitions of agreement, analysis methods, and reported discrepancies are evaluated.
British journal of surgeryGroin hernia repair in Scotland
207 Citations2000Alan Hair, K Duffy +6 more
The aim of this study was to survey the methods of groin hernia repair in Scotland and to assess patient satisfaction with the operation.
PEDIATRICSDecrease in Hospital Admissions for Febrile Seizures and Reports of Hypotonic-Hyporesponsive Episodes Presenting to Hospital Emergency Departments Since Switching to Acellular Pertussis Vaccine in Canada: A Report From IMPACT
112 Citations2003Nicole Le Saux, Nicholas Barrowman +5 more
The risks of febrile seizures and HHEs after pertussis-containing vaccine declined significantly with the introduction of acellular pertussi vaccine in Canada.
Research EthicsRandomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
109 Citations2017John Concato, Nirav N. Shah +1 more
The LancetFolic acid supplements during pregnancy and risk of miscarriage
108 Citations2001Jacqueline Gindler, Zhu Li +9 more
No evidence is found that daily consumption of 400 microg of folic acid before and during early pregnancy influenced a woman's risk for miscarriage, and the distributions of gestational age at pregnancy diagnosis and at miscarriage were similar for both groups of women.
Journal of the American Geriatrics SocietyRisk Factors for Hospitalized Gastrointestinal Bleeding Among Older Persons
106 Citations2001Robert C. Kaplan, Susan R. Heckbert +6 more
Estimation of the incidence of hospitalization for upper and lower gastrointestinal bleeding among older persons and to identify independent risk factors is sought.
BMJAny casualties in the clash of randomised and observational evidence?
106 Citations2001John P. A. Ioannidis, Anna-Bettina Haidich +1 more
In contrast to the belief that randomised controlled trials are more reliable estimators of how much a treatment works, both reports found that observational studies did not overestimate the size of the treatment effect compared with their randomised counterparts.
Drug SafetyImproving Safety Reporting from Randomised Trials
100 Citations2002John P. A. Ioannidis, Joseph Lau
The use of standardised scales for adverse effects is a prerequisite for improved reporting on safety in randomised trials and electronic publication, publication of raw databases, large database research, meta-analytic approaches, and prospective registration of clinical trials and of their databases may further improve the safety insights the authors can gain from randomised clinical trials.
PubMedThe safety of acellular pertussis vaccine vs whole-cell pertussis vaccine. A postmarketing assessment.
100 Citations1996Steven J. Rosenthal, R Chen +1 more
Analysis of postmarketing vaccine adverse event data from the Vaccine Adverse Event Reporting System confirmed that minor adverse events are less frequent after administration of the acellular pertussis vaccine and suggested that seizures and hospitalizations associated with pertuss is less frequent in age groups for which it is now recommended.
New England Journal of MedicineThe Discovery of Drug-Induced Illness
97 Citations1977Hershel Jick
The increased use of drugs (and the concurrent increased risks of drug-induced illness) require definition of relevant research areas and strategy, and systematic evaluations, especially case-referent studies are needed.
StrokeProspective Study of Aspirin Use and Risk of Stroke in Women
95 Citations1999Hiroyasu Iso, Charles H. Hennekens +6 more
It is indicated that women who take 1 to 6 aspirin per week have a reduced risk of large-artery occlusive infarction, but those who use 15 or more aspirinper week have an increased risk of subarachnoid hemorrhage.
SurgeryLaparoscopic appendectomy in the elderly
91 Citations2004Ulrich Güller, Nitin B. Jain +4 more
LA has statistically significant advantages over OA with respect to the length of hospital stay, the rate of routine discharge, and postoperative morbidity and mortality rates for patients who are less than 65 years old, in elderly patients, and in patients with appendiceal abscess or perforation.
Thrombosis and HaemostasisHospitalisation for Upper Gastrointestinal Bleeding Associated with Use of Oral Anticoagulants
86 Citations2001Henrik Toft Sørensen, Lene Mellemkjøer +5 more
It is indicated that use of OA is associated with a significantly increased risk of upper GI bleeding, with still higher risks associated with the concomitant use of other medications including acetaminophen.
PubMedFatal isoniazid-induced hepatitis. Its risk during chemoprophylaxis.
85 Citations1993Shelley R. Salpeter
The rate of fatal isoniazid-induced hepatitis during chemoprophylaxis that is done according to current monitoring guidelines is significantly lower than was previously estimated and should be used to reevaluate the benefit of preventive therapy for tuberculin-reactive patients older than 35.
Journal of Neurology Neurosurgery & PsychiatryAnticoagulant treatment as a risk factor for primary intracerebral haemorrhage.
83 Citations1992R Fogelholm, Katri Eskola +2 more
The case fatality rate during the first week and the mortality during follow up of 32 months were slightly higher, and the functional outcome slightly worse in the anticoagulated group, than in the other groups.
Twin ResearchUse of Multivitamins and Folic Acid in Early Pregnancy and Multiple Births in Sweden
81 Citations2001A Ericson, Bëngt Källén +1 more
If this association is causal, wide-spread supplementation with folic acid may represent a hazard larger than the postulated beneficial effect on neural tube defects, at least in low-risk areas.
The LancetFolic acid supplements during early pregnancy and likelihood of multiple births: a population-based cohort study
79 Citations2003Zhu Li, Jacqueline Gindler +7 more
The findings suggest that consumption of folic acid supplements during pregnancy is not associated with an increased occurrence of multiple births.
The LancetDRUG-INDUCED GASTROINTESTINAL BLEEDING
79 Citations1978Hershel Jick, Jane Porter
Heparin, warfarin, ethacrynic acid, steroids, and aspirin-containing drugs were associated with gastrointestinal bleeding and were estimated to account for about two-thirds of such bleeds.
The American Journal of MedicineAvailability of large-scale evidence on specific harms from systematic reviews of randomized trials
75 Citations2004Panagiotis N. Papanikolaou, John P. A. Ioannidis
To assess how frequently systematic reviews of randomized controlled trials convey large-scale evidence on specific, well-defined adverse events, the Cochrane Database of Systematic Reviews was searched.
Journal of Internal MedicineRisk of haemorrhagic stroke in patients with oral anticoagulation compared with the general population
56 Citations2003Anders Själander, Gunnar Engström +2 more
Risk of haemorrhagic stroke in patients with oral anticoagulation compared with the general population is higher than in the generalpopulation, according to the authors.
BMJBenefits and harms of drug treatments
53 Citations2004Jan P. Vandenbroucke
Observational studies and randomised trials should learn from each other to improve the quality of research and reduce the amount of uncertainty in clinical practice.
Archives of Internal MedicineConcurrent use of nonsteroidal anti-inflammatory drugs and oral anticoagulants places elderly persons at high risk for hemorrhagic peptic ulcer disease
50 Citations1993R. I. Shorr
American Journal of Medical GeneticsMultivitamin supplementation and multiple births
50 Citations1997Martha M. Werler, Janet D. Cragan +4 more
The study findings are tentative, due to a lack of consistency across all five datasets and they should not alter recent recommendations related to folate supplementation for the prevention of neural tube defects.
Journal of Clinical EpidemiologyDiscrepancies among megatrials
49 Citations2000Toshi A. Furukawa, David L. Streiner +1 more
The findings suggest that taking megatrials as the gold standard can be problematic and that there is no substitute for clear and hard thinking for any study, be it a meta-analysis or a megatrial.
StrokeAspirin Use and Incident Stroke in the Cardiovascular Health Study
49 Citations1998R. A. Kronmal, Robert G. Hart +4 more
Aspirin use was associated with increased risks of ischemic stroke in women and hemorrhagic stroke overall in this elderly cohort, after adjustment for other stroke predictors.
StrokeEffect of Antiplatelet and Anticoagulant Agents on Risk of Hospitalization for Bleeding Among a Population of Elderly Nursing Home Stroke Survivors
44 Citations2001Brian J. Quilliam, Kate L. Lapane +2 more
The risk associated with use of antiplatelet and anticoagulant agents among an elderly nursing home population is small and the numbers needed to treat to harm 1 resident with aspirin and warfarin were 467 and 126, respectively.
Brain and DevelopmentAn evaluation of serious neurological disorders following immunization: a comparison of whole-cell pertussis and acellular pertussis vaccines
36 Citations2003David A. Geier, Mark R. Geier
The results, and conclusions by the US Institute of Medicine, suggest an association between serious neurological disorders and whole-cell pertussis immunization and the Japanese and US switch to using acellular pertussi vaccine seems well justified.
The American Journal of CardiologyBleeding risk of platelet glycoprotein IIb/IIIa receptor antagonists in broad-based practice (results from the Society for Cardiac Angiography and Interventions Registry)
30 Citations2003Phillip A. Horwitz, Jesse A. Berlin +4 more
Digestive SurgeryProspective Multicenter Study of Antibiotic Prophylaxis in Operative Treatment of Appendicitis
17 Citations2000A. Koch, R. Zippel +4 more
It is deduced that conventional appendectomy with antibiotic prophylaxis comprises no higher risk of wound infection than laparoscopy, since the risk of conversion exists for every operation begun by laparoscope, which would lead to the conclusion that antibiotic proPHylaxis should be given before every appendectomy, whether by lapARoscopy or conventional methods.
Twin ResearchUse of Multivitamins and Folic Acid in Early Pregnancy and Multiple Births in Sweden
6 Citations2001A Ericson, Bëngt Källén +1 more
If this association is causal, wide-spread supplementation with folic acid may represent a hazard larger than the postulated beneficial effect on neural tube defects, at least in low-risk areas.
American Journal of Medical GeneticsMultivitamin supplementation and multiple births
4 Citations1997Martha M. Werler, Janet D. Cragan +4 more