Comment on “Estimating the reproducibility of psychological science”
SciencePublished 3 March 2016
Daniel T. Gilbert, Gary King, Stephen Pettigrew, Timothy D. Wilson
Citations500
SJR quartileQ1
SJR score10.42
SNIP6.62
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
It is shown that this article contains three statistical errors and provides no support for the conclusion that the reproducibility of psychological science is surprisingly low, and that the data are consistent with the opposite conclusion.
Abstract
A paper from the Open Science Collaboration (Research Articles, 28 August 2015, aac4716) attempting to replicate 100 published studies suggests that the reproducibility of psychological science is surprisingly low. We show that this article contains three statistical errors and provides no support for such a conclusion. Indeed, the data are consistent with the opposite conclusion, namely, that the reproducibility of psychological science is quite high.
Keywords
PsychologyDecision Sciences
ScienceEstimating the reproducibility of psychological science
8,673 Citations2015Alexander A. Aarts
A large-scale assessment suggests that experimental reproducibility in psychology leaves a lot to be desired, and correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.
Psychological ScienceFalse-Positive Psychology
6,712 Citations2011Joseph P. Simmons, Leif D. Nelson +1 more
It is shown that despite empirical psychologists’ nominal endorsement of a low rate of false-positive findings, flexibility in data collection, analysis, and reporting dramatically increases actual false- positive rates, and a simple, low-cost, and straightforwardly effective disclosure-based solution is suggested.
Social PsychologyInvestigating Variation in Replicability
1,253 Citations2014Richard Klein, Kate A. Ratliff +49 more
Journal of Personality and Social PsychologyA needs-based model of reconciliation: Satisfying the differential emotional needs of victim and perpetrator as a key to promoting reconciliation.
609 Citations2008Nurit Shnabel, Arie Nadler
A needs-based model of reconciliation is developed that posits that being a victim is associated with a threat to one's status and power, whereas being a perpetrator threatens one's image as moral and socially acceptable and a social exchange interaction in which these threats are removed should enhance the parties' willingness to reconcile.
Journal of Personality and Social PsychologyWhy do implicit and explicit attitude tests diverge? The role of structural fit.
379 Citations2008B. Keith Payne, Melissa Burkley +1 more
The authors examined in 4 studies whether correlations between implicit and explicit tests were influenced by the similarity in task demands and, hence, the processes engaged by each test, and proposed a solution that uses procedures to maximize structural fit.
Psychological ScienceDetecting the Snake in the Grass
377 Citations2008Vanessa LoBue, Judy S. DeLoache
Evidence is reported of enhanced visual detection of evolutionarily relevant threat stimuli in young children using an array of eight distractors to detect snakes in the presence of other kinds of visual stimuli.
Psychological ScienceToward a Physiology of Dual-Process Reasoning and Judgment: Lemonade, Willpower, and Expensive Rule-Based Analysis
331 Citations2008E. J. Masicampo, Roy F. Baumeister
This experiment used the attraction effect to test the hypothesis that ingestion of sugar can reduce reliance on intuitive, heuristic-based decision making and found that the effect increases when people have depleted their mental resources performing a previous self-control task.
Journal of Personality and Social PsychologyDynamics of self-regulation: How (un)accomplished goal actions affect motivation.
292 Citations2008Minjung Koo, Ayelet Fishbach
4 studies show that emphasizing to-date information increases goal adherence when commitment is uncertain--that is, when participants study for a relatively unimportant exam, consume luxuries, fulfill a desire, and make first-time contributions to a charity.
Journal of Personality and Social PsychologyWhy people are reluctant to tempt fate.
134 Citations2008Jane L. Risen, Thomas Gilovich
The present research explored the belief that it is bad luck to "tempt fate" and demonstrated that people do indeed have the intuition that actions that tempt fate increase the likelihood of negative outcomes.
Replication Data for: Comment on “Estimating the reproducibility of psychological science.”
1 Citations2016Daniel King Gilbert, King, Gary +2 more