Replication studies: Bad copy
NaturePublished 14 May 2012Open access
Ed Yong
Citations404
SJR quartileQ1
SJR score18.29
SNIP10.16
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
In the wake of high-profile controversies, psychologists are facing up to problems with replication and how to deal with them.
Abstract
In the wake of high-profile controversies, psychologists are facing up to problems with replication.
Keywords
PsychologyDecision SciencesNeuroscience
Psychological ScienceFalse-Positive Psychology
6,712 Citations2011Joseph P. Simmons, Leif D. Nelson +1 more
It is shown that despite empirical psychologists’ nominal endorsement of a low rate of false-positive findings, flexibility in data collection, analysis, and reporting dramatically increases actual false- positive rates, and a simple, low-cost, and straightforwardly effective disclosure-based solution is suggested.
CHANCEWhy Most Published Research Findings Are False
4,827 Citations2005John P. A. Ioannidis
Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true.
Journal of Personality and Social PsychologyAutomaticity of social behavior: Direct effects of trait construct and stereotype activation on action.
2,659 Citations1996John A. Bargh, Mark Chen +1 more
Psychological ScienceMeasuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
2,333 Citations2012Leslie K. John, George Loewenstein +1 more
It is found that the percentage of respondents who have engaged in questionable practices was surprisingly high, which suggests that some questionable practices may constitute the prevailing research norm.
ScientometricsNegative results are disappearing from most disciplines and countries
1,217 Citations2011Daniele Fanelli
Journal of the American Statistical AssociationPublication Decisions and their Possible Effects on Inferences Drawn from Tests of Significance—or Vice Versa
936 Citations1959T. D. Sterling
Journal of Personality and Social PsychologyFeeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect.
903 Citations2011J. Daryl
9 experiments are reported, involving more than 1,000 participants, that test for retroactive influence by "time-reversing" well-established psychological effects so that the individual's responses are obtained before the putatively causal stimulus events occur.
PLoS ONE“Positive” Results Increase Down the Hierarchy of the Sciences
750 Citations2010Daniele Fanelli
These results support the scientific status of the social sciences against claims that they are completely subjective, by showing that, when they adopt a scientific approach to discovery, they differ from the natural sciences only by a matter of degree.
PLoS ONEBehavioral Priming: It's All in the Mind, but Whose Mind?
667 Citations2012Stéphane Doyen, Olivier Klein +2 more
It is concluded that unconscious behavioral priming is real, while real, involves mechanisms different from those typically assumed to cause the effect.
Psychological ScienceWith a Clean Conscience
505 Citations2008Simone Schnall, Jennifer Benton +1 more
The findings support the idea that moral judgment can be driven by intuitive processes, rather than deliberate reasoning, and one of those intuitions appears to be physical purity, because it has a strong connection to moral purity.
The American StatisticianPublication Decisions Revisited: The Effect of the Outcome of Statistical Tests on the Decision to Publish and Vice Versa
458 Citations1995T. D. Sterling, W. L. Rosenbaum +1 more
Evidence that published results of scientific investigations are not a representative sample of results of all scientific studies is presented and practice leading to publication bias have not changed over a period of 30 years is indicated.
Psychological ScienceWeight as an Embodiment of Importance
398 Citations2009Nils B. Jostmann, Daniël Lakens +1 more
Findings suggest that, much as weight makes people invest more physical effort in dealing with concrete objects, it also makes people investment more cognitive effort in deals with abstract issues.
PLoS ONEFailing the Future: Three Unsuccessful Attempts to Replicate Bem's ‘Retroactive Facilitation of Recall’ Effect
190 Citations2012Stuart J. Ritchie, Richard Wiseman +1 more
Three pre-registered independent attempts to exactly replicate one of recently reported parapsychological experiments, ‘retroactive facilitation of recall’, which examines whether performance on a memory test can be influenced by a post-test exercise, failed to produce significant effects and thus do not support the existence of psychic ability.
ScienceCoping with Chaos: How Disordered Contexts Promote Stereotyping and Discrimination
52 Citations2011Diederik A. Stapel, Siegwart Lindenberg
It is shown that disordered contexts indeed promote stereotyping and discrimination in real-world situations and that it is a heightened need for structure that mediates these effects and has clear policy implications: diagnose environmental disorder early and intervene immediately.