Approaching a fair deal for significance and other concerns
Journal of Experimental Social PsychologyPublished 23 January 2016Open access
Roger Giner‐Sorolla
Citations43
SJR quartileQ1
SJR score2.06
SNIP1.68
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Inaugural editorial for JESP addressing new standards at the journal and the question of statistical evidence.
Keywords
PsychologySocial SciencesDecision Sciences
CHANCEWhy Most Published Research Findings Are False
4,827 Citations2005John P. A. Ioannidis
Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true.
Occupational Therapy In Health CarePublication Manual of the American Psychological Association
3,198 Citations2011Kate E. DeCleene, Jennifer Fogo
Journal of Personality and Social PsychologyEstablishing a causal chain: Why experiments are often more effective than mediational analyses in examining psychological processes.
2,412 Citations2005Steven J. Spencer, Mark P. Zanna +1 more
It is argued that when it is easy to manipulate and measure a proposed psychological process that a series of experiments that demonstrates the proposed causal chain is superior, and that designs that examine underlying process by utilizing moderation can be effective.
Personality and Social Psychology ReviewHARKing: Hypothesizing After the Results are Known
2,058 Citations1998Norbert L. Kerr
It is conceded that the question of whether HARKing's costs exceed its benefits is a complex one that ought to be addressed through research, open discussion, and debate.
Review of General PsychologyOne Hundred Years of Social Psychology Quantitatively Described
1,599 Citations2003F Richard, Charles F. Bond +1 more
Journal of Experimental Psychology GeneralP-curve: A key to the file-drawer.
1,398 Citations2013Uri Simonsohn, Leif D. Nelson +1 more
By telling us whether the authors can rule out selective reporting as the sole explanation for a set of findings, p-curve offers a solution to the age-old inferential problems caused by file-drawers of failed studies and analyses.
Journal of Personality and Social PsychologyTreating stimuli as a random factor in social psychology: A new and comprehensive solution to a pervasive but largely ignored problem.
1,224 Citations2012Charles M. Judd, Jacob Westfall +1 more
The substantial biases inherent in analyses that ignore one or the other of the random factors are shown, and the substantial advantages of the mixed models approach are illustrated with both hypothetical and actual, well-known data sets in social psychology.
Psychological BulletinA justification-suppression model of the expression and experience of prejudice.
1,086 Citations2003Christian S. Crandall, Amy Eshleman
A justification-suppression model is proposed, which characterizes the processes that lead to prejudice expression and the experience of one's own prejudice, and suggests that "genuine" prejudices are not directly expressed but are restrained by beliefs, values, and norms that suppress them.
Psychological BulletinA variance explanation paradox: When a little is a lot.
1,008 Citations1985Robert P. Abelson
Philosophy of ScienceTheory-Testing in Psychology and Physics: A Methodological Paradox
992 Citations1967Paul E. Meehl
Perspectives on Psychological ScienceThe Rules of the Game Called Psychological Science
853 Citations2012Marjan Bakker, Annette van Dijk +1 more
This paper considers 13 meta-analyses covering 281 primary studies in various fields of psychology and finds indications of biases and/or an excess of significant results in seven, highlighting the need for sufficiently powerful replications and changes in journal policies.
Journal of Experimental Social PsychologyThe Replication Recipe: What makes for a convincing replication?
704 Citations2013Mark J. Brandt, Hans IJzerman +8 more
Journal of Experimental Social PsychologyWhat mediation analysis can (not) do
605 Citations2011Klaus Fiedler, Malte Schott +1 more
European Journal of Social PsychologyPerforming high‐powered studies efficiently with sequential analyses
455 Citations2014Daniël Lakens
Psychological MethodsResearchers Misunderstand Confidence Intervals and Standard Error Bars.
399 Citations2005Sarah. Belia, Fiona Fidler +2 more
Results suggest that many leading researchers have severe misconceptions about how error bars relate to statistical significance, do not adequately distinguish CIs and SE bars, and do not appreciate the importance of whether the 2 means are independent or come from a repeated measures design.
Journal of the American Statistical AssociationThe Fisher, Neyman-Pearson Theories of Testing Hypotheses: One Theory or Two?
312 Citations1993E. L. Lehmann
Annales Zoologici FenniciFinal Collapse of the Neyman-Pearson Decision Theoretic Framework and Rise of the neoFisherian
304 Citations2009Stuart H. Hurlbert, Celia M. Lombardi
BiometricsThe Behavior of the P-Value When the Alternative Hypothesis is True
290 Citations1997Hung Hung, Robert T. O’Neill +2 more
Potential applications of the P-value distribution under the alternative hypothesis to the design, analysis, and interpretation of results of clinical trials are considered.
Perspectives on Psychological ScienceA Short (Personal) Future History of Revolution 2.0
244 Citations2015Barbara A. Spellman
The Fisher, Neyman-Peerson Theories of Testing Hypotheses: One Theory or Two?
223 Citations2011E. L. Lehmann
Perspectives on Psychological ScienceExpectations for Replications
216 Citations2014David Stanley, Jeffrey S. Spence
It is suggested that researchers should adjust their expectations concerning replications and shift to a meta-analytic mind-set, given the large impact that even modest amounts of measurement error can have on observed associations.
Basic and Applied Social PsychologyReversing Arrows in Mediation Models Does Not Distinguish Plausible Models
200 Citations2015Felix Thoemmes
Journal of Experimental Social PsychologyConceptualizing and evaluating the replication of research results
174 Citations2015Leandre R. Fabrigar, Duane T. Wegener
Journal of the American Statistical AssociationA Simple Method of Multiple Comparisons of Means
174 Citations1978K. Ruben Gabriel
Review of General PsychologyFearing the Future of Empirical Psychology: Bem's (2011) Evidence of Psi as a Case Study of Deficiencies in Modal Research Practice
171 Citations2011Etienne P. LeBel, Kurt R. Peters
Journal of Experimental Social PsychologyThe “true” indirect effect won't (always) stand up: When and why reverse mediation testing fails
138 Citations2016Gunnar Lemmer, Mario Gollwitzer
Personality and Social Psychology ReviewResearch Practices That Can Prevent an Inflation of False-Positive Rates
132 Citations2013Kou Murayama, Reinhard Pekrun +1 more
It is argued that an inflation of false-positive rates would diminish, sometimes to a substantial degree, when researchers have explicit a priori theoretical hypotheses, include multiple replication studies in a single paper, and collect additional data based on observed results.
Journal of Experimental Psychology Generalp-hacking by post hoc selection with multiple opportunities: Detectability by skewness test?: Comment on Simonsohn, Nelson, and Simmons (2014).
86 Citations2015Rolf Ulrich, Jeff Miller
A novel test to detect p-hacking in research is suggested, that is, when researchers report excessive rates of "significant effects" that are truly false positives.
Frontiers in PsychologyConfidence intervals permit, but don’t guarantee, better inference than statistical significance testing
79 Citations2010Melissa Coulson
Improved statistical inference can result from encouragement of meta-analytic thinking and use of CIs but, for full benefit, such highly desirable statistical reform requires also that researchers interpret CIs without recourse to NHST.
Perspectives on Psychological ScienceShort, Sweet, and Problematic? The Rise of the Short Report in Psychological Science
72 Citations2012Alison Ledgerwood, Jeffrey W. Sherman
It is essential to find ways to preserve the advantages of the short-and-fast approach while minimizing its disadvantages and while acknowledging the complementary and critical importance of longer articles in advancing the field.
Journal of Experimental Social PsychologyThe morality of action: The asymmetry between judgments of praise and blame in the action–omission effect
65 Citations2015Dries H. Bostyn, Arne Roets
Columbia Academic Commons (Columbia University)Bayes, Jeffreys, Prior Distributions and the Philosophy of Statistics
56 Citations2009Andrew Gelman
Statistical ScienceBayes, Jeffreys, Prior Distributions and the Philosophy of Statistics
42 Citations2009Andrew Gelman
FigshareConfidence intervals permit, but do not guarantee, better inference than statistical significance testing
37 Citations2010Coulson, Melissa, Healey, Michelle +2 more
Psychological ScienceUnderstanding Data When Interactions Are Present or Hypothesized
32 Citations1996Richard E. Petty, Leandre R. Fabrigar +2 more
Utrecht University Repository (Utrecht University)Moving at snails pace: Some observations on the publication process in social and personality psychology
1 Citations2008Miles Hewstone, Wolfgang Stroebe