How can preregistration contribute to research in our field?
Comprehensive Results in Social PsychologyPublished 24 July 2015
Kai J. Jonas, Joseph Cesario
Citations39
SJR quartileQ3
SJR score0.43
SNIP0.56
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Comprehensive Results in Social Psychology (CRSP) is a novel journal for preregistered research (so-called registered reports, RR) in the field of social psychology. It offers RR-only publications, with the possibility of adding exploratory analysis and data as well. After submission of introduction, hypotheses, methods, procedure, and analysis plan, submitted manuscripts are reviewed prior to data collection. If the peer review process results in a positive evaluation of the manuscript, an initial publication agreement (IPA) is issued upon which publication of the manuscript (given adherence to the registered protocol) independent of the obtained results is possible. CRSP seeks to complement the publication options in our field by making transparent confirmatory and exploratory research possible.
Keywords
PsychologyDecision SciencesEconomics, Econometrics and Finance
Psychological BulletinThe file drawer problem and tolerance for null results.
8,595 Citations1979Robert Rosenthal
Quantitative procedures for computing the tolerance for filed and future null results are reported and illustrated, and the implications are discussed.
Psychological ScienceFalse-Positive Psychology
6,712 Citations2011Joseph P. Simmons, Leif D. Nelson +1 more
It is shown that despite empirical psychologists’ nominal endorsement of a low rate of false-positive findings, flexibility in data collection, analysis, and reporting dramatically increases actual false- positive rates, and a simple, low-cost, and straightforwardly effective disclosure-based solution is suggested.
CHANCEWhy Most Published Research Findings Are False
4,827 Citations2005John P. A. Ioannidis
Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true.
Psychonomic Bulletin & ReviewA practical solution to the pervasive problems ofp values
2,547 Citations2007Eric‐Jan Wagenmakers
The BIC provides an approximation to a Bayesian hypothesis test, does not require the specification of priors, and can be easily calculated from SPSS output.
Journal of Clinical EpidemiologyPublication bias in meta-analysis its causes and consequences
1,254 Citations2000Alison J. Thornton
The design of the meta-analysis itself, and the studies included in it, are shown to be important among a number of sources of publication bias.
Perspectives on Psychological ScienceAn Agenda for Purely Confirmatory Research
1,136 Citations2012Eric‐Jan Wagenmakers, Ruud Wetzels +3 more
This article proposes that researchers preregister their studies and indicate in advance the analyses they intend to conduct, and proposes that only these analyses deserve the label “confirmatory,” and only for these analyses are the common statistical tests valid.
Perspectives on Psychological ScienceThe Rules of the Game Called Psychological Science
853 Citations2012Marjan Bakker, Annette van Dijk +1 more
This paper considers 13 meta-analyses covering 281 primary studies in various fields of psychology and finds indications of biases and/or an excess of significant results in seven, highlighting the need for sufficiently powerful replications and changes in journal policies.
Perspectives on Psychological ScienceReplications in Psychology Research
783 Citations2012Matthew C. Makel, Jonathan A. Plucker +1 more
It was found that the majority of replications in psychology journals reported similar findings to their original studies (i.e., they were successful replications), however, replications were significantly less likely to be successful when there was no overlap in authorship between the original and replicating articles.
PLoS ONE“Positive” Results Increase Down the Hierarchy of the Sciences
750 Citations2010Daniele Fanelli
These results support the scientific status of the social sciences against claims that they are completely subjective, by showing that, when they adopt a scientific approach to discovery, they differ from the natural sciences only by a matter of degree.
Perspectives on Psychological ScienceIs the Replicability Crisis Overblown? Three Arguments Examined
695 Citations2012Harold Pashler, Christine R. Harris
It is argued that there are no plausible concrete scenarios to back up such forecasts and that what is needed is not patience, but rather systematic reforms in scientific practice.
Controlled Clinical TrialsDo Certain Countries Produce Only Positive Results? A Systematic Review of Controlled Trials
677 Citations1998Andrew J. Vickers, Niraj Goyal +2 more
Research conducted in certain countries was uniformly favorable to acupuncture; all trials originating in China, Japan, Hong Kong, and Taiwan were positive, as were 10 out of 11 of those published in Russia/USSR.
Perspectives on Psychological ScienceThe Value of Direct Replication
644 Citations2014Daniel J. Simons
This commentary argues that direct replication by multiple laboratories is the only way to verify the reliability of an effect and questions the value of direct replicationby other laboratories are problematic.
CortexRegistered Reports: A new publishing initiative at Cortex
610 Citations2012Chris Chambers
You a r e a dvise d to cons ul t t h e p u blish e r’s ve r sion if you wish to ci t e t his p a p er.
SciencePromoting Transparency in Social Science Research
566 Citations2014Edward Miguel, Colin F. Camerer +17 more
There is growing appreciation for the advantages of experimentation in the social sciences, and changes have been particularly pronounced in development economics, where hundreds of randomized trials have been carried out over the last decade.
Psychological MethodsThe ironic effect of significant results on the credibility of multiple-study articles.
470 Citations2012Ulrich Schimmack
One major recommendation is to pay more attention to the power of studies to produce positive results without the help of questionable research practices and to request that authors justify sample sizes with a priori predictions of effect sizes.
Political AnalysisFishing, Commitment, and Communication: A Proposal for Comprehensive Nonbinding Research Registration
308 Citations2013Macartan Humphreys, Raúl Sierra +1 more
It is demonstrated here that even with this level of advanced specification, the scope for fishing is considerable when there is latitude over selection of covariates, subgroups, and other elements of an analysis plan.
Perspectives on Psychological ScienceScience or Art? How Aesthetic Standards Grease the Way Through the Publication Bottleneck but Undermine Science
294 Citations2012Roger Giner‐Sorolla
To open the bottleneck, putting structures in place to reward broader forms of information sharing beyond the exquisite art of present-day journal publication is suggested, suggesting a more palatable solution to the crisis in psychological research.
Quarterly Journal of Experimental PsychologyA peculiar prevalence of <i>p</i> values just below .05
269 Citations2012E. J. Masicampo, Daniel Lalande
Perspectives on Psychological ScienceThe Long Way From α-Error Control to Validity Proper
233 Citations2012Klaus Fiedler, Florian Kutzner +1 more
It is argued that, given the current state of affairs in behavioral science, false negatives often constitute a more serious problem and a scientific culture rewarding strong inference is more likely to see progress than a culture preoccupied with tightening its standards for the mere publication of original findings.
Personality and Social Psychology ReviewResearch Practices That Can Prevent an Inflation of False-Positive Rates
132 Citations2013Kou Murayama, Reinhard Pekrun +1 more
It is argued that an inflation of false-positive rates would diminish, sometimes to a substantial degree, when researchers have explicit a priori theoretical hypotheses, include multiple replication studies in a single paper, and collect additional data based on observed results.
PsychometrikaPlaying with Data—Or How to Discourage Questionable Research Practices and Stimulate Researchers to Do Things Right
83 Citations2015Klaas Sijtsma
Two policy measures are suggested that are effective in improving the quality of psychological research and run against common practice to keep data to oneself and overestimate one’s methodological and statistical skills, thus allowing secrecy and errors to enter research practice.
Personality and Social Psychology ReviewWhat We Should Expect From Theories in Social Psychology
64 Citations2012Paul A. M. Van Lange
PsychometrikaEncourage Playing with Data and Discourage Questionable Reporting Practices
63 Citations2015Daniël Wigboldus, Ron Dotsch
Making research data and research materials publicly available and consulting methodologists or statisticians for help and a second opinion will help in increasing the transparency of the data analysis phase of the empirical research cycle within psychology.
European PsychologistResult-Blind Peer Reviews and Editorial Decisions
45 Citations2013Werner Greve, Arndt Bröder +1 more
It is argued that peer-reviewed journals based on the principle of rigorous evaluation of research proposals before results are known would address the persisting problem of publication bias more efficiently than other tools and techniques suggested so far.
Frontiers in PsychologyReplication Unreliability in Psychology: Elusive Phenomena or “Elusive” Statistical Power?
38 Citations2012Patrizio Tressoldi
The focus of this paper is to analyze whether the unreliability of results related to certain controversial psychological phenomena may be a consequence of their low statistical power, and provides some suggestions on how to increase the statistical power or use different statistical approaches to help discriminate whether the results obtained may or may not be used to support or to refute the reality of a phenomenon with small ES.
Perspectives on Psychological ScienceSix Guidelines for Interesting Research
35 Citations2013Kurt Gray, Daniel M. Wegner
Social CognitionReplicability and Models of Priming: What a Resource Computation Framework can Tell us About Expectations of Replicability
34 Citations2014Joseph Cesario, Kai J. Jonas
It is argued that whether or not a replication attempt is informative is dependent on the accuracy of one’s underlying model to explain the effect, as it is the explanatory model that enumerates the contingencies necessary for producing the effect.