Encourage Playing with Data and Discourage Questionable Reporting Practices
PsychometrikaPublished 29 March 2015Open access
Daniël Wigboldus, Ron Dotsch
Citations63
SJR quartileQ1
SJR score1.90
SNIP2.06
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Making research data and research materials publicly available and consulting methodologists or statisticians for help and a second opinion will help in increasing the transparency of the data analysis phase of the empirical research cycle within psychology.
Abstract
Contains fulltext : 156302.pdf (Publisher’s version ) (Open Access)
Keywords
Computer ScienceDecision Sciences
Thinking, Fast and Slow
10,444 Citations2011Daniel Kahneman
Psychological ScienceFalse-Positive Psychology
6,712 Citations2011Joseph P. Simmons, Leif D. Nelson +1 more
It is shown that despite empirical psychologists’ nominal endorsement of a low rate of false-positive findings, flexibility in data collection, analysis, and reporting dramatically increases actual false- positive rates, and a simple, low-cost, and straightforwardly effective disclosure-based solution is suggested.
Psychological ScienceMeasuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
2,333 Citations2012Leslie K. John, George Loewenstein +1 more
It is found that the percentage of respondents who have engaged in questionable practices was surprisingly high, which suggests that some questionable practices may constitute the prevailing research norm.
Perspectives on Psychological ScienceAn Agenda for Purely Confirmatory Research
1,136 Citations2012Eric‐Jan Wagenmakers, Ruud Wetzels +3 more
This article proposes that researchers preregister their studies and indicate in advance the analyses they intend to conduct, and proposes that only these analyses deserve the label “confirmatory,” and only for these analyses are the common statistical tests valid.
Social Psychological and Personality ScienceQuestionable Research Practices Revisited
312 Citations2015Klaus Fiedler, Norbert Schwarz
Perspectives on Psychological ScienceThe Long Way From α-Error Control to Validity Proper
233 Citations2012Klaus Fiedler, Florian Kutzner +1 more
It is argued that, given the current state of affairs in behavioral science, false negatives often constitute a more serious problem and a scientific culture rewarding strong inference is more likely to see progress than a culture preoccupied with tightening its standards for the mere publication of original findings.
PsychometrikaPlaying with Data—Or How to Discourage Questionable Research Practices and Stimulate Researchers to Do Things Right
83 Citations2015Klaas Sijtsma
Two policy measures are suggested that are effective in improving the quality of psychological research and run against common practice to keep data to oneself and overestimate one’s methodological and statistical skills, thus allowing secrecy and errors to enter research practice.
SignificancePlaying with Data
5 Citations2014Brian Tarran
This is Metrico – a game about infographics and the designer Geert “Gene” Nellen talks to Brian Tarran about the design and development of the game.