Are We Wasting a Good Crisis? The Availability of Psychological Research Data after the Storm
CollabraPublished 1 January 2015Open access
Wolf Vanpaemel, Maarten Vermorgen, Leen Deriemaecker, Gert Storms
Citations168
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
To study the availability of psychological research data, we requested data from 394 papers, published in all issues of four APA journals in 2012. We found that 38% of the researchers sent their data immediately or after reminders. These findings are in line with estimates of the willingness to share data in psychology from the recent or remote past. Although the recent crisis of confidence that shook psychology has highlighted the importance of open research practices, and technical developments have greatly facilitated data sharing, our findings make clear that psychology is nowhere close to being an open science.
Keywords
Computer ScienceDecision SciencesSocial Sciences
Psychological ScienceFalse-Positive Psychology
6,712 Citations2011Joseph P. Simmons, Leif D. Nelson +1 more
It is shown that despite empirical psychologists’ nominal endorsement of a low rate of false-positive findings, flexibility in data collection, analysis, and reporting dramatically increases actual false- positive rates, and a simple, low-cost, and straightforwardly effective disclosure-based solution is suggested.
Psychological ScienceMeasuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
2,333 Citations2012Leslie K. John, George Loewenstein +1 more
It is found that the percentage of respondents who have engaged in questionable practices was surprisingly high, which suggests that some questionable practices may constitute the prevailing research norm.
Perspectives on Psychological ScienceScientific Utopia
1,336 Citations2012Brian A. Nosek, Jeffrey R. Spies +1 more
Strategies for improving scientific practices and knowledge accumulation are developed that account for ordinary human motivations and biases and can reduce the persistence of false findings.
Perspectives on Psychological ScienceStatistical Evidence in Experimental Psychology
991 Citations2011Ruud Wetzels, Dóra Matzke +4 more
PLoS ONESharing Detailed Research Data Is Associated with Increased Citation Rate
891 Citations2007Heather Piwowar, Roger Day +1 more
This correlation between publicly available data and increased literature impact may further motivate investigators to share their detailed research data.
Proceedings of the National Academy of SciencesRevised standards for statistical evidence
819 Citations2013Valen E. Johnson
Modifications of common standards of evidence are proposed to reduce the rate of nonreproducibility of scientific research by a factor of 5 or greater and to correct the problem of unjustifiably high levels of significance.
American PsychologistThe poor availability of psychological research data for reanalysis.
559 Citations2006Jelte M. Wicherts, Denny Borsboom +2 more
A failed attempt to obtain data reported in 141 empirical articles recently published by the APA, to assess the robustness of the research findings to outliers.
PLoS ONEWillingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results
442 Citations2011Jelte M. Wicherts, Marjan Bakker +1 more
It is suggested that statistical results are particularly hard to verify when reanalysis is more likely to lead to contrasting conclusions, which highlights the importance of establishing mandatory data archiving policies.
PLoS ONEEmpirical Study of Data Sharing by Authors Publishing in PLoS Journals
410 Citations2009Caroline Savage, Andrew J. Vickers
It is suggested that journal policies requiring data sharing do not lead to authors making their data sets available to independent investigators, as only one of ten raw data sets requested was received.
NatureReplication studies: Bad copy
404 Citations2012Ed Yong
In the wake of high-profile controversies, psychologists are facing up to problems with replication and how to deal with them.
Psychological InquiryScientific Utopia: I. Opening Scientific Communication
391 Citations2012Brian A. Nosek, Yoav Bar‐Anan
This work outlines a path that moves away from the existing model of scientific communication to improve the efficiency in meeting the purpose of public science—knowledge accumulation and calls for six changes.
PLoS ONEPublic Availability of Published Research Data in High-Impact Journals
369 Citations2011Alawi Alsheikh‐Ali, Waqas Qureshi +2 more
A substantial proportion of original research papers published in high-impact journals are either not subject to any data availability policies, or do not adhere to the data availability instructions in their respective journals.
Royal Society Open ScienceThe Peer Reviewers' Openness Initiative: incentivizing open research practices through peer review
308 Citations2016Richard D. Morey, Chris Chambers +11 more
This work suggests a social dilemma arising from misaligned incentives and proposes a specific, concrete mechanism—reviewers withholding comprehensive review—to achieve the goal of creating the expectation of open practices as a matter of scientific principle.
PLoS ONEWho Shares? Who Doesn't? Factors Associated with Openly Archiving Raw Research Data
214 Citations2011Heather Piwowar
Research data sharing levels are still low and increasing only slowly, and data is least available in areas where it could make the biggest impact, according to bibliometric methods.
NaturePost-publication sharing of data and tools
171 Citations2009CASIMIR Rome Meeting participants, Paul N. Schofield +9 more
A meeting of mouse researchers in Rome proposes ways to promote a culture of sharing to help improve access to data and bioresources.
Psychological ReviewBayesian statistical inference in psychology: Comment on Trafimow (2003).
135 Citations2005Michael Lee, Eric‐Jan Wagenmakers
This comment, with the help of a simple example, explains the usefulness of Bayesian inference for psychology.
Behavior Research MethodsThe what, why, and how of born-open data
91 Citations2015Jeffrey N. Rouder
The benefits of born-open data are discussed and some of the common concerns about opening data before publication are addressed, and a brief technical overview of the process is provided.
Columbia Academic Commons (Columbia University)Trust Your Science? Open Your Data and Code
46 Citations2011Victoria Stodden
As the community embraces and tackles this issue across the computational sciences, concepts are inevitably labeled with different terms and different concepts are emphasized.
Frontiers in PsychologyMeasuring the crowd within again: a pre-registered replication study
29 Citations2014Sara Steegen, Laura Dewitte +2 more
A high-powered, pre-registered replication study of the crowd within effect, both when the second guess was made immediately after the first guess, as well as when it was made 3 weeks later.
BMC Research NotesA call for BMC Research Notes contributions promoting best practice in data standardization, sharing and publication
25 Citations2010Iain Hrynaszkiewicz