Reliability and bias in peer-review practices
Behavioral and Brain SciencesPublished 1 June 1982
Robert Rosenthal
Citations14
SJR quartileQ2
SJR score0.55
SNIP0.43
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
An abstract is not available for this content so a preview has been provided. Please use the Get access link above for information on how to access this content.
Keywords
Social SciencesDecision SciencesEconomics, Econometrics and Finance
McGraw-Hill Book CompanyStatistical principles in experimental design.
26,927 Citations1962B. J. WINER
Psychological BulletinConvergent and discriminant validation by the multitrait-multimethod matrix.
17,061 Citations1959Donald T. Campbell, Donald W. Fiske
This transmutability of the validation matrix argues for the comparisons within the heteromethod block as the most generally relevant validation data, and illustrates the potential interchangeability of trait and method components.
American PsychologistToward an experimental ecology of human development.
10,197 Citations1977Urie Bronfenbrenner
Psychological BulletinWeighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.
8,537 Citations1968Jacob Cohen
The Kw provides for the incorpation of ratio-scaled degrees of disagreement (or agreement) to each of the cells of the k * k table of joi.
ScienceThe Matthew Effect in Science
6,270 Citations1968Robert Κ. Merton
The psychosocial conditions and mechanisms underlying the Matthew effect are examined and a correlation between the redundancy function of multiple discoveries and the focalizing function of eminent men of science is found—a function which is reinforced by the great value these men place upon finding basic problems and by their self-assurance.
Macat Library eBooksThe Structure of Scientific Revolutions
5,423 Citations2017Jo Hedesan, Joseph Tendler
PubMedThe Matthew effect in science. The reward and communication systems of science are considered.
4,872 Citations1968Robert Κ. Merton
Cambridge University Press eBooksFalsification and the Methodology of Scientific Research Programmes
4,344 Citations1970И. Лакатос
Cambridge University Press eBooksCriticism and the Growth of Knowledge
3,370 Citations1970Lakatos, Imre 1922-1974, Musgrave, Alan 1940-
Philosophy of ScienceImre Lakatos and Musgrave Alan (eds.). <i><b>Criticism and the growth of knowledge</b></i>. Cambridge: Cambridge University Press, 1970. 282 pp. np.
3,008 Citations1972Hugh Lehman
Psychological ReportsThe Intraclass Correlation Coefficient as a Measure of Reliability
2,343 Citations1966John J. Bartko
Perceiving, Acting and Knowing
2,074 Citations2017Robert E. Shaw
Journal of Personality and Social PsychologyThe halo effect: Evidence for unconscious alteration of judgments.
1,989 Citations1977Richard E. Nisbett, Timothy D. Wilson
Technology and CultureCitation Indexing-Its Theory and Application in Science, Technology, and Humanities
1,669 Citations1980Jack Goodwin, Eugene Garfield
Citation indexing-its theory and application in science, technology, and humanities, Citation indexing (Citation Indexing) (CIFS), مرکز فناوری اطلاعات (Citations Indexing),
Archives of Internal MedicineExperimenter Effects in Behavioral Research.
1,207 Citations1967James L. Titchener
"Clever Hans," the mathematical horse owned by an apparently ingenuous German schoolmaster in the early 1900's, could add, subtract, multiply, divide, read, spell, and solve problems of musical harmony, communicating his answers by tapping his foot.
The Philosophical QuarterlyThe Structure of Scientific Theories.
1,153 Citations1975John Day, Frederick Suppe
Behavioral and Brain SciencesInterpersonal expectancy effects: the first 345 studies
1,149 Citations1978Robert Rosenthal, Donald B. Rubin
American Journal of PhysicsSocial Stratification in Science
1,143 Citations1974Jonathan R. Cole, Stephen Cole +1 more
Cognitive Therapy and ResearchPublication prejudices: An experimental study of confirmatory bias in the peer review system
1,030 Citations1977M. J. Mahoney
Journal of the American Society for Information ScienceRELEVANCE: A review of and a framework for the thinking on the notion in information science
866 Citations1975Tefko Saračević
Information science emerged as the third subject, along with logic and philosophy, to deal with relevance-an elusive, human notion that is traced to the problems of scientific communication.
British Journal of Educational StudiesOn Knowing: Essays for the Left Hand
759 Citations1963H. E. O. James, Jerome S. Bruner
ScienceChance and Consensus in Peer Review
624 Citations1981Stephen Cole, Jonathan R. Cole +1 more
An experiment in which 150 proposals submitted to the National Science Foundation were evaluated independently by a new set of reviewers indicates that getting a research grant depends to a significant extent on chance.
The Academic Marketplace
526 Citations2017Théodore Caplow, Reece McGee +1 more
Journal of Experimental Psychology Human Perception & PerformanceOn the psychology of experimental surprises.
466 Citations1977Paul Slovic, Baruch Fischhoff
Social Studies of ScienceStages in the Empirical Programme of Relativism
461 Citations1981Harry Collins
ScienceThe Ortega Hypothesis
388 Citations1972Jonathan R. Cole, Stephen Cole
The data allow the view stated by Ortega, Florey, and others that large numbers of average scientists contribute substantially to the advance of science through their research to be questioned.
Journal of Personality and Social PsychologyEvaluation of the performance of women as a function of their sex, achievement, and personal history.
386 Citations1971Gail Pheterson, Sara Kiesler +1 more
The Psychobiology of Consciousness
359 Citations1980Julian M. Davidson, Richard J. Davidson
The nature of the Unconscious, the Organization of Competence and Conduct, and Genetic Factors in EEG, Sleep, and Evoked Potentials: An Opportunity for Private Processing are examined.
Child DevelopmentChallenges to a Science of Developmental Psychology
323 Citations1977Robert B. McCall
The American Journal of MedicinePeer review in biomedical publication
242 Citations1974Franz J. Ingelfinger
Concurrence between two reviewers of each of some 500 papers submitted to the New England Journal of Medicine was only moderately better than a chance result, and the reviewing system was important to maintain standards.
Academy of Management JournalManuscript Characteristics Which Influence Acceptance for Management and Social Science Journals.
239 Citations1977S. J. Kerr, Joseph Thomas Tolliver +1 more
Sociological QuarterlyEditorial Policies and Practices Among Leading Journals in Four Scientific Fields
231 Citations1978Janice M. Beyer
Journal of Political EconomyWhat Is an Article Worth?
218 Citations1975Howard P. Tuckman, Jack Leahey
Cambridge University Press eBooksLife and Letters of Thomas Henry Huxley
208 Citations2011Leonard Huxley, Thomas Henry Huxley
D. Appleton and company eBooksLife and letters of Thomas Henry Huxley
195 Citations1900Thomas Henry Huxley, Leonard Huxley
Social Studies of ScienceReview Paper : Psychology of the Scientist: An Evaluative Review
179 Citations1979M. J. Mahoney
American PsychologistImproving manuscript evaluation procedures.
160 Citations1972Donald D. Bowen, Robert Perloff +1 more
Convention program committees face a similar problem in selecting papers for presentation, although the published complaints usually focus exclusively on frustrations encountered in dealings with the journals.
Sociology of the sciences/Sociology of the sciences yearbookScientific Establishments and Hierarchies
157 Citations1982Norbert Elias, Hermínio Martins +1 more
This book discusses the establishment and structure of the Sciences as Reputational Organizations, as well as the development of Restrictedness in the Sciences.
The Library QuarterlyA Statistical Procedure for Evaluating the Importance of Scientific Papers
151 Citations1977Julie A. Virgo
Testing the hypothesis that more important papers on the average are cited in the published literature more frequently than papers perceived as less important revealed that citation frequency alone was as good an indicator of the importance of an article as judged by oneSet of judges than a second set of judges.
PubMedA statistical analysis of reviewer agreement and bias in evaluating medical abstracts.
144 Citations1976Domenic V. Cicchetti, Harold O. Conn
Of the 77 abstracts rated for all parameters by all observers, interobserver agreement ranged between 81 and 88%.
The American StatisticianA Proposal for a New Editorial Policy in the Social Sciences
142 Citations1970G. William Walster, T. Anne Cleary
Psychological ReportsPsychology of Scientist: XXX. Credibility of Psychologists: An Empirical Study
142 Citations1970Leonard D. Goodstein, Karen Lee Brazis
ScienceCommunication in the Physical and the Social Sciences
141 Citations1970William D. Garvey, Nan Lin +1 more
Because the lags and filtering within each system differ in loci and extent, the members of different disciplines adjust to them differently, and the overall information flow patterns in the physical and in the social sciences differ.
Scientific AmericanPeer Review and the Support of Science
140 Citations1977Stephen Cole, Leonard R. Rubin +1 more
Sociological QuarterlyThe Structure of Scientific Fields and the Allocation of Editorships on Scientific Journals: Some Observations on the Politics of Knowledge
130 Citations1974William C. Yoels
The Journal of PsychologyAre Women Still Prejudiced against Women? A Replication and Extension of Goldberg's Study
127 Citations1975Hanna Levenson, Brent Burford +2 more
Social Studies of SciencePeer Review at the NSF: A Dialectical Policy Analysis
124 Citations1979Ian I. Mitroff, Daryl E. Chubin
International Journal of Intercultural RelationsEthics in social and behavioral research
116 Citations1979John F. Kremer
Social Studies of ScienceProfessional Age and the Reception of Sociological Publications: A Test of the Zuckerman-Merton Hypothesis
104 Citations1977Mark Oromaner
What is Psychology?
103 Citations2016Andrew M. Colman
Sociology of the sciences/Sociology of the sciences yearbookResearch Trails and Science Policies: Local and Extra-Local Negotiation of Scientific Work
98 Citations1982Daryl E. Chubin, T. Connolly
BMJReferees and research administrators: barriers to scientific research?
93 Citations1974David F. Horrobin
The group hopes to develop a modified version of the system for use in general practice, with a view to aiding management and study of hypertensive patients in the population at large.
Journal of Social Service ResearchRecognition of Authors in Blind Review of Manuscripts
86 Citations1980Aaron Rosenblatt, Stuart A. Kirk
The results of this study show that the major source of information tipping off the identity of authors is the manuscript itself, not the expert knowledge of referees.
Academy of Management ReviewAdvocacy as a Scientific Strategy: The Mitroff Myth
75 Citations1980J. Scott Armstrong
A committee created a fictitious author, Ian Mitroff, who published a paper that violated scientific guidelines, and the advocacy strategy is used to scientifically prove that MitroFF does not exist.
EndeavourThe Force of Knowledge: The scientific dimension of society
74 Citations1977Jerome R. Ravetz
BioScienceThe Act of Creation: Creative Processes in Science
68 Citations1978Annegaaike Leopold
There are many things that could be said about creative processes in science, but I intend to make just four central points: Creativity is definitively a personal function, and in part because of this personal quality, creativity is difficult to teach to students.
Science<i>Phycomyces</i> : Interference Between the Light Growth Response and the Avoidance Response
62 Citations1979Sally S. Harris, David S. Dennison
Phycomyces sporangiophores showl a growth response to a light stimus and an avoidance bending response toA physical barrier and a bluie-light stimus in conjunction with a barrier interferes with the avoidance bending sponse.
BioScienceCommentary: The Double Helix: Science and Myth in the Act of Creation
61 Citations1979Clyde Manwell
Social Studies of ScienceEducation Through Science: The Early Stages of Career Development in Chemistry
61 Citations1976Dorothy S. Zinberg
…