Apples and Oranges: An Empirical Comparison of Commonly Used Indices of Interrater Agreement.
Academy of Management JournalPublished 1 September 1983
A. P. Jones, L. A. Johnson, Mark C. Butler, Deborah S. Main
Citations128
SJR quartileQ1
SJR score10.53
SNIP3.95
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Empirical comparison of common indices of interrater agreement indicated that the indices are not directly comparable in regard to the magnitude of the estimates produced or the information conveye...
Keywords
Decision Sciences
McGraw-Hill Book CompanyStatistical principles in experimental design.
26,927 Citations1962B. J. WINER
Psychology Press eBooksApplied Multiple Regression/Correlation Analysis for the Behavioral Sciences
20,853 Citations2014Patricia Cohen, Patricia Cohen +2 more
Psychological BulletinWeighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.
8,537 Citations1968Jacob Cohen
The Kw provides for the incorpation of ratio-scaled degrees of disagreement (or agreement) to each of the cells of the k * k table of joi.
Journal of Applied PsychologyAggregation bias in estimates of perceptual agreement.
2,080 Citations1982Lawrence R. James
Organizational Behavior and Human PerformancePsychological climate: Dimensions and relationships of individual and aggregated work environment perceptions
813 Citations1979Allan P. Jones, Lawrence R. James
Psychological BulletinOn various intraclass correlation reliability coefficients.
809 Citations1976John J. Bartko
Psychological BulletinInterobserver agreement, reliability, and generalizability of data collected in observational studies.
439 Citations1979Sandra K. Mitchell
Journal of Applied PsychologyA study of job characteristics and job dimensions as based on the Position Analysis Questionnaire (PAQ).
375 Citations1972Ernest J. McCormick, P. Richard Jeanneret +1 more
Journal of Applied Behavior AnalysisDIFFERENCES AMONG COMMON METHODS FOR CALCULATING INTEROBSERVER AGREEMENT
106 Citations1976Alan C. Repp, Dianne E. D. Deitz +3 more
The present experiment compared the results of computing interobserver agreement by these common methods and variations: variations in the length of the time block and the definition of an interval of agreement.
Journal of Applied PsychologyValidity of behavioral assessment for predicting military recruiter performance.
95 Citations1982Walter C. Borman
Psychological BulletinStatistical approaches to the correction of correlational bias.
83 Citations1980David A. Kenny, Jeffrey S. Berman
Personnel PsychologyCONVERGENCE AMONG DATA SOURCES, RESPONSE BIAS, AND RELIABILITY AND VALIDITY OF A STRUCTURED JOB ANALYSIS QUESTIONNAIRE
80 Citations1979Jack Smith, Milton D. Hakel
Journal of Applied PsychologyScrutinizing the Skipper: A study of leadership behaviors in the dugout.
68 Citations1979Bill Curtis, Ronald E. Smith +1 more
Psychological BulletinEstimating false alarms and missed events from interobserver agreement: A rationale.
26 Citations1980Kenneth Kaye
Personnel PsychologyEMPIRICALLY DERIVED JOB FAMILIES AS A FOUNDATION FOR THE STUDY OF VALIDITY GENERALIZATION
25 Citations1978Lew Taylor
Educational and Psychological MeasurementEstimating Scorer Agreement for Nominal Categorization Systems
13 Citations1981Nancy Burton
Educational and Psychological MeasurementComments on the Analysis of Variance Strategy for the Computation of Intraclass Reliability
11 Citations1976Rob Selvage