Coefficients of Agreement
The British Journal of PsychiatryPublished 1 November 1983
Michael Dewey
Citations99
SJR quartileQ1
SJR score2.47
SNIP2.17
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper criticizes the proposed random error coefficient (RE) and suggests that Cohen's (1960) coefficient kappa (K) is still the measure of choice.
Abstract
Several coefficients have been suggested for the measurement of agreement between raters. Recently Maxwell (1977) has proposed, and Janes (1979) has extended, a new coefficient, which they have termed the random error coefficient (RE). This paper criticizes their proposal and suggests that Cohen's (1960) coefficient kappa (K) is still the measure of choice.
Keywords
Decision Sciences
Psychological BulletinWeighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.
8,537 Citations1968Jacob Cohen
The Kw provides for the incorpation of ratio-scaled degrees of disagreement (or agreement) to each of the cells of the k * k table of joi.
BiometricsMeasuring Agreement between Two Judges on the Presence or Absence of a Trait
504 Citations1975Joseph L. Fleiss
Using the binary (positive-negative) case as a model, some of the proposed indexes for measuring agreement between two judges on a categorical scale are presented and critically evaluates.
The British Journal of PsychiatryFirst Rank Symptoms of Schizophrenia: I. the Frequency in Schizophrenics on Admission to Hospital II. Differences between Individual First Rank Symptoms
476 Citations1970C. S. Mellor
This paper gives an account of these symptoms in schizophrenics, on admission to mental hospital; the assumption being that if they are the defining symptoms of the illness then they should be most prominent in the acute phase.
The British Journal of PsychiatryCoefficients of Agreement Between Observers and Their Interpretation
195 Citations1977Annette E. Maxwell
The measurement of agreement between ratings of patient symptomatology by two or more psychiatrists is discussed and coefficients which allow for possible chance agreement are to be preferred, but they involve assumptions about the way in which chance factors may operate.
The British Journal of PsychiatryAn Extension of the Random Error Coefficient of Agreement to N x N Tables
16 Citations1979Cynthia L. Janes
A more general formula for RE's computation is presented and it is shown how the new form is applicable to cases with more than two response categories.