login

Sampling Error and Selecting Intercoder Reliability Samples for Nominal Content Categories

Journalism & Mass Communication QuarterlyPublished 1 December 1996
Stephen Lacy, Daniel Riffe
Citations239
SJR quartileQ1
SJR score1.33
SNIP1.69

Abstract

This study views intercoder reliability as a sampling problem. It develops a formula for generating sample sizes needed to have valid reliability estimates. It also suggests steps for reporting reliability. The resulting sample sizes will permit a known degree of confidence that the agreement in a sample of items is representative of the pattern that would occur if all content items were coded by all coders.

Keywords

Computer Science