Assessing agreement on classification tasks
Computational LinguisticsPublished 1 June 1996
CarlettaJean
Citations85
SJR quartileQ1
SJR score1.15
SNIP4.16
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Currently, computational linguists and cognitive scientists working in the area of discourse and dialogue argue that their subjective judgments are reliable using several different statistics, none of which supports the claim that they are reliable.
Abstract
Currently, computational linguists and cognitive scientists working in the area of discourse and dialogue argue that their subjective judgments are reliable using several different statistics, none...
Keywords
PsychologyComputer Science
Revue économiqueNonparametric Statistics for the Behavioral Sciences
35,492 Citations1958Henri Guitton, Sidney Siegel
Journal of the American Statistical AssociationContent Analysis: An Introduction to its Methodology.
24,566 Citations1984Mack Shelley, Klaus Krippendorff
Computational LinguisticsAttention, intentions, and the structure of discourse
2,606 Citations1986Barbara J. Grosz, Candace L. Sidner
A new theory of discourse structure that stresses the role of purpose and processing in discourse is explored and various properties of discourse are described, and explanations for the behavior of cue phrases, referring expressions, and interruptions are explored.
Intention-based segmentation
153 Citations1993Rebecca J. Passonneau, Diane Litman
A two part study evaluates the statistical reliability of human segmentation of a corpus of spontaneous, narrative monologues, where speaker intention is the segmentation criterion.
Disambiguating cue phrases in text and speech
34 Citations1990Diane Litman, Julia Hirschberg
This paper extends the previous characterization of cue phrases and generalizes its domain of coverage, based on a larger and more comprehensive empirical study: an examination of all cue phrases produced by a single speaker in recorded natural speech.
Temporal structure of discourse
13 Citations1992Irene Pimenta Rodrigues, José Gabriel P. Lopes
This method for discourse segmentation primarily based on abduction of temporal relations between segments is proposed and is precise and computationally feasible and supported by previous work in the area of temporal anaphora resolution.
arXiv (Cornell University)An investigation into the correlation of cue phrases, unfilled pauses and the structuring of spoken discourse
11 Citations1995Janet E. Cahn
The results suggest that cue phrase and discourse structuring tasks may align, and show a correlation for pause length and some of the modifications that speakers can make to discourse structure.