Linear Segmentation and Segment Significance
ArXiv.orgPublished 15 September 1998Open access
Min‐Yen Kan, Judith L. Klavans, Kathleen McKeown
Citations101
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A new method for discovering a segmental discourse structure of a document while categorizing each segment's function and importance is presented, using a zero-sum weighting scheme.
Abstract
We present a new method for discovering a segmental discourse structure of a document while categorizing segment function. We demonstrate how retrieval of noun phrases and pronominal forms, along with a zero-sum weighting scheme, determines topicalized segmentation. Futhermore, we use term distribution to aid in identifying the role that the segment performs in the document. Finally, we present results of evaluation in terms of precision and recall which surpass earlier approaches.
Keywords
Computer Science
arXiv (Cornell University)Assessing agreement on classification tasks: the kappa statistic
2,092 Citations1996Jean Carletta
TextTiling: segmenting text into multi-paragraph subtopic passages
1,253 Citations1997Marti A. Hearst
The algorithm is fully implemented and is shown to produce segmentation that corresponds well to human judgments of the subtopic boundaries of 12 texts, which should be useful for many text analysis tasks, including information retrieval and summarization.
Columbia Academic Commons (Columbia University)Using lexical chains for text summarization
869 Citations1997Regina Barzilay, Michael Elhadad
Empirical results on the identification of strong chains and of significant sentences are presented in this paper, and plans to address short-comings are briefly presented.
Natural Language EngineeringTechnical terminology: some linguistic properties and an algorithm for identification in text
817 Citations1995John S. Justeson, Slava M. Katz
The paper presents a terminology indentification algorithm that recovers a high proportion of the technical terms in a text, and a high proportaion of the recovered strings are vaild technical terms.
Multi-paragraph segmentation of expository text
558 Citations1994Marti A. Hearst
TextTiling, an algorithm for partitioning expository texts into coherent multi-paragraph discourse units which reflect the subtopic structure of the texts, is described and shown to produce segmentation that corresponds well to human judgments of the major subtopic boundaries of thirteen lengthy texts.
arXiv (Cornell University)Multi-Paragraph Segmentation of Expository Text
392 Citations1994Marti A. Hearst
Comlex Syntax
205 Citations1994Ralph Grishman, Catherine Macleod +1 more
The design of Comlex Syntax is described, a computational lexicon providing detailed syntactic information for approximately 38,000 English headwords, and the types of errors which arise in creating such a lexicon are considered.
Text segmentation based on similarity between words
203 Citations1993Hideki Kozima
Comparison with the text segments marked by a number of subjects shows that LCP closely correlates with the human judgments, which may provide valuable information for resolving anaphora and ellipsis.
Intention-based segmentation
153 Citations1993Rebecca J. Passonneau, Diane Litman
A two part study evaluates the statistical reliability of human segmentation of a corpus of spontaneous, narrative monologues, where speaker intention is the segmentation criterion.
The rhetorical parsing of natural language texts
151 Citations1997Daniel Marcu
An automatic method of finding topic boundaries
140 Citations1994Jeffrey C. Reynar
A new method of locating discourse boundaries based on lexical cohesion and a graphical technique called dotplotting is outlined, which can be performed either manually, by examining a graph, or automatically, using an optimization algorithm.
LanguageA New Tool for Discourse Analysis: The Vocabulary-Management Profile
91 Citations1991Gilbert Youmans
Word sense disambiguation and text segmentation based on lexical cohesion
91 Citations1994Manabu Okumura, Takeo Honda
How word sense ambiguity can be resolved with the aid of lexical cohesion is described and incremental word sense disambiguation based on contextual information that lexical chains, reveal is realized.
ArXiv.orgText Segmentation Using Exponential Models
85 Citations1997Doug Beeferman, Adam Berger +1 more
This work enlists both short-range and long-range language models to help it sniff out likely sites of topic changes in text, and proposes a new probabilistically motivated error metric for use by the natural language processing and information retrieval communities.
The use of emphasis to automatically summarize a spoken discourse
76 Citations1992F.R. Chen, M. Withgott
The authors describe a method for exploiting prosodic information in natural, conventional speed for the purpose of automatically creating an audio summary based on identifying emphasized speech and then using proximity measures on the emphasized regions to select summarizing excerpts.
Resources for evaluation of summarization techniques
15 Citations1998Kathleen McKeown, Kan Min-Yen +2 more
A set of evaluation resources, both comprised of a corpus of human judgments, fashioned to accurately test the two technologies currently implemented in the text analysis module: namely, linear segmentation of text and sentence extraction.