Chunking with maximum entropy models
Published 1 January 2000Open access
Rob Koeling
Citations84
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A first attempt to create a text chunker using a Maximum Entropy model is discussed, implementing classifiers that tag every word in a sentence with a phrase-tag using very local lexical information, part-of-speech tags and phrase tags of surrounding words.
Abstract
In this paper I discuss a first attempt to create a text chunker using a Maximum Entropy model. The first experiments, implementing classifiers that tag every word in a sentence with a phrase-tag using very local lexical information, part-of-speech tags and phrase tags of surrounding words, give encouraging results.
Keywords
Computer Science
Computational LinguisticsA maximum entropy approach to natural language processing
3,120 Citations1996Adam Berger, Vincent J. Della Pietra +1 more
A maximum-likelihood approach for automatically constructing maximum entropy models is presented and how to implement this approach efficiently is described, using as examples several problems in natural language processing.
IEEE Transactions on Pattern Analysis and Machine IntelligenceInducing features of random fields
1,044 Citations1997S. Della Pietra, V. Della Pietra +1 more
The random field models and techniques introduced in this paper differ from those common to much of the computer vision literature in that the underlying random fields are non-Markovian and have a large number of parameters that must be estimated.
ScholarlyCommons (University of Pennsylvania)Maximum entropy models for natural language ambiguity resolution
432 Citations1998Adwait Ratnaparkhi, Mitchell P. Marcus
This thesis demonstrates that several important kinds of natural language ambiguities can be resolved to state-of-the-art accuracies using a single statistical modeling technique based on the principle of maximum entropy.
arXiv (Cornell University)A Linear Observed Time Statistical Parser Based on Maximum Entropy Models
122 Citations1997Adwait Ratnaparkhi
arXiv (Cornell University)A Learning Approach to Shallow Parsing
80 Citations2000M. Ruiz Muñoz, Vasin Punyakanok +2 more
Lecture notes in computer scienceMaximum Entropy modeling with Clausal Constraints
45 Citations1997Luc De Raedt
First experiments indicate MACCENT may be useful for prediction, and for classification in cases where the induced model should be combined with other stochastic information sources, and on an existing maximum-likelihood approach to maximum entropy modeling.