Towards understanding text with a very large vocabulary

Published 1 January 1990

Damaris Ayuso, Robert Bobrow, Dawn MacLaughlin, Marie Meteer, Lance Ramshaw, Rich Schwartz

Citations9

TL;DR

Abstract

In order to meet the information processing demands of the next decade, natural language systems must have the capability of processing very large amounts of text, commonly called "messages", from highly diverse sources written in any of a few dozen languages. One of the key issues in building systems with this scale of competence is handling large numbers of different words and word senses. Natural language understanding systems today are typically limited to vocabularies of less than 10,000 words; tomorrow's systems will need vocabularies at least 5 times that to effectively handle the volume and diversity of messages needing to be processed.

Keywords

Computer Science

A stochastic parts program and noun phrase parser for unrestricted text

974 Citations1988Kenneth Church

A program that tags each word in an input sentence with the most likely part of speech has been written and performance is encouraging; a 400-word sample is presented and is judged to be 99.5% correct.

View PDF

IEEE Transactions on Pattern Analysis and Machine IntelligenceA cache-based natural language model for speech recognition

503 Citations1990Roland Kühn, Renato De Mori

A novel kind of language model which reflects short-term patterns of word use by means of a cache component (analogous to cache memory in hardware terminology) is presented and contains a 3g-gram component of the traditional type.

View PDF

Parsing, word associations and typical predicate-argument relations

91 Citations1989Kenneth Church, William A. Gale +2 more

This paper will attempt to show that many of these types of concerns can be addressed with syntactic methods (symbol pushing, and need not require explicit semantic interpretation), and it is possible to identify many of these interesting co-occurrence relations by computing simple summary statistics over millions of words of text.

View PDF

Parsing the LOB corpus

84 Citations1990Carl G. de Marcken

A rapid and robust parsing system currently used to learn from large bodies of unedited text, which contains a multivalued part-of-speech disambiguator and a novel parser employing bottom-up recognition to find the constituent phrases of larger structures that might be too difficult to analyze.

View PDF

Statistical parsing of messages

48 Citations1990Mahesh Vinayak Chitrao, Ralph Grishman

The recent trend in natural language processing research has been to develop systems that deal with text concerning small, well defined domains, where there is not a great diversity of language constructs and therefore it becomes easier to construct a grammar which will capture all the constructs which exist in this sub-language.

Dictionaries, dictionary grammars and dictionary entry parsing

37 Citations1989Mary S. Neff, Branimir Boguraev

This work presents a general purpose dictionary entry parser which uses a formal notation designed to describe the structure of entries and performs a mapping from the flat character stream on the tape to a highly structured and fully instantiated representation of the dictionary.

View PDF

A tool for investigating the synonymy relation in a sense disambiguated thesaurus

21 Citations1988Martin Chodorow, Yael Ravin +1 more

An exploration of the implicit synonymy relationship expressed by synonym lists in an on-line thesaurus results in groupings of semantically related word senses that constitute a useful tool for natural language processing and for work in lexicography.

View PDF

Unification-based semantic interpretation in the BBN Spoken Language System

11 Citations1989David Stallard

This paper describes the current state of work on unification-based semantic interpretation in HARC (for Hear and Recognize Continous speech) the BBN Spoken Language System and presents the implementation of an integrated syntax/semantics grammar written in a unification formalism similar to Definite Clause Grammar.

View PDF

A common facts data base

2 Citations1989William Crowther

This note is about a project whose goal has been to develop methods for converting large amounts of natural language text into machine-accessible data base relations.

View PDF