Statistical sense disambiguation with relatively small corpora using dictionary definitions

Using the definition-based conceptual co-occurrence data collected from the relatively small Brown corpus, the sense disambiguation system achieves an average accuracy comparable to human performance given the same contextual information.

Abstract

Corpus-based sense disambiguation methods, like most other statistical NLP approaches, suffer from the problem of data sparseness. In this paper, we describe an approach which overcomes this problem using dictionary definitions. Using the definition-based conceptual co-occurrence data collected from the relatively small Brown corpus, our sense disambiguation system achieves an average accuracy comparable to human performance given the same contextual information.