The importance of proper weighting methods

Published 1 January 1993Open access

Chris Buckley

Citations55

TL;DR

Evidence is presented that good weighting methods are more important than the feature selection process and it is suggested that the two need to go hand-in-hand in order to be effective.

Abstract

The importance of good weighting methods in information retrieval --- methods that stress the most useful features of a document or query representative --- is examined. Evidence is presented that good weighting methods are more important than the feature selection process and it is suggested that the two need to go hand-in-hand in order to be effective. The paper concludes with a method for learning a good weight for a term based upon the characteristics of that term.

Keywords

Computer Science

Information Processing & ManagementTerm-weighting approaches in automatic text retrieval

9,532 Citations1988Gerard Salton, Chris Buckley

This paper summarizes the insights gained in automatic term weighting, and provides baseline single term indexing models with which other more elaborate content analysis procedures can be compared.

Journal of DocumentationON THE SPECIFICATION OF TERM VALUES IN AUTOMATIC INDEXING

577 Citations1973G. Salton, Chul‐Su Yang

It is shown that the standard theories for the specification of term values (or weights) are not adequate, and new techniques are introduced for the assignment of weights to index terms, based on the characteristics of individual document collections.

ACM Transactions on Information SystemsA probabilistic learning approach for document indexing

202 Citations1991Norbert Fuhr, Chris Buckley

A method for probabilistic document indexing using relevance feedback data that has been collected from a set of queries based on three new concepts, which allows the integration of new text analysis and knowledge-based methods in this approach as well as the consideration of document structures or different types of terms.

View PDF

Cornell University eBooksExperiments in Automatic Phrase Indexing For Document Retrieval: A Comparison of Syntactic and Non-Syntactic Methods

185 Citations1987Joel L. Fagan

A 78-year-old man with palpitations, dizziness, and presyncope was referred to the authors' institution for evaluation and a diagnosis of right ventricular dysplasia was made, and the patient underwent an electrophysiological study to evaluate hisPalpitations and Presyncope.

View PDF

Information Processing & ManagementModels for retrieval with probabilistic indexing

177 Citations1989Norbert Fuhr

Three retrieval models for probabilistic indexing are described along with evaluation results for each, including the binary independence indexing (BII) model, which is a generalized version of the Maron and Kuhns indexing model.

Text REtrieval ConferenceAutomatic Retrieval With Locality Information Using SMART.

120 Citations1992Chris Buckley, Gerard Salton +1 more

The Smart project at Cornell University, using a completely automatic approach for both routing and ad-hoc experiments, performed extremely well in the first Text Retrieval Conference.

Optimizing document indexing and search term weighting based on probabilistic models

17 Citations1992Norbert Fuhr, Chris Buckley

This work describes the application of probabilistic indexing and retrieval methods to the TREC material and applies a description-oriented approach which uses relevance feedback information from previous queries run on the same collection.