Some inconsistencies and misnomers in probabilistic information retrieval

Published 1 September 1991

William S. Cooper

Citations55

TL;DR

The statistical character of certain probabilistic IR models, including the so-called ‘binary independence’ model, has been seriously misapprehended.

Abstract

Article Some inconsistencies and misnomers in probabilistic information retrieval Share on Author: William S. Cooper School of Library and Information Studies, University of California, Berkeley, California School of Library and Information Studies, University of California, Berkeley, CaliforniaView Profile Authors Info & Claims SIGIR '91: Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrievalSeptember 1991 Pages 57–61https://doi.org/10.1145/122860.122866Online:01 September 1991Publication History 31citation267DownloadsMetricsTotal Citations31Total Downloads267Last 12 Months6Last 6 weeks1 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access

Keywords

Computer ScienceDecision Sciences

Journal of the American Society for Information ScienceRelevance weighting of search terms

2,068 Citations1976Stephen Robertson, Karen Spärck Jones

This paper examines statistical techniques for exploiting relevance information to weight search terms using information about the distribution of index terms in documents in general and shows that specific weighted search methods are implied by a general probabilistic theory of retrieval.

Journal of the ACMOn Relevance, Probabilistic Indexing and Information Retrieval

901 Citations1960M. E. Maron, J. L. Kuhns

The paper suggests an interpretation of the whole library problem as one where the request is considered as a clue on the basis of which the library system makes a concatenated statistical inference in order to provide as an output an ordered list of those documents which most probably satisfy the information needs of the user.

View PDF

Journal of DocumentationAN EVALUATION OF FEEDBACK IN DOCUMENT RETRIEVAL USING CO‐OCCURRENCE DATA

160 Citations1978David J. Harper, C. J. van Rijsbergen

This paper reports experiments with a term weighting model incorporating relevance information in which it is assumed that index terms are distributed dependently and argues that if high recall searches are required, relevance feedback based on the modified dependence model may be superior to the widely used Boolean search.

Journal of the ACMPrecision Weighting—An Effective Automatic Indexing Method

146 Citations1976C. Yu, Gerard Salton

The precision weighting procedure described in the present study uses relevance criteria to weight the terms occurring in user queries as a function of the balance between relevant and nonrelevant documents in which these terms occur; this approximates a semantic know-how of term importance.

View PDF

eCommons (Cornell University)A Generalized Term Dependence Model in Information Retrieval

103 Citations1983C. T. Yu, Chris Buckley +2 more

A generalized term dependence model is introduced in this study which does not carry the disadvantages of either the tree dependence or the BLE models.

View PDF

Journal of the American Society for Information ScienceExploiting the maximum entropy principle to increase retrieval effectiveness

46 Citations1983William S. Cooper

A design approach in which queries consist of sets of terms, either unweighted or weighted with subjective term precision estimates, and retrieval outputs are ranked by probability of usefulness estimated in accordance with the maximum entropy principle results in a system design of increased power and expressiveness without a concomitant increase in the complexity of the request language.

IEEE Transactions on Systems Man and CyberneticsAn Inductive Search System: Theory, Design, and Implementation

36 Citations1986M. E. Maron, Sean Curry +1 more

An automated information system that can accept requests for information and, in response, selects and ranks by probability of satisfaction the names of those people who can answer the input queries is described, based on new probabilistic design principles.

Probabilistic document indexing from relevance feedback data

30 Citations1989Norbert Fuhr, Chris Buckley

Based on the binary independence indexing model, three new concepts for probabilistic document indexing from relevance feedback data are applied:Abstraction from specific terms and documents, Flexibility of the representation, and Probabilistic learning or classification methods for the estimation of the indexing weights making better use of the available relevance information.

Journal of DocumentationA PROBABILISTIC SEARCH STRATEGY FORMEDLARS

28 Citations1971William L. Miller

The Scoring technique successfully widened the scope of the search and retrieved twice as many relevant references as the Boolean searches.

Journal of the American Society for Information ScienceA study of probabilistic information retrieval systems in the case of inconsistent expert judgments

12 Citations1991Jung Jin Lee, Paul B. Kantor

The maximum entropy principle may be applied to the design of probabilistic retrieval systems to find revised judgments which are consistent with the true data structure but still reflect the original expert judgment.