Some inconsistencies and misidentified modeling assumptions in probabilistic information retrieval

ACM Transactions on Information SystemsPublished 2 January 1995Open access

William S. Cooper

DOI10.1145/195705.195735

Source URL

Citations73

SJR quartileQ1

SJR score1.54

SNIP2.78

View PDF

TL;DR

Research in the probabilistic theory of information retrieval involves the construction of mathematical models based on statistical assumptions, including the so-called Binary Independence model, which has been seriously misapprehended.

Abstract

article Free Access Share on Some inconsistencies and misidentified modeling assumptions in probabilistic information retrieval Author: William S. Cooper Univ. of California, Berkeley Univ. of California, BerkeleyView Profile Authors Info & Claims ACM Transactions on Information SystemsVolume 13Issue 1Jan. 1995 pp 100–111https://doi.org/10.1145/195705.195735Published:02 January 1995Publication History 50citation748DownloadsMetricsTotal Citations50Total Downloads748Last 12 Months21Last 6 weeks1 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my Alerts New Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteeReaderPDF

Keywords

Computer ScienceDecision Sciences

Journal of the American Society for Information ScienceRelevance weighting of search terms

2,068 Citations1976Stephen Robertson, Karen Spärck Jones

This paper examines statistical techniques for exploiting relevance information to weight search terms using information about the distribution of index terms in documents in general and shows that specific weighted search methods are implied by a general probabilistic theory of retrieval.

Journal of the ACMOn Relevance, Probabilistic Indexing and Information Retrieval

901 Citations1960M. E. Maron, J. L. Kuhns

The paper suggests an interpretation of the whole library problem as one where the request is considered as a clue on the basis of which the library system makes a concatenated statistical inference in order to provide as an output an ordered list of those documents which most probably satisfy the information needs of the user.

View PDF

ACM Transactions on Information SystemsA probabilistic learning approach for document indexing

202 Citations1991Norbert Fuhr, Chris Buckley

A method for probabilistic document indexing using relevance feedback data that has been collected from a set of queries based on three new concepts, which allows the integration of new text analysis and knowledge-based methods in this approach as well as the consideration of document structures or different types of terms.

View PDF

Journal of DocumentationAN EVALUATION OF FEEDBACK IN DOCUMENT RETRIEVAL USING CO‐OCCURRENCE DATA

160 Citations1978David J. Harper, C. J. van Rijsbergen

This paper reports experiments with a term weighting model incorporating relevance information in which it is assumed that index terms are distributed dependently and argues that if high recall searches are required, relevance feedback based on the modified dependence model may be superior to the widely used Boolean search.

Journal of the ACMPrecision Weighting—An Effective Automatic Indexing Method

146 Citations1976C. Yu, Gerard Salton

The precision weighting procedure described in the present study uses relevance criteria to weight the terms occurring in user queries as a function of the balance between relevant and nonrelevant documents in which these terms occur; this approximates a semantic know-how of term importance.

View PDF

eCommons (Cornell University)A Generalized Term Dependence Model in Information Retrieval

103 Citations1983C. T. Yu, Chris Buckley +2 more

A generalized term dependence model is introduced in this study which does not carry the disadvantages of either the tree dependence or the BLE models.

View PDF

Journal of the American Society for Information ScienceExploiting the maximum entropy principle to increase retrieval effectiveness

46 Citations1983William S. Cooper

A design approach in which queries consist of sets of terms, either unweighted or weighted with subjective term precision estimates, and retrieval outputs are ranked by probability of usefulness estimated in accordance with the maximum entropy principle results in a system design of increased power and expressiveness without a concomitant increase in the complexity of the request language.

IEEE Transactions on Systems Man and CyberneticsAn Inductive Search System: Theory, Design, and Implementation

36 Citations1986M. E. Maron, Sean Curry +1 more

An automated information system that can accept requests for information and, in response, selects and ranks by probability of satisfaction the names of those people who can answer the input queries is described, based on new probabilistic design principles.

Probabilistic document indexing from relevance feedback data

30 Citations1989Norbert Fuhr, Chris Buckley

Based on the binary independence indexing model, three new concepts for probabilistic document indexing from relevance feedback data are applied:Abstraction from specific terms and documents, Flexibility of the representation, and Probabilistic learning or classification methods for the estimation of the indexing weights making better use of the available relevance information.

Journal of DocumentationA PROBABILISTIC SEARCH STRATEGY FORMEDLARS

28 Citations1971William L. Miller

The Scoring technique successfully widened the scope of the search and retrieved twice as many relevant references as the Boolean searches.