DR-LINK in TIPSTER III
Information RetrievalPublished 1 December 2000Open access
Elizabeth D. Liddy, Ted Diamond, Mary C. McKenna
Citations4
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Experimental results show that there is potential for improving retrieval through query-specific fusion and that analysts found the Detailed Multiple Document Summary to be extremely useful for almost every query, while the Thumbnail sketch was useful in approximately 50% of the queries.
Abstract
A Natural Language Processing based Information Retrieval System that was one of the original systems developed in Phase I of TIPSTER, was the basis of research in TIPSTER III the goal of which was to add two extended capabilities to the core system. Following a description of the multiple levels of linguistic processing that were developed for the original DR-LINK System, details are provided on research into query-specific data fusion and query-specific cross-document summarization. Experimental results show that there is potential for improving retrieval through query-specific fusion and that analysts found the Detailed Multiple Document Summary to be extremely useful for almost every query, while the Thumbnail sketch was useful in approximately 50% of the queries.
Keywords
Computer Science
BiometricsThe Measurement of Observer Agreement for Categorical Data
78,934 Citations1977J. Richard Landis, Gary G. Koch
A general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies is presented and tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interob server agreement are developed as generalized kappa-type statistics.
Journal of the American Statistical AssociationContent Analysis: An Introduction to its Methodology.
24,566 Citations1984Mack Shelley, Klaus Krippendorff
International Journal of LexicographyIntroduction to WordNet: An On-line Lexical Database<sup>*</sup>
4,207 Citations1990George A. Miller, Richard Beckwith +3 more
Standard alphabetical procedures for organizing lexical information put together words that are spelled alike and scatter words with similar or related meanings haphazardly through the list.
arXiv (Cornell University)Assessing agreement on classification tasks: the kappa statistic
2,092 Citations1996Jean Carletta
Text REtrieval ConferenceCombination of multiple searches
917 Citations1994Edward A. Fox, Joseph A. Shaw
This paper describes one method that has been shown to increase performance by combining the similarity values from five different retrieval runs using both vector space and P-norm extended boolean retrieval methods.
ACM SIGIR ForumPivoted Document Length Normalization
863 Citations2017Amit Singhal, Chris Buckley +1 more
Pivoted normalization is presented, a technique that can be used to modify any normalization function thereby reducing the gap between the relevance and the retrieval probabilities, and two new normalization functions--pivoted unique normalization and piuotert byte size normalization are presented.
The Thread of Discourse
585 Citations1975Joseph E. Grimes
Pivoted document length normalization
545 Citations1996Amit Singhal, Chris Buckley +1 more
Pivoted normalization is presented, a technique that can be used to modify any normalization function thereby reducing the gap between the relevance and the retrieval probabilities and two new normalization functions are presented–-pivoted unique normalization and piuotert byte size nornaahzation.
Text, speech and language technologyNatural Language Information Retrieval
324 Citations1999Tomek Strzalkowski
Information Processing & ManagementCombining the evidence of multiple query representations for information retrieval
268 Citations1995Nicholas J. Belkin, Paul B. Kantor +2 more
Both projects found that the best method of combination often led to results that were better than the best performing single query, and the combined results from the two projects have also been combined by data fusion.
ACM Transactions on Information SystemsExperiences with selecting search engines using metasearch
196 Citations1997Daniel Dreilinger, Adele E. Howe
The efficacy of SavvySearch's incrementally acquired metaindex approach to selecting search engines is studied by analyzing the effect of time and experience on performance and how much experience is required to surpass the simple scheme.
Predicting the performance of linearly combined IR systems
119 Citations1998Christopher C. Vogt, Garrison W. Cottrell
A new technique for analyzing combination models that allows to make qualitative conclusions about which IR systems should be combined by using a linear regression to accurately predict the performance of the combined system based on quantitative measurements of individual component systems taken from TREC5.
Automatic Combination of Multiple Ranked Retrieval Systems
108 Citations1994Brian T. Bartell, Garrison W. Cottrell +1 more
This work proposes a method by which the relevance estimates made by different experts can be automatically combined to result in superior retrieval performance and applies the method to two expert combination tasks.
Method combination for document filtering
102 Citations1996David A. Hull, Jan Pedersen +1 more
It is found that simple averaging strategies do indeed improve performance, but that direet averaging of probability estimates is not the correet approach, and the probabiJit y estimates must be renormalized using logistic regression on the known relevance judgments.
Bulletin of the American Society for Information Science and TechnologyEnhanced Text Retrieval Using Natural Language Processing
87 Citations1998Elizabeth D. Liddy
Quelques ameliorations basees sur l'emploi du traitement du langage naturel ont atteint finalement les moteurs de recherche du commmerce, mais il n'y a pas d'usage normalise en terminologie pour decrire leur processus.
ACM Transactions on Information SystemsText categorization for multiple users based on semantic features from a machine-readable dictionary
39 Citations1994Elizabeth D. Liddy, Woojin Paik +1 more
The text categorization module described here provides a front-end filtering function for the larger DR-LINK text retrieval system to determine which documents are sufficiently similar to a profile at the broad subject level to warrant more refined representation and matching.
Text REtrieval ConferenceDR-LINK's linguistic conceptual approach to document detection
29 Citations1993Elizabeth D. Liddy, Sung Hyon Myaeng
To produce richer representations of documents and topic statements, this work has developed a system whose architecture is modular in design and which uses lexical, syntactic, semantic and discourse processing techniques.
Development, implementation and testing of a discourse model for newspaper texts
21 Citations1993Elizabeth D. Liddy, Kenneth A. McVearry +3 more
A Text Structurer module which recognizes text-level structure for use within a larger information retrieval system to delineate the discourse-level organization of each document's contents to allow those document components which are more likely to contain the type of information suggested by the user's query to be selected for higher weighting.
DR-LINK: A System Update for TREC-2
15 Citations1994Elizabeth D. Liddy, Sung-Hyon Myaeng
The DR-LINK Text Retrieval System has developed a modular system which processes and represent text, at the lexical, syntactic, semantic, and discourse levels of language, to achieve a level of intelligent retrieval beyond more traditional appraoches.
Text REtrieval ConferenceReport on the TREC-4 Experiment: Combining Probabilistic and Vector-Space Schemes.
15 Citations1995Jacques Savoy, Melchior Ndarugendamwo +1 more
Can the statistical characteristics of a query be good predicators in an automatic selection procedure and faced with the relativity high retrieval effectiveness achieved by the OKAPI model, can various vector-space schemes further improve the retrieval performance of the OK API approach?
Development and Implementation of a Discourse Model for Newspaper Texts
10 Citations1995Elizabeth D. Liddy, Woojin Paik +1 more
A discourse model is developed for use in a Text Structuring module that recognizes discourse-level structure within a large-scale information retrieval system, DR-LINK, and produces an enriched representation of each document by computationally decomposing it into smaller, conceptually labelled components.
Multimedia Information RetrievalDocument retrieval using linguistic knowledge
6 Citations1994Elizabeth D. Liddy, Woojin Paik +2 more
The DR-LINK Text Retrieval System is a modular system which processes and represents text at the lexical, syntactic, semantic, and discourse levels of language, allowing it to achieve a level of intelligent retrieval beyond more traditional approaches.
DR-LINK system
2 Citations1993Elizabeth D. Liddy, Sung Hyon Myaeng
DR-LINK has developed a modular system which processes, represents, and matches text at the lexical, syntactic, semantic, and discourse levels of language, which allows it to achieve a level of intelligent retrieval beyond more traditional approaches.