Overview of the Sixth Text REtrieval Conference (TREC-6)
Information Processing & ManagementPublished 1 January 2000
Ellen M. Voorhees, Donna Harman
Citations315
SJR quartileQ1
SJR score2.06
SNIP2.91
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The Text REtrieval Conference is a workshop series designed to encourage research on text retrieval for realistic applications by providing large test collections, uniform scoring procedures and a forum for organizations interested in comparing results.
Abstract
The Text REtrieval Conference is a workshop series designed to encourage research on text retrieval for realistic applications by providing large test collections, uniform scoring procedures and a forum for organizations interested in comparing results. TREC contains two main retrieval tasks plus optional subtasks that allow participants to focus on particular common subproblems in retrieval. The emphasis on individual experiments evaluated in a common setting has proven to be very successful. In the six years since the beginning of TREC, the state of the art in retrieval effectiveness has approximately doubled, and technology transfer among research labs and between research systems and commercial products has accelerated. In addition, TREC has sponsored the first large-scale evaluations of Chinese language retrieval, retrieval of speech and retrieval across different languages.
Keywords
Computer Science
Morgan Kaufmann Publishers Inc. eBooksReadings in information retrieval
1,064 Citations1997Karen Spärck Jones, Peter Willett
How reliable are the results of large-scale information retrieval experiments?
577 Citations1998Justin Zobel
A detailed empirical investigation of the TREC results shows that the measured relative performance of systems appears to be reliable, but that recall is overestimated: it is likely that many relevant documents have not been found.
Information Processing & ManagementVariations in relevance judgments and the measurement of retrieval effectiveness
505 Citations2000Ellen M. Voorhees
Relevance and Information Behavior.
315 Citations1994Linda Schamber
The author views relevance as a manifestation of human information behavior and excludes work that views relevance only as a matching or computational functions of IR systems.
Efficient construction of large test collections
233 Citations1998Gordon V. Cormack, Christopher R. Palmer +1 more
This work proposes two methods, Intemctive Searching and Judging and Moveto-front Pooling, that yield effective test collections while requiring many fewer judgements.
Text REtrieval ConferenceOverview of the Fourth Text REtrieval Conference (TREC-4)
205 Citations1996Donna Harman
Un resume of cette conference (TREC-4), une description des collections tests utilisees pour les recherches mises en place lors ofertains, and il en souligne les resultats.
Information Processing & ManagementUsing clustering and SuperConcepts within SMART: TREC 6
131 Citations2000Chris Buckley, Mandar Mitra +2 more
The major focus for TREC 6 is on trying to maintain the balance of the query — attempting to ensure the various aspects of the original query are appropriately addressed, especially while adding expansion terms.
Aspect windows, 3-D visualizations, and indirect comparisons of information retrieval systems
90 Citations1998Russell Swan, James Allan
Two Information Retrieval systems built to test the usefulness of different visualizations in an interactive IR setting and show substantial differences in user performance are related to spatial reasoning ability and to a lesser degree other traits.
Comparing interactive information retrieval systems across sites
84 Citations1998Eric S. Lagergren, Paul Over
The results confirm the dominance of the topic effect, show the searcher effect is almost as often absent as present, and indicate that for several sites the a-factor interactions are negligible.
INQUERY does battle with TREC-6
83 Citations1997James Allan, James P. Callan +5 more
Okapi at TREC-6 automatic ad hoc, VLC, routing, filtering and QSDR
69 Citations1997Steve Walker, Stephen Robertson +3 more
Recherche d'information sur le catalogue en ligne OKAPI : VLC= Very Large Collection SDR= Spoken Document Retrieval.
Information Processing & ManagementReflections on TREC
66 Citations1995Karen Spärck Jones
The TREC programme is reviewed as an evaluation exercise, the methods of indexing and retrieval being tested within it in terms of the approaches to system performance factors these represent, and the test results are analyzed.
Information Processing & ManagementThe second Text Retrieval Conference (TREC-2)
31 Citations1995Donna Harman
ANU/ACSys TREC-5 Experiments.
28 Citations1996David Hawking, Paul B. Thistlewaite +1 more
Text REtrieval ConferencePassage-Based Refinement (MultiText Experiements for TREC-6).
24 Citations1997Gordon V. Cormack, Charles L. A. Clarke +2 more
Crowdfunding’s relations with the health care industry, seeking the crowdfunding levers and the effects that crowdfunding has on the innovation and accessibility of medical treatments are described, as well as an approach based on a variant of super-efficiency models and their duals are proposed.
Phrase discovery for English and Cross-Language Retrieval at TREC-6
18 Citations1997Fredric C. Gey, Aitao Chen
The GURU system in TREC-6
17 Citations1997Eric W. Brown, Herb A. Chong
Text REtrieval ConferenceMercure at TREC6.
11 Citations1997Mohand Boughanem, Chantal Soulé-Dupuy
Mercure continues its work in TREC performing runs in adhoc, routing and part of the cross language track.
ETH TREC-6 : Routing, Chinese, Cross-Language and Spoken Document Retrieval
11 Citations1997Bojidar Mateev, Eugen Munteanu +3 more
Presentation de nouvelles methodes de recherche d'information, evaluees dans le cadre du TREC-6, d'abord entre langues differentes et de systemes de traduction automatique.
Information Processing & ManagementVerity at TREC-6: out-of-the-box and beyond
7 Citations2000Jan Pedersen, Craig Silverstein +1 more
The Verity TREC-6 entry focused on the performance of the built-in search facilities of the commercially available Verity engine and explored the impact of simple enhancements.
Expanding Relevance Feedback in the Relational Model.
5 Citations1997Carol Lundquist, David Holmes +3 more
In TREC 6, the relevance feedback methodology was expanded to include additional term weighting methods as well as feedback term scaling, and the relevance ranking scores between documents and queries could be improved by eliminating certain highly weighted terms.
Daimler Benz Research : System and experiments routing and filtering
4 Citations1997Thomas A. Bayer, Heike Mogg-Schneider +2 more
The retrieval approach is based on vector representation, dimension reduction, LSI, latent semantic indexing and statistical machine learning techniques in all processing levels.
CSIRO Routing and Ad-Hoc Experiments at TREC-6.
2 Citations1997Arkadi Kosmynin
Evaluation des performances dans le cadre TREC 6 : utilisation d'un methode vectorielle de recherche d'information, recherches basee sur le contexte.