CLEF 2000 — Overview of Results
Lecture notes in computer sciencePublished 1 January 2001
Martín Braschler
Citations25
SJR quartileQ2
SJR score0.35
SNIP0.55
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Details of the various subtasks are presented, and the analysis indicates that the CLEF relevance assessments are of comparable quality to those of the well-known and trusted TREC ad-hoc collections.
Abstract
The first CLEF campaign was a big success in attracting increased participation when compared to its predecessor, the TREC8 cross-language track. Both the number of participants and of experiments has grown considerably. This paper presents details of the various subtasks, and attempts to summarize the main results and research directions that were observed. Additionally, the CLEF collection is examined with respect to the completeness of its relevance assessments. The analysis indicates that the CLEF relevance assessments are of comparable quality to those of the well-known and trusted TREC ad-hoc collections.
Keywords
Computer Science
How reliable are the results of large-scale information retrieval experiments?
577 Citations1998Justin Zobel
A detailed empirical investigation of the TREC results shows that the measured relative performance of systems appears to be reliable, but that recall is overestimated: it is likely that many relevant documents have not been found.
Information Processing & ManagementVariations in relevance judgments and the measurement of retrieval effectiveness
505 Citations2000Ellen M. Voorhees
Overview of the Eighth Text REtrieval Conference (TREC-8).
305 Citations1999Ellen M. Voorhees, Donna Harman
Lecture notes in computer scienceCross-Language Information Retrieval and Evaluation
151 Citations2001C Peters, Kraaij, Wessel +2 more
When you read more every page of this cross language information retrieval and evaluation, what you will obtain is something great.
Cross-Language Information Retrieval (CLIR) Track Overview.
95 Citations1998Peter Scháuble, Páraic Sheridan
Recherche d'informations dans le cas ou les documents sont ecrits dans une langue differente de celle employee dans la requete: resultats obtenus par 13 groupes de travail employant des methodes differentes.
Lecture notes in computer scienceThe Domain-Specific Task of CLEF - Specific Evaluation Strategies in Cross-Language Information Retrieval
49 Citations2001Michael Kluck, Fredric C. Gey
The domain-specific cross-language information retrieval (CLIR) task of CLEF is described, why and why it is important and how it differs from general cross- language retrieval problem associated with the general CLEF collections.
Lecture notes in computer scienceExperiments with the Eurospider Retrieval System for CLEF 2000
41 Citations2001Martín Braschler, Peter Scháuble
The goal of these experiments was to investigate query translation using different methods, as well as document translation, and a main focus was the use of so-called similarity thesauri for query translation.
Lecture notes in computer scienceTranslation Resources, Merging Strategies, and Relevance Feedback for Cross-Language Information Retrieval
41 Citations2001Djoerd Hiemstra, Wessel Kraaij +2 more
The Twenty-One group participated in the monolingual, bilingual and multilingual tasks and performed preliminary experiments to exploit the web to generate translation probabilities and bilingual dictionaries, notably for English-Italian and English-Dutch.
Lecture notes in computer scienceA Language-Independent Approach to European Text Retrieval
37 Citations2001Paul McNamee, James Mayfield +1 more
An approach to multilingual information retrieval that does not depend on the existence of specific linguistic resources such as stemmers or thesauri is presented and a translation method using aligned parallel corpora to commercial machine translation software is compared.
Lecture notes in computer scienceWest Group at CLEF 2000: Non-english Monolingual Retrieval
25 Citations2001Isabelle Moulinier, J. Andrew McCulloh +1 more
The results suggest that German retrieval is indeed different from English or French retrieval, inasmuch as accounting for compounds can significantly improve performance.
Lecture notes in computer scienceCross-Language Retrieval for the CLEF Collections — Comparing Multiple Methods of Retrieval
22 Citations2001Fredric C. Gey, Hailing Jiang +2 more
A manual reformulation of the original German queries was prepared which achieved excellent performance, more than 110% better than average of median precision.
Lecture notes in computer scienceMultilingual Information Retrieval Based on Parallel Texts from the Web
16 Citations2001Jian‐Yun Nie, Michel Simard +1 more
The results show that the models trained on the parallel web pages can achieve reasonable CLIR performance, however, combining models effectively is a difficult task, and single models still yield better results.
Lecture notes in computer scienceSheffield University CLEF 2000 Submission — Bilingual Track: German to English
6 Citations2001Tim Gollins, Mark Sanderson