Pseudo-relevance feedback using named entities for question answering
Published 1 January 2006Open access
Luiz Pizzato, Diego Mollá
Citations26
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Whether a pseudo relevance feedback technique on IR can improve the Question Answering task (QA) is explored and the use of relevant named entities from the top retrieved documents as clues of relevance is used.
Abstract
Relevance feedback has already proven its usefulness in probabilistic information retrieval (IR). In this research we explore whether a pseudo relevance feedback technique on IR can improve the Question Answering task (QA). The basis of our exploration is the use of relevant named entities from the top retrieved documents as clues of relevance. We discuss two interesting findings from these experiments: the reasons the results were not improved, and the fact that today’s metrics of IR evaluation on QA do not reflect the results obtained by a QA system. 1
Keywords
Computer Science
Text REtrieval ConferenceOkapi at TREC
2,229 Citations1994Stephen Robertson, Steve Walker +3 more
Much of the work involved investigating plausible methods of applying Okapi-style weighting to phrases, and expansion using terms from the top documents retrieved by a pilot search on topic terms was used.
Learning question classifiers
1,276 Citations2002Xin Li, Dan Roth
A hierarchical classifier is learned that is guided by a layered semantic hierarchy of answer types, and eventually classifies questions into fine-grained classes.
Overview of the TREC 2006.
469 Citations2006Ellen M. Voorhees
The fourteenth Text REtrieval Conference, TREC 2005, was held at the National Institute of Standards and Technology (NIST) 15 to 18 November 2005 and had 117 participating groups from 23 different countries.
Building a question answering test collection
448 Citations2000Ellen M. Voorhees, Dawn M. Tice
The TREC-8 Question Answering (QA) Track was the first large-scale evaluation of domain-independent question answering systems and was used to investigate whether the evaluation methodology used for document retrieval is appropriate for a different natural language processing task.
The Knowledge Engineering ReviewA survey on the use of relevance feedback for information access systems
403 Citations2003Ian Ruthven, Mounia Lalmas
This paper surveys relevance feedback techniques and studies both automatic techniques, in which the system modifies the user's query, and interactive techniques, which the user has control over query modification.
Web question answering
289 Citations2002Susan Dumais, Michele Banko +3 more
This paper describes a question answering system that is designed to capitalize on the tremendous amount of data that is now available online, and uses the redundancy available in large corpora as an important resource to simplify the query rewrites and support answer mining from returned snippets.
Quantitative evaluation of passage retrieval algorithms for question answering
284 Citations2003Stefanie Tellex, Boris Katz +3 more
This work presents a quantitative evaluation of various passage retrieval algorithms for question answering, implemented in a framework called Pauchok, and presents three important findings: Boolean querying schemes perform well in the question answering task.
Medical Entomology and ZoologyEvaluating Natural Language Processing Systems: An Analysis and Review
276 Citations1996Karen Spärck Jones, Julia Galliers
Lecture notes in computer scienceEvaluating Passage Retrieval Approaches for Question Answering
58 Citations2004Ian Roberts, Robert Gaizauskas
Two new measures, coverage and answer redundancy, are introduced which are believed to capture aspects of IR performance specifically relevant to QA more appropriately than do the traditional recall and precision measures.
Simple Translation Models for Sentence Retrieval in Factoid Question Answering
33 Citations2004Vanessa Murdock, W. Bruce Croft
A simple translation model for passage retrieval at the sentence level is presented, and it is demonstrated that it performs better than retrieval based on query likelihood, and on par with other systems.
Lecture notes in computer scienceClassifying Sentences Using Induced Structure
6 Citations2005Menno van Zaanen, Luiz Pizzato +1 more
A new approach to the task of sentence classification, where pre-defined classes are assigned to sentences, where sequential information present in the sentences is used directly and classifiers can be generated automatically and the output and intermediate representations can be investigated and manually optimised if needed.
Data Archiving and Networked Services (DANS)Optimizing information retrieval in question answering using syntactic annotation
3 Citations2005Jörg Tiedemann
This study explores the possibilities of integrating linguistic information taken from machine annotated Dutch newspaper text into information retrieval by describing a genetic algorithm for optimizing queries send to an enriched IR index.