Priberam’s Question Answering System in QA@CLEF 2007

Lecture notes in computer sciencePublished 1 January 2008

Carlos Amaral, Adán Cassan, Helena Andrade Figueira, André F. T. Martins, Afonso Mendes, Pedro Mendes

DOI10.1007/978-3-540-85760-0_46

Source URL

Citations15

SJR quartileQ2

SJR score0.35

SNIP0.55

Abstract

This paper accounts for Priberam's participation in the monolingual question answering (QA) track of CLEF 2007. In previous participations, Priberam's QA system obtained encouraging results both in monolingual and cross-language tasks. This year we endowed the system with syntactical processing, in order to capture the syntactic structure of the question. The main goal was to obtain a more tuned question categorisation and consequently a more precise answer extraction. Besides this, we provided our system with the ability to handle topic-related questions and to use encyclopaedic sources like Wikipedia. The paper provides a description of the improvements made in the system, followed by the discussion of the results obtained in Portuguese and Spanish monolingual runs.

Keywords

Computer Science

Communications of the ACMAn efficient context-free parsing algorithm

817 Citations1970Jay Earley

A parsing algorithm which seems to be the most efficient general context-free algorithm known is described and appears to be superior to the top-down and bottom-up algorithms studied by Griffiths and Petrick.

View PDF

Lecture notes in computer scienceOverview of the CLEF 2004 Multilingual Question Answering Track

122 Citations2005Bernardo Magnini, Alessandro Vallin +7 more

The evaluation exercise for multilingual QA systems took place in 2004 highlighted some difficulties in assessing definition questions and can be improved in the future, but the overall analysis of submissions shows encouraging results.

Lecture notes in computer scienceOverview of the CLEF 2005 Multilingual Question Answering Track

89 Citations2006Alessandro Vallin, Bernardo Magnini +9 more

An overview of the 2005 QA track is provided, the procedure followed to build the test sets and the results are presented, showing that the best systems did not always provide the most reliable confidence score.

Lecture notes in computer scienceOverview of the CLEF 2006 Multilingual Question Answering Track

85 Citations2007Bernardo Magnini, Danilo Giampiccolo +8 more

The preparation of the test set and the evaluation process are described, together with a detailed presentation of the results for each of the languages, and two pilot tasks WiQA and AVE will be presented in dedicated articles.

Lecture notes in computer scienceOverview of the CLEF 2007 Multilingual Question Answering Track

58 Citations2008Danilo Giampiccolo, Pamela Forner +9 more

The results and the analyses reported by the participants suggest that the introduction of Wikipedia and the topic related questions led to a drop in systems' performance.

Lecture notes in computer sciencePriberam’s Question Answering System for Portuguese

28 Citations2006Carlos Amaral, Helena Andrade Figueira +4 more

The work done by Priberam in the development of a question answering (QA) system for Portuguese was built using the company’s natural language processing (NLP) workbench and information retrieval technology.

Lecture notes in computer sciencePriberam’s Question Answering System in a Cross-Language Environment

25 Citations2007Adán Cassan, Helena Andrade Figueira +5 more

The improvements and changes implemented in Priberam's QA system since last CLEF participation are described, detailing the work involved in its cross-lingual extension and discussing the results of the runs submitted to evaluation.

Lecture notes in computer sciencePriberam’s Question Answering System in QA@CLEF 2007

15 Citations2008Carlos Amaral, Adán Cassan +6 more