A generalized framework of exploring category information for question retrieval in community question answer archives
Published 26 April 2010
Xin Cao, Gao Cong, Bin Cui, Christian S. Jensen
Citations101
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper presents a new approach to exploiting category information of questions for improving the performance of question retrieval, and applies the approach to existing question retrieval models, including a state-of-the-art question retrieval model.
Abstract
Community Question Answering (CQA) has emerged as a popular type of service where users ask and answer questions and access historical question-answer pairs. CQA archives contain very large volumes of questions organized into a hierarchy of categories. As an essential function of CQA services, question retrieval in a CQA archive aims to retrieve historical question-answer pairs that are relevant to a query question. In this paper, we present a new approach to exploiting category information of questions for improving the performance of question retrieval, and we apply the approach to existing question retrieval models, including a state-of-the-art question retrieval model. Experiments conducted on real CQA data demonstrate that the proposed techniques are capable of outperforming a variety of baseline methods significantly.
Keywords
Computer Science
Text REtrieval ConferenceOkapi at TREC
2,229 Citations1994Stephen Robertson, Steve Walker +3 more
Much of the work involved investigating plausible methods of applying Okapi-style weighting to phrases, and expansion using terms from the top documents retrieved by a pilot search on topic terms was used.
Finding high-quality content in social media
1,237 Citations2008Eugene Agichtein, Carlos Castillo +3 more
This paper introduces a general classification framework for combining the evidence from different sources of information, that can be tuned automatically for a given social media type and quality definition, and shows that its system is able to separate high-quality items from the rest with an accuracy close to that of humans.
ACM Transactions on Information SystemsA study of smoothing methods for language models applied to information retrieval
1,212 Citations2004ChengXiang Zhai, John Lafferty
Evaluation on five different databases and four types of queries indicates that the two-stage smoothing method with the proposed parameter estimation methods consistently gives retrieval performance that is close to or better than the best results achieved using a single smoothing methods and exhaustive parameter search on the test data.
ACM Computing SurveysInverted files for text search engines
1,077 Citations2006Justin Zobel, Alistair Moffat
This tutorial introduces the key techniques in the area of text indexing, describing both a core implementation and how the core can be enhanced through a range of extensions.
ACM SIGIR ForumPivoted Document Length Normalization
863 Citations2017Amit Singhal, Chris Buckley +1 more
Pivoted normalization is presented, a technique that can be used to modify any normalization function thereby reducing the gap between the relevance and the retrieval probabilities, and two new normalization functions--pivoted unique normalization and piuotert byte size normalization are presented.
Pivoted document length normalization
545 Citations1996Amit Singhal, Chris Buckley +1 more
Pivoted normalization is presented, a technique that can be used to modify any normalization function thereby reducing the gap between the relevance and the retrieval probabilities and two new normalization functions are presented–-pivoted unique normalization and piuotert byte size nornaahzation.
Finding similar questions in large question and answer archives
438 Citations2005Jiwoon Jeon, W. Bruce Croft +1 more
Methods for question retrieval that are based on using the similarity between answers in the archive to estimate probabilities for a translation-based retrieval model are discussed and it is shown that with this model it is possible to find semantically similar questions with relatively little word overlap.
Retrieval models for question and answer archives
370 Citations2008Xiaobing Xue, Jiwoon Jeon +1 more
A retrieval model that combines a translation-based language model for the question part with a query likelihood approach for the answer part and incorporates word-to-word translation probabilities learned through exploiting different sources of information is proposed.
A formal study of information retrieval heuristics
352 Citations2004Hui Fang, Tao Tao +1 more
A formal study of retrieval heuristics is presented and it is found that the empirical performance of a retrieval formula is tightly related to how well it satisfies basic desirable constraints.
AI MagazineQuestion Answering from Frequently Asked Question Files: Experiences with the FAQ Finder System
339 Citations1997Robin Burke, Kristian J. Hammond +4 more
This technical report describes FAQ Finder, a natural language question answering system that uses files of frequently asked questions as its knowledge base, and describes the design and the current implementation of the system and its support components.
Bridging the lexical chasm
309 Citations2000Adam Berger, Rich Caruana +3 more
It is shown that the task of “answer-finding” differs from both document retrieval and tradition question-answering, presenting challenges different from those found in these problems.
Finding the right facts in the crowd
277 Citations2008Jiang Bian, Yandong Liu +2 more
A general ranking framework for factual information retrieval from social media is presented and results of a large scale evaluation demonstrate that the method is highly effective at retrieving well-formed, factual answers to questions, as evaluated on a standard factoid QA benchmark.
Predicting information seeker satisfaction in community question answering
258 Citations2008Yandong Liu, Jiang Bian +1 more
This paper attempts to predict whether a question author will be satisfied with the answers submitted by the community participants, and presents a general prediction model, and develops a variety of content, structure, and community-focused features for this task.
Statistical Machine Translation for Query Expansion in Answer Retrieval
221 Citations2007Stefan Riezler, Alexander Vasserman +3 more
An approach to query expansion in answer retrieval that uses Statistical Machine Translation (SMT) techniques to bridge the lexical gap between questions and answers is presented.
A syntactic tree matching approach to finding similar questions in community-based qa services
220 Citations2009Kai Wang, Zhaoyan Ming +1 more
This paper proposes a new retrieval framework based on syntactic tree structure to tackle the similar question matching problem and builds a ground-truth set from Yahoo! Answers, and experimental results show that the method outperforms traditional bag-of-word or tree kernel based methods.
IEEE Transactions on Knowledge and Data EngineeringAutomatic text categorization and its application to text retrieval
137 Citations1999Wai Lam, María Isabel Doval Ruiz +1 more
This work develops an automatic text categorization approach and investigates its application to text retrieval, demonstrating the effectiveness of the approach and demonstrating that the retrieval performance using automatic categorization achieves the same retrieval quality as the performance using manual categorization.
Searching Questions by Identifying Question Topic and Question Focus
135 Citations2008Huizhong Duan, Yunbo Cao +2 more
Experimental results indicate that the approach of identifying question topic and question focus for search significantly outperforms the baseline methods such as Vector Space Model (VSM) and Language Model for Information Retrieval (LMIR).
Retrieving answers from frequently asked questions pages on the web
129 Citations2005Valentin Jijkoun, Maarten de Rijke
The use of categorization information in language models for question retrieval
104 Citations2009Xin Cao, Gao Cong +3 more
A category-based framework for search in CQA archives is proposed that embodies several new techniques that use language models to exploit categories of questions for improving question-answer search.
Finding semantically similar questions based on their answers
89 Citations2005Jiwoon Jeon, W. Bruce Croft +1 more
An automatic method that can detect semantically similar questions that have little word overlap because it calculates question-question similarities by using the corresponding answers as well as the questions.
North American Chapter of the Association for Computational LinguisticsAutomatic Question Answering: Beyond the Factoid.
87 Citations2004Radu Soricut, Eric Brill
This paper describes and evaluates a Question Answering system that goes beyond answering factoid questions, and builds the system around a noisy-channel architecture which exploits both a language model for answers and a transformation model for answer/question terms.