Evaluation of phrase-representation summarization based on information retrieval task
Generate an AI Snapshot to get a quick, structured summary of this paper.
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
An improved task-based evaluation method of summarization is developed, the accuracy of which is increased by specifying the details of the task including background stories, and by assigning ten subjects per summary sample.
Abstract
We have developed an improved task-based evaluation method of summarization, the accuracy of which is increased by specifying the details of the task including background stories, and by assigning ten subjects per summary sample. The method also serves precision/recall pairs for a variety of situations by introducing multiple levels of relevance assessment. The method is applied to prove phrase-represented summary is most effective to select relevant documents from information retrieval results.