Older versions of the ROUGEeval summarization evaluation system were easier to fool
Generate an AI Snapshot to get a quick, structured summary of this paper.
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A method for automatic summarization based on a Markov model of the source text, by a simple greedy word selection strategy, is presented, and summaries with high ROUGE-scores are generated.
Abstract
We show some limitations of the ROUGE evaluation method for automatic summarization. We present a method for automatic summarization based on a Markov model of the source text. By a simple greedy word selection strategy, summaries with high ROUGE-scores are generated. These summaries would however not be considered good by human readers. The method can be adapted to trick different settings of the ROUGEeval package.