login

Strength and similarity of affix removal stemming algorithms

ACM SIGIR ForumPublished 1 April 2003
William B. Frakes, Christopher J. Fox
Citations121

TL;DR

This study evaluated the strength of, and similarity among, four affix removal stemming algorithms based on a list of 49,656 English words derived from the UNIX spelling dictionary and the Moby corpus.

Abstract

This study evaluated the strength of, and similarity among, four affix removal stemming algorithms. Strength and similarity were evaluated in different ways, including new metrics based on the Hamming distance measure. Data was collected on stemmer outputs for a list of 49,656 English words derived from the UNIX spelling dictionary and the Moby corpus. Conclusions about the relative strength and similarity of the four stemming algorithms are reported.

Keywords

Computer ScienceSocial Sciences