A neural network based approach to automated e-mail classification

Published 23 April 2004

James J. Clark, Irena Koprinska, Josiah Poon

DOI10.1109/wi.2003.1241300

Citations177

TL;DR

A neural network based system for automated e-mail filing into folders and anti-spam filtering that is more accurate than several other techniques and also the portability of the anti- Spam filter across different users is investigated.

Abstract

We present a neural network based system for automated e-mail filing into folders and anti-spam filtering. The experiments show that it is more accurate than several other techniques. We also investigate the effects of various feature selection, weighting and normalization methods, and also the portability of the anti-spam filter across different users.

Keywords

Computer Science

A Bayesian Approach to Filtering Junk E-Mail

1,153 Citations1998Mehran Sahami, Susan Dumais +2 more

This work examines methods for the automated construction of filters to eliminate such unwanted messages from a user’s mail stream, and shows the efficacy of such filters in a real world usage scenario, arguing that this technology is mature enough for deployment.

An experimental comparison of naive Bayesian and keyword-based anti-spam filtering with personal e-mail messages

451 Citations2000Ion Androutsopoulos, John Koutsias +2 more

This work introduces appropriate cost-sensitive measures, and investigates at the same time the effect of attribute-set size, training-corpus size, lemmatization, and stop lists, issues that have not been explored in previous experiments.

View PDF

Learning Rules that Classify E-Mail

400 Citations1996William W. Cohen

Two methods for learning text classifiers are compared on classification problems that might arise in filtering and filing personM e-mail messages: a "traxiitionM IR" method based on TF-IDF weighting, and a new method for learning sets of "keyword-spotting rules" based on the RIPPER rule learning algorithm.

arXiv (Cornell University)Boosting Trees for Anti-Spam Email Filtering

342 Citations2001Xavier Carreras, Lluı́s Màrquez

The boosting-based methods clearly outperform the baseline learning algorithms on the PU1 corpus, achieving very high levels of the F1 measure and obtaining better ``high-precision'' classifiers, which is a very important issue when misclassification costs are considered.

View PDF

arXiv (Cornell University)Learning to Filter Spam E-Mail: A Comparison of a Naive Bayesian and a Memory-Based Approach

282 Citations2000Ion Androutsopoulos, Γεώργιος Παλιούρας +4 more

This work investigates thoroughly the performance of the Naive Bayesian filter on a publicly available corpus, contributing towards standard benchmarks and compares it to an alternative memorybased learning approach, after introducing suitable cost-sensitive evaluation measures.

View PDF

arXiv (Cornell University)Stacking classifiers for anti-spam filtering of e-mail

143 Citations2001Georgios Sakkis, Ion Androutsopoulos +4 more

View PDF

ifile: An Application of Machine Learning to E-Mail Filtering

118 Citations2000Jason D. M. Rennie

Here, problems that plague practical e-mail filtering are attacked and solutions are suggested that will bring us closer to the acceptance of using automated classification techniques to filter personal e-mails.