Identifying Image Spam based on Header and File Properties using C4.5 Decision Trees and Support Vector Machine Learning

Published 1 June 2007

Sven Krasser, Yuchun Tang, Jeremy Gould, Dmitri Alperovitch, Paul Judge

DOI10.1109/iaw.2007.381941

Citations58

TL;DR

A feature extraction and classification framework that operates on features that can be extracted from image files in a very fast fashion that is able to detect a large amount of malicious images while being computationally inexpensive.

Abstract

Image spam poses a great threat to email communications due to high volumes, bigger bandwidth requirements, and higher processing requirements for filtering. We present a feature extraction and classification framework that operates on features that can be extracted from image files in a very fast fashion. The features considered are thoroughly analyzed regarding their information gain. We present classification performance results for C4.5 decision tree and support vector machine classifiers. Lastly, we compare the performance that can be achieved using these fast features to a more complex image classifier operating on morphological features extracted from fully decoded images. The proposed classifier is able to detect a large amount of malicious images while being computationally inexpensive.

Keywords

Computer Science

TechnometricsStatistical Learning Theory

26,913 Citations1999Yuhai Wu, Vladimir Vapnik

Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.

C4.5: Programs for Machine Learning

23,665 Citations1992J. R. Quinlan

A complete guide to the C4.5 system as implemented in C for the UNIX environment, which starts from simple core learning methods and shows how they can be elaborated and extended to deal with typical problems such as missing data and over hitting.

Pattern RecognitionThe use of the area under the ROC curve in the evaluation of machine learning algorithms

7,233 Citations1997Andrew P. Bradley

AUC exhibits a number of desirable properties when compared to overall accuracy: increased sensitivity in Analysis of Variance (ANOVA) tests; a standard error that decreased as both AUC and the number of test samples increased; decision threshold independent; and it is invariant to a priori class probabilities.

View PDF

Programs for Machine Learning

5,794 Citations1994Steven L. Salzberg, Alberto M. Segre

In his new book, C4.5: Programs for Machine Learning, Quinlan has put together a definitive, much needed description of his complete system, including the latest developments, which will be a welcome addition to the library of many researchers and students.

BioinformaticsSupport vector machine classification and validation of cancer tissue samples using microarray expression data

2,471 Citations2000Terrence S. Furey, Nello Cristianini +4 more

A new method to analyse tissue samples using support vector machines for mis-labeled or questionable tissue results and shows that other machine learning methods also perform comparably to the SVM on many of those datasets.

View PDF

Fast and Effective Spam Sender Detection with Granular SVM on Highly Imbalanced Mail Server Behavior Data

39 Citations2006Yuchun Tang, Sven Krasser +2 more

This research explores a behavioral classification approach based on spectral sender characteristics retrieved from such global messaging patterns and demonstrates superior performance on spam IP detection, in terms of both effectiveness and efficiency.