Incremental support vector machine construction

This work first introduces and compares different incremental learning techniques, and shows that they are capable of producing performance results similar to the batch algorithm, and in some cases superior condensation properties, and considers the problem of training SVMs using stream data.

Abstract

SVMs (support vector machines) suffer from the problem of large memory requirement and CPU time when trained in batch mode on large data sets. We overcome these limitations, and at the same time make SVMs suitable for learning with data streams, by constructing incremental learning algorithms. We first introduce and compare different incremental learning techniques, and show that they are capable of producing performance results similar to the batch algorithm, and in some cases superior condensation properties. We then consider the problem of training SVMs using stream data. Our objective is to maintain an updated representation of recent batches of data. We apply incremental schemes to the problem and show that their accuracy is comparable to the batch algorithm.