An approach to feature selection for keystroke dynamics systems based on PSO and feature weighting

Published 1 September 2007

Gabriel. L. F. B. G. Azevedo, George D. C. Cavalcanti, Edson C. B. Carvalho Filho

DOI10.1109/cec.2007.4424936

Citations72

TL;DR

A hybrid system based on support vector machines and stochastic optimization techniques is presented, where PSO outperformed GA with regard to classification error, processing time and feature reduction rate.

Abstract

Techniques based on biometrics have been successfully applied to personal identification systems. One rather promising technique uses the keystroke dynamics of each user in order to recognize him/her. In the present study, we present the development of a hybrid system based on support vector machines and stochastic optimization techniques. The main objective is the analysis of these optimization algorithms for feature selection. We evaluate two optimization techniques for this task. genetic algorithms (GA) and particle swarm optimization (PSO). We use the standard GA and we created a PSO variation, where each particle is represented by a vector of probabilities that indicate the possibility of selecting a particular feature and directly affects the original values of the features. In the present study, PSO outperformed GA with regard to classification error, processing time and feature reduction rate.

Keywords

Computer Science

Particle swarm optimization

47,523 Citations2002James Kennedy, R.C. Eberhart

Neural ComputationEstimating the Support of a High-Dimensional Distribution

5,946 Citations2001Bernhard Schölkopf, John Platt +3 more

The algorithm is a natural extension of the support vector algorithm to the case of unlabeled data by carrying out sequential optimization over pairs of input patterns and providing a theoretical analysis of the statistical performance of the algorithm.

IEEE Transactions on Evolutionary ComputationA Cooperative Approach to Particle Swarm Optimization

2,122 Citations2004F. vandenBergh, Andries P. Engelbrecht

A variation on the traditional PSO algorithm, called the cooperative particle swarm optimizer, or CPSO, employing cooperative behavior to significantly improve the performance of the original algorithm.

Support Vector Method for Novelty Detection

2,061 Citations1999Bernhard Schölkopf, Robert C. Williamson +3 more

The algorithm is a natural extension of the support vector algorithm to the case of unlabelled data and is regularized by controlling the length of the weight vector in an associated feature space.

IEEE Intelligent Systems and their ApplicationsFeature subset selection using a genetic algorithm

1,363 Citations1998Jihoon Yang, Vasant Honavar

The authors' approach uses a genetic algorithm to select subsets of attributes or features to represent the patterns to be classified, achieving multicriteria optimization in terms of generalization accuracy and costs associated with the features.

International Journal of Pattern Recognition and Artificial IntelligenceA SURVEY ON PATTERN RECOGNITION APPLICATIONS OF SUPPORT VECTOR MACHINES

212 Citations2003Hyeran Byun, Seong–Whan Lee

A brief introduction of SVMs is described and its various pattern recognition applications are summarized, which have been applied to wide range of applications.

Journal of Organizational Computing and Electronic CommerceWeb-Based Keystroke Dynamics Identity Verification Using Neural Network

182 Citations2000Sungzoon Cho, Chigeun Han +2 more

An autoassociator neural network is proposed that is trained with the timing vectors of the owner's keystroke dynamics and then used to discriminate between the owner and an imposter.

Computers & SecurityKeystroke dynamics identity verification—its problems and practical solutions

144 Citations2004Enzhe Yu, Sungzoon Cho

Experimental results show that the proposed methods are promising, and that the keystroke dynamics is a viable and practical way to add more security to identity verification.