Evaluation of simple performance measures for tuning SVM hyperparameters
NeurocomputingPublished 15 March 2003Open access
Kai-Bo Duan, S. Sathiya Keerthi, A.N. Poo
Citations634
SJR quartileQ4
SJR score0.11
SNIP0.06
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The empirically study the usefulness of several simple performance measures that are inexpensive to compute (in the sense that they do not require expensive matrix operations involving the kernel matrix) for tuning SVM hyperparameters.
Abstract
10.1016/S0925-2312(02)00601-X
Keywords
Computer Science
Machine LearningSupport-vector networks
40,463 Citations1995Corinna Cortes, Vladimir Vapnik
High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated and the performance of the support- vector network is compared to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
Machine LearningSupport-Vector Networks
33,035 Citations1995Corinna Cortes, Vladimir Vapnik
High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated and the performance of the support- vector network is compared to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
TechnometricsStatistical Learning Theory
26,913 Citations1999Yuhai Wu, Vladimir Vapnik
Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Data Mining and Knowledge DiscoveryA Tutorial on Support Vector Machines for Pattern Recognition
16,433 Citations1998Christopher J. C. Burges
There are several arguments which support the observed high accuracy of SVMs, which are reviewed and numerous examples and proofs of most of the key theorems are given.
International Conference on Neural Information ProcessingAdvances in kernel methods: support vector learning
5,815 Citations1999Bernhard Schölkopf, Christopher J. C. Burges +1 more
Support vector machines for dynamic reconstruction of a chaotic system, Klaus-Robert Muller et al pairwise classification and support vector machines, Ulrich Kressel.
Machine LearningChoosing Multiple Parameters for Support Vector Machines
2,182 Citations2002Olivier Chapelle, Vladimir Vapnik +2 more
The problem of automatically tuning multiple parameters for pattern recognition Support Vector Machines (SVMs) is considered by minimizing some estimates of the generalization error of SVMs using a gradient descent algorithm over the set of parameters.
The MIT Press eBooksAdvances in Large-Margin Classifiers
1,870 Citations2000
This book provides an overview of recent developments in large margin classifiers, examines connections with other methods, and identifies strengths and weaknesses of the method, as well as directions for future research.
Incremental and Decremental Support Vector Machine Learning
1,158 Citations2000Gert Cauwenberghs, Tomaso Poggio
An on-line recursive algorithm for training support vector machines, one vector at a time, is presented and interpretation of decremental unlearning in feature space sheds light on the relationship between generalization and geometry of the data.
Neural ComputationBounds on Error Expectation for Support Vector Machines
627 Citations2000Vladimir Vapnik, Olivier Chapelle
It is proved that the value of the span is always smaller (and can be much smaller) than the diameter of the smallest sphere containing the support vectors, used in previous bounds.
Extracting support data for a given task
542 Citations1995Bernhard Schölkopf, Chris Burges +1 more
It is observed that three different types of handwritten digit classifiers construct their decision surface from strongly overlapping small subsets of the data base, which opens up the possibility of compressing data bases significantly by disposing of theData which is not important for the solution of a given task.
Dynamically Adapting Kernels in Support Vector Machines
153 Citations1998Nello Cristianini, Colin Campbell +1 more
In this procedure model selection and learning are not separate, but kernels are dynamically adjusted during the learning process to find the kernel parameter which provides the best possible upper bound on the generalisation error.
Alpha seeding for support vector machines
81 Citations2000Dennis DeCoste, Kiri L. Wagstaff
A key practical obstacle in applying support vector machines to many large-scale data mining tasks is that SVM's generally scale quadratically (or worse) in the number of examples or support vectors.
IEEE Transactions on Neural NetworksAn Efficient Method for Computing Leave-One-Out Error in Support Vector Machines With Gaussian Kernels
62 Citations2004Mong Li Lee, S. Sathiya Keerthi +2 more
An efficient method for computing the leave-one-out (LOO) error for support vector machines (SVMs) with Gaussian kernels quite accurately and has good promise for use in hyperparameter tuning and model comparison.
The MIT Press eBooksGACV for Support Vector Machines
52 Citations2000Grace Wahba, Yi Lin +1 more
A look at the SVM paradigm from the point of view of a regularization problem, which allows a comparison with penalized log likelihood methods, as well as the application of model selection and tuning approaches which have been used with those and other regularization-type algorithms to choose tuning parameters in nonparametric statistical models.
Journal of Zhejiang University(Engineering Science)Support vector machines for pattern recognition
52 Citations2003WU Tie-jun
As a direct implementation of the structure risk minimization (SRM) inductive principle, SVM provides good performances such as global optimization and good generalization ability.
Ausgezeichnete InformatikdissertationenThe Maximum-Margin Approach to Learning Text Classifiers: Methods, Theory, and Algorithms
45 Citations2001Thorsten Joachims
Lecture notes in computer scienceLearning to Predict the Leave-One-Out Error of Kernel Based Classifiers
26 Citations2001Koji Tuda, Gunnar Rätsch +2 more
An algorithm to predict the leave-one-out (LOO) error for kernel based classifiers is proposed, inspired by geometrical intuition and allows to reliably select a good model as demonstrated in simulations on Support Vector and Linear Programming Machines.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Automatic recognition of USGS land use/cover categories using statistical and neural network classifiers</title>
18 Citations1993Robert R. Bailey, Elaine J. Pettit +3 more
Part of an end-to-end system being developed for the automatic recognition of general land use/cover categories from digitized aerial photography is presented, and a new, fast method of training the multilayer perceptron is described.