Fuzzy support vector machine for regression estimation
Published 23 April 2004
Zonghai Sun, Youxian Sun
Citations35
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This method combines the fuzzy logic with the generalize SVM to construct multi-layer SVM and enhances the SVM in reducing the effect of outliers and noises in the application of data fitting.
Abstract
The theory of support vector machine (SVM), as a tool of pattern classification and regression estimation, draws much attention on this field. In this method, it maps the input data into a high dimensional characteristic space in which it constructs an optimal separating hyperplane. In many applications it has provided high generalization ability. In this paper we provide the fuzzy SVM for regression estimation problem. This method combines the fuzzy logic with the generalize SVM to construct multi-layer SVM. The first layer is the fuzzification process. We apply a fuzzy membership to each data point of SVM and reformulate the SVM such that different input points can make different contributions to the learning of regression function. The second layer is the generalize SVM which make the kernel function and may not satisfy the Mercer's condition. The proposed method enhances the SVM in reducing the effect of outliers and noises in the application of data fitting.
Keywords
Computer ScienceEngineering
Machine LearningSupport-vector networks
40,463 Citations1995Corinna Cortes, Vladimir Vapnik
High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated and the performance of the support- vector network is compared to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
The Nature of Statistical Learning Theory
39,279 Citations1995Vladimir Vapnik
Machine LearningSupport-Vector Networks
33,035 Citations1995Corinna Cortes, Vladimir Vapnik
High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated and the performance of the support- vector network is compared to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
TechnometricsStatistical Learning Theory
26,913 Citations1999Yuhai Wu, Vladimir Vapnik
Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Data Mining and Knowledge DiscoveryA Tutorial on Support Vector Machines for Pattern Recognition
16,433 Citations1998Christopher J. C. Burges
There are several arguments which support the observed high accuracy of SVMs, which are reviewed and numerous examples and proofs of most of the key theorems are given.
Neural ComputationNonlinear Component Analysis as a Kernel Eigenvalue Problem
8,078 Citations1998Bernhard Schölkopf, Alexander J. Smola +1 more
A new method for performing a nonlinear form of principal component analysis by the use of integral operator kernel functions is proposed and experimental results on polynomial feature extraction for pattern recognition are presented.
The MIT Press eBooksFast Training of Support Vector Machines Using Sequential Minimal Optimization
5,462 Citations1998John Platt
Neural ComputationImprovements to Platt's SMO Algorithm for SVM Classifier Design
1,817 Citations2001S. Sathiya Keerthi, Shirish Shevade +2 more
Using clues from the KKT conditions for the dual problem, two threshold parameters are employed to derive modifications of SMO that perform significantly faster than the original SMO on all benchmark data sets tried.
IEEE Transactions on Neural NetworksFuzzy support vector machines
1,489 Citations2002Chun-Fu Lin, Sheng‐De Wang
This paper applies a fuzzy membership to each input point and reformulate the SVMs such that different input points can make different contributions to the learning of decision surface.
NeurocomputingWeighted least squares support vector machines: robustness and sparse approximation
1,249 Citations2002Johan A. K. Suykens, Jos De Brabanter +2 more
The methods of this paper are illustrated for RBF kernels and demonstrate how to obtain robust estimates with selection of an appropriate number of hidden units, in the case of outliers or non-Gaussian error distributions with heavy tails.
Advances in pattern recognitionSupport Vector Machines for Pattern Classification
855 Citations2005Shigeo Abe
This paper presents a meta-analyses of feature selection and extraction methods for maximum-Margin Multilayer Neural Networks and their applications to Support Vector Machines.
Quarterly of Applied MathematicsA duality theorem for non-linear programming
585 Citations1961Philip Wolfe
IEEE Transactions on Fuzzy SystemsSwitching regression models and fuzzy clustering
531 Citations1993Richard J. Hathaway, James C. Bezdek
A family of objective functions called fuzzy c-regression models, which can be used too fit switching regression models to certain types of mixed data, is presented and a general optimization approach is given and corresponding theoretical convergence results are discussed.
IEEE Transactions on Neural NetworksSuccessive overrelaxation for support vector machines
437 Citations1999O. L. Mangasarian, David R. Musicant
Successive overrelaxation for symmetric linear complementarity problems and quadratic programs is used to train a support vector machine (SVM) for discriminating between the elements of two massive datasets, each with millions of points.
Machine LearningSupport Vector Machines for Classification in Nonstandard Situations
348 Citations2002Yi Lin, Yoonkyung Lee +1 more
This paper explains why the standard support vectors machine is not suitable for the nonstandard situation, and introduces a simple procedure for adapting the support vector machine methodology to the non standard situation.
Machine LearningConvergence of a Generalized SMO Algorithm for SVM Classifier Design
306 Citations2002S. Sathiya Keerthi, Éric Gilbert
Convergence of a generalized version of the modified SMO algorithms given by Keerthi et al. for SVM classifier design is proved and the results are extended to modifiedSMO algorithms for solving ν-SVM classifiers problems.
Fuzzy support vector machines for pattern classification
219 Citations2002Takuya Inoue, Shigeo Abe
Using the decision functions obtained by training the SVM, for each class, a truncated polyhedral pyramidal membership function is defined and, for the data in the classifiable regions, the classification results are the same for the two methods.
IEEE Transactions on Pattern Analysis and Machine IntelligenceRobust linear and support vector regression
187 Citations2000O. L. Mangasarian, David R. Musicant
Numerical test comparisons with these algorithms indicate the computational effectiveness of the new quadratic programming model for both linear and nonlinear support vector problems.
Fuzzy Support Vector Machines for Multiclass Problems
134 Citations2002Shigeo Abe, Takuya Inoue
The generalization ability of the fuzzy support vector machine is the same with or better than that of the support vectors machine for pair- wise classification.
Applied optimizationData Discrimination via Nonlinear Generalized Support Vector Machines
41 Citations2001O. L. Mangasarian, David R. Musicant
Numerical results on a number of datasets show improved testing set correctness, by as much as a factor of two, when comparing the nonlinear GSVM surface to a linear separating surface.
Switching regression models using ambiguity and distance rejects: application to ionogram analysis
6 Citations2002M. Ménard, Pierre-André Dardignac +1 more
This paper examines how reject options can be used in performing switching regression models, and uses an extension of the Fc+2M algorithm objective function to compute rejects of the fuzzy c+2-regression model.