Fuzzy rule extraction from support vector machines
Published 1 January 2005
Ad.C.F. Chaves, Marley Vellasco, Ricardo Tanscheit
Citations48
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
To increase the linguistic interpretability of the generated rules, a methodology for extracting fuzzy rules from a trained SVM, where the rule's antecedents are associated with fuzzy sets is proposed.
Abstract
This paper proposes a fuzzy rule extraction method from support vector machines. Support vector machines (SVM) are learning systems based on statistical learning theory that have been successfully applied to a wide variety of application. However, SVM are "black box" models, that is, they generate a solution with linear combination of kernel functions which has a quite difficult interpretation. Methods for rule extraction from trained SVM have already been proposed, however, the rules generated by these methods have, in their antecedents, intervals or functions. This format decreases the interpretability of the generated rules and jeopardizes the knowledge extraction capability. Hence, to increase the linguistic interpretability of the generated rules, we propose in this paper a methodology for extracting fuzzy rules from a trained SVM, where the rule's antecedents are associated with fuzzy sets.
Keywords
Computer Science
Neural Networks: A Comprehensive Foundation
29,816 Citations1998Simon Haykin
Thorough, well-organized, and completely up to date, this book examines all the important aspects of this emerging technology, including the learning process, back-propagation learning, radial-basis function networks, self-organizing systems, modular networks, temporal processing and neurodynamics, and VLSI implementation of neural networks.
TechnometricsStatistical Learning Theory
26,913 Citations1999Yuhai Wu, Vladimir Vapnik
Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Cambridge University Press eBooksAn Introduction to Support Vector Machines and Other Kernel-based Learning Methods
13,883 Citations2000Nello Cristianini, John Shawe‐Taylor
Lecture notes in computer scienceText categorization with Support Vector Machines: Learning with many relevant features
7,925 Citations1998Thorsten Joachims
SVMs achieve substantial improvements over the currently best performing methods and behave robustly over a variety of di-erent learning tasks, eliminating the need for manual parameter tuning.
IEEE Transactions on Neural NetworksAn overview of statistical learning theory
6,159 Citations1999Vladimir Vapnik
How the abstract learning theory established conditions for generalization which are more general than those discussed in classical statistical paradigms are demonstrated and how the understanding of these conditions inspired new algorithmic approaches to function estimation problems are demonstrated.
Support Vector Machines for Classification and Regression
2,828 Citations1998S.R. Gunn
Support Vector Method for Function Approximation, Regression Estimation and Signal Processing
2,702 Citations1996Vladimir Vapnik, Steven E. Golowich +1 more
This presentation reports results of applying the Support Vector method to problems of estimating regressions, constructing multidimensional splines, and solving linear operator equations.
Proceedings of the National Academy of SciencesKnowledge-based analysis of microarray gene expression data by using support vector machines
2,315 Citations2000Michael P. Brown, William Noble Grundy +6 more
A method of functionally classifying genes by using gene expression data from DNA microarray hybridization experiments, based on the theory of support vector machines (SVMs), to predict functional roles for uncharacterized yeast ORFs based on their expression data is introduced.
Proceedings of the IEEEFuzzy logic systems for engineering: a tutorial
2,073 Citations1995Jerry M. Mendel
After synthesizing a FLS, it is demonstrated that it can be expressed mathematically as a linear combination of fuzzy basis functions, and is a nonlinear universal function approximator, a property that it shares with feedforward neural networks.
IEEE Transactions on Neural NetworksSupport vector machines for spam categorization
1,457 Citations1999Harris Drucker, Donghui Wu +1 more
The use of support vector machines in classifying e-mail as spam or nonspam is studied by comparing it to three other classification algorithms: Ripper, Rocchio, and boosting decision trees, which found SVM's performed best when using binary features.
Lecture notes in computer sciencePredicting time series with support vector machines
977 Citations1997K. Müller, Alexander J. Smola +4 more
Two different cost functions for Support Vectors are made use: training with an e insensitive loss and Huber's robust loss function and how to choose the regularization parameters in these models are discussed.
IEEE Transactions on Neural NetworksThe truth will come to light: directions and challenges in extracting the knowledge embedded within trained artificial neural networks
438 Citations1998Alan Tickle, Robert Andrews +2 more
This paper shows that not only is the ADT taxonomy applicable to a cross section of current techniques for extracting rules from trained feedforward ANN's but also how the taxonomy can be adapted and extended to embrace a broader range of ANN types and explanation structures.
Advanced information and knowledge processingRule Extraction from Support Vector Machines
169 Citations2006
A procedure for rule extraction from support vector machines is proposed: the SVM+Prototypes method, which allows to give explanation ability to SVM.
IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews)Inverted hierarchical neuro-fuzzy BSP system: a novel neuro-fuzzy model for pattern classification and rule extraction in databases
111 Citations2006Laercio Brito Goncalves, Marley Vellasco +2 more
The HNFB/sup -1/ model is based on the Hierarchical Neuro-Fuzzy Binary Space Partitioning Model, which embodies a recursive partitioning of the input space, is able to automatically generate its own structure, and allows a greater number of inputs.
Extracting the knowledge embedded in support vector machines
69 Citations2005Xiuju Fu, ChongJin Ong +3 more
The fact that the decisions from a non-linear SVM could be decoded into linguistic rules based on the information provided by support vectors and its decision function is exploited to produce a compact rule set.