Method of Static Classifiers Selection Using the Weights of Base Classifiers
Advances in intelligent systems and computingPublished 1 January 2015
Robert Burduk
Citations1
SNIP0.30
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A new approach of calculating the weight of base classifiers is developed and the values of these weights are the basis for the selection process of classifiers from the initial pool.
Abstract
The choice of a pertinent objective function is one of the most crucial elements in static ensemble selection. In this study, a new approach of calculating the weight of base classifiers is developed. The values of these weights are the basis for the selection process of classifiers from the initial pool. The obtained weights are interpreted in the context of the interval logic. A number of experiments have been carried out on several datasets available in the UCI repository. The performed experiments compare the proposed algorithms with base classifiers, oracle, sum, product, and mean methods.
Keywords
Computer Science
TechnometricsCombining Pattern Classifiers: Methods and Algorithms
3,234 Citations2005Subhash Bagui
This chapter discusses the development of the Spatial Point Pattern Analysis Code in S–PLUS, which was developed in 1993 by P. J. Diggle and D. C. Griffith.
IEEE Transactions on Pattern Analysis and Machine IntelligenceDecision combination in multiple classifier systems
1,511 Citations1994Tin Kam Ho, J.J. Hull +1 more
This work proposes three methods based on the highest rank, the Borda count, and logistic regression for class set reranking that have been tested in applications of degraded machine-printed characters and works from large lexicons, resulting in substantial improvement in overall correctness.
IEEE Transactions on Systems Man and Cybernetics - Part A Systems and HumansApplication of majority voting to pattern recognition: an analysis of its behavior and performance
842 Citations1997Louisa Lam, Shu-Ping Suen
This paper examines the mode of operation of the majority vote method in order to gain a deeper understanding of how and why it works, so that a more solid basis can be provided for its future applications to different data and/or domains.
IEEE Transactions on Pattern Analysis and Machine IntelligenceA theoretical study on six classifier fusion strategies
713 Citations2002Ludmila I. Kuncheva
Formulas for the classification error for the following fusion methods: average, minimum, maximum, median, majority vote, and oracle are given.
Information FusionClassifier selection for majority voting
621 Citations2004Dymitr Ruta, Bogdan Gabryś
This work provides a revision of the classifier selection methodology and evaluates the practical applicability of diversity measures in the context of combining classifiers by majority voting, and proposes a novel design of multiple classifier systems in which selection and fusion are recurrently applied to a population of best combinations of classifiers.
IEEE Transactions on Pattern Analysis and Machine IntelligenceSum versus vote fusion in multiple classifier systems
230 Citations2003Josef Kittler, Fuad M. Alkoot
It is shown, analytically, that, for Gaussian estimation error distributions, Sum always outperforms Vote, and by simulation that Vote may outperform Sum for heavy tail distributions.
Pattern Recognition LettersAn approach to the automatic design of multiple classifier systems
197 Citations2001Giorgio Giacinto, Fabio Roli
Results on the classification of multisensor remote sensing images show that an approach to the automatic design of multiple classifier systems aimed at selecting the subset made up of the most accurate and diverse classifiers allows the design of effective multiple classifiers.
Pattern RecognitionA probabilistic model of classifier competence for dynamic ensemble selection
184 Citations2011Tomasz Woloszynski, Marek Kurzyński
The results obtained indicate that the full vector of class supports should be used for evaluating the classifier competence as this potentially improves performance of MCSs.
International Journal of Hybrid Intelligent SystemsMulti-Classifier Systems: Review and a roadmap for developers
182 Citations2006Romesh Ranawana, Vasile Palade
All the key decisions that a designer would have to make over the design of a MCS are identified and list out the most useful options available at each decision making step to provide a road-map for MCS designers.
Pattern RecognitionA study on the performances of dynamic classifier selection based on local accuracy estimation
127 Citations2005Luca Didaci, Giorgio Giacinto +2 more
Upper bounds against which the performances of DCS by Local Accuracy estimation (DCS-LA) can be evaluated are proposed and the experimental results clearly show the effectiveness of the selection methods based on local accuracy estimates.
Bell System Technical JournalThe Design and Analysis of Pattern Recognition Experiments
113 Citations1962W. H. Highleyman
One important nonparametric result is that the proportion of the total sample used for testing the machine should never be less than that proportion used for designing the machine, and in some cases should be a good deal more.
Neural Computing and ApplicationsDynamic selection approaches for multiple classifier systems
107 Citations2011Paulo Cavalin, Robert Sabourin +1 more
This paper proposes dynamic multistage organization (DMO), which defines the best multistage structure for each test sample, and proposes two implementations for DMO, namely DSAm and DSAc.
Pattern Recognition LettersBuilding a new generation of handwriting recognition systems
107 Citations1993Ching Y. Suen, R. Legault +3 more
An assessment of the current state of the art in handwriting recognition is given and some evidences and novel ideas on ways of stretching the limits of handwriting recognition systems aiming at outperforming human beings are presented.
Journal of Mathematical Imaging and VisionOne-Class Support Vector Ensembles for Image Segmentation and Classification
84 Citations2011Bogusław Cyganek
Information SciencesIncremental construction of classifier and discriminant ensembles
72 Citations2009Aydın Ulaş, Murat Semerci +2 more
It is seen that an incremental ensemble has higher accuracy than bagging and random subspace method; and it has a comparable accuracy to AdaBoost, but fewer classifiers.
International Journal of Neural SystemsIMPROVED ADAPTIVE SPLITTING AND SELECTION: THE HYBRID TRAINING METHOD OF A CLASSIFIER BASED ON A FEATURE SPACE PARTITIONING
44 Citations2014Konrad Jackowski, Bartosz Krawczyk +1 more
Advances in intelligent systems and computingGenetic Algorithms in EEG Feature Selection for the Classification of Movements of the Left and Right Hand
38 Citations2013Izabela Rejer
A modified version of genetic algorithm is presented, capable of choosing feature sets of a slightly lower classification precision but significantly smaller number of features, which is presented via a benchmark EEG set submitted to the second BCI Competition.
International Journal of Computational Intelligence SystemsA Study on the Use of Multiobjective Genetic Algorithms for Classifier Selection in FURIA-based Fuzzy Multiclassifiers
27 Citations2012Krzysztof ski, Óscar Cordón +1 more
A state-of-the-art evolutionary multiobjective algorithm, namely NSGA-II, is used to provide a component classifier selection and improve FURIA-based fuzzy MCS, becoming competitive with classical MCS learning methods.
Expert SystemsMethod of classifier selection using the genetic approach
25 Citations2010Konrad Jackowski, Michał Woźniak
A novel machine learning algorithm used for training a compound classifier system that consists of a set of area classifiers that outperforms each elementary classifier as well as simple voting.
New Generation ComputingSelection of Heterogeneous Fuzzy Model Ensembles Using Self-adaptive Genetic Algorithms
24 Citations2011Magdalena Smętek, Bogdan Trawiński
Three self-adapting genetic algorithms were proposed with different control parameters of mutation, crossover, and selection adjusted during the execution to create heterogeneous ensembles comprising regression fuzzy models to aid in real estate appraisals.
Classifier ensembles optimization guided by population oracle
6 Citations2011Eulanda M. dos Santos, Robert Sabourin
Experimental results conducted to compare the proposed hybrid algorithm to perform the optimization phase of overproduce-and-choose strategy to a multi-objective genetic algorithm demonstrate that the method outperforms MOGA on generating population of candidate ensembles with higher oracle rates.