Clustering-and-selection model for classifier combination

Published 7 November 2002

Ludmila I. Kuncheva

DOI10.1109/kes.2000.885788

Citations154

TL;DR

A simple clustering-and-selection algorithm based on a probabilistic interpretation of classifier selection, where the most successful classifier for a given cluster is nominated to label the inputs in the Voronoi cell of the cluster centroid.

Abstract

We devise a simple clustering-and-selection algorithm based on a probabilistic interpretation of classifier selection. First, the data set is clustered into K clusters, and then the most successful classifier for a given cluster is nominated to label the inputs in the Voronoi cell of the cluster centroid. The proposed method is compared experimentally with the minimum, maximum, product and average. Also given are the results from the naive Bayes method, the behaviour-knowledge space (BKS) method, the best individual and the oracle.

Keywords

Computer Science

Cambridge University Press eBooksPattern Recognition and Neural Networks

6,468 Citations1996B. D. Ripley

Neural ComputationAdaptive Mixtures of Local Experts

4,988 Citations1991Robert A. Jacobs, Michael I. Jordan +2 more

A new supervised learning procedure for systems composed of many separate networks, each of which learns to handle a subset of the complete set of training cases, which is demonstrated to be able to be solved by a very simple expert network.

IEEE Transactions on Systems Man and CyberneticsMethods of combining multiple classifiers and their applications to handwriting recognition

2,171 Citations1992Longchang Xu, Adam Krzyżak +1 more

On applying these methods to combine several classifiers for recognizing totally unconstrained handwritten numerals, the experimental results show that the performance of individual classifiers can be improved significantly.

IEEE Transactions on Pattern Analysis and Machine IntelligenceCombination of multiple classifiers using local accuracy estimates

949 Citations1997K. Woods, W. Philip Kegelmeyer +1 more

IEEE Transactions on Pattern Analysis and Machine IntelligenceA method of combining multiple experts for the recognition of unconstrained handwritten numerals

561 Citations1995Yongliang Huang, Ching Y. Suen

A method was developed which can aggregate the decisions obtained from individual classifiers and derive the best final decisions from the statistical point of view, and outperforms voting, Bayesian, and Dempster-Shafer approaches.

Proceedings of the IEEEA composite classifier system design: Concepts and methodology

332 Citations1979B.V. Dasarathy, B. V. Sheela

This study explores the scope for achieving enhanced recognition system performance through deployment of a composite classifier system consisting of two or more component classifiers which belong to different categories using a specific technique-Sequential Weight Increasing Factor Technique (SWIFT).

Pattern Recognition LettersSoft combination of neural classifiers: A comparative study

238 Citations1999Antanas Verikas, Arūnas Lipnickas +3 more

This paper presents four schemes for soft fusion of the outputs of multiple classifiers using Zimmermann's compensatory operator, and an empirical evaluation substantiates the validity of the approaches with data-dependent weights, compared to various existing combination schemes of multipleclassifiers.

IEEE Transactions on Neural NetworksLocal linear perceptrons for classification

79 Citations1996Ethem Alpaydın, Michael I. Jordan

A structure composed of local linear perceptrons for approximating global class discriminants is investigated and it is concluded that even on such a high-dimensional problem, such local models are promising, much better than RBF's and use much less memory.

Pattern Recognition Letters‘Change-glasses’ approach in pattern recognition

40 Citations1993Ludmila I. Kuncheva

An idea is presented for on-line change of the recognition rule in dependence on the reliability of the classification decision, aiming at better accuracy.