Classifier Combinations: Implementations and Theoretical Issues
Lecture notes in computer sciencePublished 1 January 2000
Louisa Lam
Citations152
SJR quartileQ2
SJR score0.35
SNIP0.55
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Some of the current developments according to the structure of the combination process are considered, and some issues involved in each structure are discussed.
Abstract
Much work has been done in the past decade to combine decisions of multiple classifiers in order to obtain improved recognition results. Many methodologies have been designed and implemented for this purpose. This article considers some of the current developments according to the structure of the combination process, and discusses some issues involved in each structure. In addition, theoretical investigations that have been performed in this area are also examined, and some related issues are discussed.
Keywords
ChemistryComputer Science
IEEE Transactions on Pattern Analysis and Machine IntelligenceThe random subspace method for constructing decision forests
6,737 Citations1998Tin Kam Ho
A method to construct a decision tree based classifier is proposed that maintains highest accuracy on training data and improves on generalization accuracy as it grows in complexity.
IEEE Transactions on Pattern Analysis and Machine IntelligenceOn combining classifiers
5,227 Citations1998Josef Kittler, M. Hatef +2 more
IEEE Transactions on Systems Man and CyberneticsMethods of combining multiple classifiers and their applications to handwriting recognition
2,171 Citations1992Longchang Xu, Adam Krzyżak +1 more
On applying these methods to combine several classifiers for recognizing totally unconstrained handwritten numerals, the experimental results show that the performance of individual classifiers can be improved significantly.
IEEE Transactions on Pattern Analysis and Machine IntelligenceDecision combination in multiple classifier systems
1,511 Citations1994Tin Kam Ho, J.J. Hull +1 more
This work proposes three methods based on the highest rank, the Borda count, and logistic regression for class set reranking that have been tested in applications of degraded machine-printed characters and works from large lexicons, resulting in substantial improvement in overall correctness.
Cambridge University Press eBooksEssai sur l'application de l'analyse à la probabilité des décisions rendues à la pluralité des voix
1,426 Citations2014Nicolas de Condorcet
IEEE Transactions on Systems Man and Cybernetics - Part A Systems and HumansApplication of majority voting to pattern recognition: an analysis of its behavior and performance
842 Citations1997Louisa Lam, Shu-Ping Suen
This paper examines the mode of operation of the majority vote method in order to gain a deeper understanding of how and why it works, so that a more solid basis can be provided for its future applications to different data and/or domains.
IEEE Transactions on Pattern Analysis and Machine IntelligenceA method of combining multiple experts for the recognition of unconstrained handwritten numerals
561 Citations1995Yongliang Huang, Ching Y. Suen
A method was developed which can aggregate the decisions obtained from individual classifiers and derive the best final decisions from the statistical point of view, and outperforms voting, Bayesian, and Dempster-Shafer approaches.
Proceedings of the IEEEComputer recognition of unconstrained handwritten numerals
413 Citations1992Ching Y. Suen, C. Nadal +3 more
It is shown that it is possible to reduce the substitution rate to a desired level while maintaining a fairly high recognition rate in the classification of totally unconstrained handwritten ZIP code numerals.
Pattern Analysis and ApplicationsCombining classifiers: A theoretical framework
375 Citations1998Josef Kittler
Classifier combination can be viewed as a multistage classification process whereby thea posteriori class probabilities generated by the individual classifiers are considered as features for a second stage classification scheme.
Pattern Recognition LettersOptimal combinations of pattern classifiers
309 Citations1995Louisa Lam, Ching Y. Suen
A Bayesian formulation and a weighted majority vote (with weights obtained through a genetic algorithm) are implemented, and the combined performances of 7 classifiers on a large set of handwritten numerals are analyzed.
Combining classifiers
198 Citations1996Josef Kittler, Mary Ann Hater +1 more
Pattern RecognitionStructural classification and relaxation matching of totally unconstrained handwritten zip-code numbers
136 Citations1988Louisa Lam, Ching Y. Suen
A system for recognizing totally unconstrained handwritten numerals is described, which comprises a feature extractor and two classification algorithms that identify the majority of the samples and a robust relaxation algorithm which classifies the rest of the data.
The Annals of StatisticsAn overtraining-resistant stochastic modeling method for pattern recognition
135 Citations1996E. M. Kleinberg
A generic approach for solving problems in pattern recognition based on the synthesis of accurate multiclass discriminators from large numbers of very inaccurate weak models through the use of discrete stochastic processes is introduced.
IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics)Use of fuzzy-logic-inspired features to improve bacterial recognition through classifier fusion
55 Citations1998Dayou Wang, J.M. Keller +3 more
The fuzzy integral was utilized in the fusion of neural networks trained with different feature sets to reach an almost perfect classification rate of E. coli O157:H7 PFGE patterns made available for the experiments.
Pattern RecognitionAN EVALUATION OF MULTI-EXPERT CONFIGURATIONS FOR THE RECOGNITION OF HANDWRITTEN NUMERALS
49 Citations1998Fuad Rahman, M.C. Fairhurst
A new class of decision combination approaches is presented and the effectiveness of these approaches in successfully combining decisions by multiple experts in the specific application of handwritten numeral recognition is compared.
Pattern Analysis and ApplicationsSerial Combination of Multiple Experts: A Unified Evaluation
44 Citations1999Fuad Rahman, M.C. Fairhurst
A unified framework for serial multiple expert decision combination is presented, showing that many multi-expert approaches reported in the literature can be easily represented within the proposed framework.
HMM-KNN word recognition engine for bank cheque processing
41 Citations2002D. Guillevic, C.Y. Suen
The mixed HMM-KNN word recognition module of a bank cheque processing system developed at CENPARMI is described, which can be easily adapted to read other European languages based on the Roman alphabet.
Pattern Analysis and ApplicationsDual classifier system for handprinted alphanumeric character recognition
23 Citations1998Yeun-Ting Chim, Ashraf A. Kassim +1 more
This paper presents a dual classifier handprinted character recognition system that is implemented using Radial Basis Function (RBF) networks, and the results are fourd to be very promising.
Combining classifiers based on confidence values
19 Citations1999Ajantha S. Atukorale, Ponnuthurai Nagaratnam Suganthan
The paper describes the investigation into the neural gas (NG) network algorithm and the hierarchical overlapped architecture (HONG) which was built by retaining the essence of the original NG algorithm by defining an implicit ranking scheme.
Pattern Recognition LettersA connectionist expert system model for conflict resolution in unconstrained handwritten numeral recognition
9 Citations1998N. V. Subba Reddy, P. Nagabhushan
A neural network and expert system model for conflict resolution of unconstrained handwritten numerals is described, found to be useful in resolving conflicts in the recognition of Unconstrained Handwritten Numerals of PIN or ZIP codes of mailing addresses.
International Conference on Advances in Pattern RecognitionPattern Classification: Fusion of Information
9 Citations1999Josef Kittler
It is shown that the use of multiple cues can be formulated as a problem of fusing the opinions of multiple experts employing distinct representations, which contrasts with the methods aimed at improving estimates of decision function values.