Pattern Classification: Fusion of Information
International Conference on Advances in Pattern RecognitionPublished 1 January 1999
Josef Kittler
Citations9
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
It is shown that the use of multiple cues can be formulated as a problem of fusing the opinions of multiple experts employing distinct representations, which contrasts with the methods aimed at improving estimates of decision function values.
Abstract
Improvements in the performance of pattern recognition systems can be brought about by fusing as many sources of information as possible. These include multiple cues, multiple opinions of experts, prior contextual knowledge and measurement context. Tools for fusing such diverse sources of information are reviewed. In particular, we show that the use of multiple cues can be formulated as a problem of fusing the opinions of multiple experts employing distinct representations. This contrasts with the methods aimed at improving estimates of decision function values, which can be viewed as fusion of opinions of experts using identical representations. Spatial and temporal context can be incorporated by taking into account measurements on neighbouring objects and modelling the distributions over their relations. This is shown to involve two basic components: a measurement process model and a prior world knowledge model. Depending on formulation, contextual decision making leads either to compound classification or to estimation of Maximum Aposteriori Probability of joint labelling 1.
Keywords
Computer Science
ScienceOptimization by Simulated Annealing
44,600 Citations1983Scott Kirkpatrick, C. D. Gelatt +1 more
A detailed analogy with annealing in solids provides a framework for optimization of the properties of very large and complex systems.
IEEE Transactions on Pattern Analysis and Machine IntelligenceStochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
17,980 Citations1984Stuart Geman, Donald Geman
The analogy between images and statistical mechanics systems is made and the analogous operation under the posterior distribution yields the maximum a posteriori (MAP) estimate of the image given the degraded observations, creating a highly parallel ``relaxation'' algorithm for MAP estimation.
Neural NetworksStacked generalization
7,478 Citations1992David H. Wolpert
The conclusion is that for almost any real-world generalization problem one should use some version of stacked generalization to minimize the generalization error rate.
IEEE Transactions on Pattern Analysis and Machine IntelligenceOn combining classifiers
5,227 Citations1998Josef Kittler, M. Hatef +2 more
IEEE Transactions on Pattern Analysis and Machine IntelligenceNeural network ensembles
4,269 Citations1990Lars Kai Hansen, Peter Salamon
It is shown that the remaining residual generalization error can be reduced by invoking ensembles of similar networks, which helps improve the performance and training of neural networks for classification.
Journal of the Royal Statistical Society Series B (Statistical Methodology)On the Statistical Analysis of Dirty Pictures
4,228 Citations1986Julian Besag
A simple, iterative method of reconstruction is proposed, which does not depend on these large-scale characteristics of the random field, and is illustrated by computer simulations in which the original scene is not directly related to the assumed random field.
IEEE Transactions on Systems Man and CyberneticsMethods of combining multiple classifiers and their applications to handwriting recognition
2,171 Citations1992Longchang Xu, Adam Krzyżak +1 more
On applying these methods to combine several classifiers for recognizing totally unconstrained handwritten numerals, the experimental results show that the performance of individual classifiers can be improved significantly.
IEEE Transactions on Pattern Analysis and Machine IntelligenceDecision combination in multiple classifier systems
1,511 Citations1994Tin Kam Ho, J.J. Hull +1 more
This work proposes three methods based on the highest rank, the Borda count, and logistic regression for class set reranking that have been tested in applications of degraded machine-printed characters and works from large lexicons, resulting in substantial improvement in overall correctness.
IEEE Transactions on Systems Man and CyberneticsScene Labeling by Relaxation Operations
1,401 Citations1976Azriel Rosenfeld, Robert A. Hummel +1 more
This paper formulates the ambiguity-reduction process in terms of iterated parallel operations (i.e., relaxation operations) performed on an array of object, identification data.
IEEE Transactions on Pattern Analysis and Machine IntelligenceOn the Foundations of Relaxation Labeling Processes
891 Citations1983Robert A. Hummel, Steven W. Zucker
It is shown that the problem of finding consistent labelings is equivalent to solving a variational inequality, and a procedure nearly identical to the relaxation operator derived under restricted circum-stances serves in the more general setting.
Understanding Line drawings of Scenes with Shadows
879 Citations1975David L. Waltz
A detailed discussion of the standard approach to computer interpretation of line drawings as three-dimensional scenes as well as some alternative approaches to this approach are discussed.
IEEE Transactions on Pattern Analysis and Machine IntelligenceA method of combining multiple experts for the recognition of unconstrained handwritten numerals
561 Citations1995Yongliang Huang, Ching Y. Suen
A method was developed which can aggregate the decisions obtained from individual classifiers and derive the best final decisions from the statistical point of view, and outperforms voting, Bayesian, and Dempster-Shafer approaches.
IEEE Transactions on Pattern Analysis and Machine IntelligenceStructural matching in computer vision using probabilistic relaxation
492 Citations1995William Christmas, Josef Kittler +1 more
The theory of probabilistic relaxation for matching features extracted from 2D images is developed, derive as limiting cases the various heuristic formulae used by researchers in matching problems, and state the conditions under which they apply.
IEEE Transactions on Pattern Analysis and Machine IntelligenceParallel and deterministic algorithms from MRFs: surface reconstruction
449 Citations1991Davi Geiger, Federico Girosi
Deterministic approximations to Markov random field (MRF) models are derived and one of the models is shown to give in a natural way the graduated nonconvexity (GNC) algorithm proposed by A. Blake and A. Zisserman (1987).
Pattern Analysis and ApplicationsCombining classifiers: A theoretical framework
375 Citations1998Josef Kittler
Classifier combination can be viewed as a multistage classification process whereby thea posteriori class probabilities generated by the individual classifiers are considered as features for a second stage classification scheme.
Proceedings of the National Academy of SciencesAnalog "neuronal" networks in early vision.
281 Citations1986Christof Koch, José L. Marroquín +1 more
This work illustrates this approach by implementing a specific analog network, solving the problem of reconstructing a smooth surface from sparse data while preserving its discontinuities, and suggests a novel computational strategy for solving early vision problems in both biological and real-time artificial vision systems.
International Journal of Computer VisionSignal matching through scale space
228 Citations1987Andrew Witkin, Demetri Terzopoulos +1 more
The general signal-matching problem is formulated as the minimization of an energy measure that combines a smoothness term and a similarity term that reduces to a dynamic system governed by a set of coupled, first-order differential equations.
IEEE Transactions on ComputersAn Application of Relaxation Labeling to Line and Curve Enhancement
219 Citations1977Zucker, Hummel +1 more
A relaxation process is described and is applied to the detection of smooth lines and curves in noisy, real world images, effective even for curves of low contrast, and even when many curves lie close to one another.
Combining classifiers
198 Citations1996Josef Kittler, Mary Ann Hater +1 more
IEEE Transactions on Neural NetworksMultiple network fusion using fuzzy logic
196 Citations1995Sung‐Bae Cho, J.H. Kim
This paper presents a method for combining multiple networks based on fuzzy logic, especially the fuzzy integral, which non-linearly combines objective evidence, in the form of a network output, with subjective evaluation of the importance of the individual neural networks.
Pattern Recognition LettersPattern Recognition in Practice VI
192 Citations1999E. S. Gelsema, Jifke F. Veenland
This special issue contains most of the papers presented at the conference ``Pattern Recognition in Practice VI'' held on Vlieland, The Netherlands, from 2 to 4 June 1999, to stimulate interaction between pattern recognition professionals and scientists from other disciplines who bring pattern recognition techniques into practice.
IEEE Transactions on Neural NetworksImproving model accuracy using optimal linear combinations of trained neural networks
178 Citations1995S. Hashem, B.W. Schmeiser
The authors formulate the MSE-OLC problem for trained NN's and derive two closed-form expressions for the optimal combination-weights and examples of significant improvement in model accuracy are included.
Image and Vision ComputingRelaxation labelling algorithms — a review
167 Citations1985Josef Kittler, J. Illingworth
The literature pertaining to relaxation labelling is surveyed and the important theoretical advances and the interesting applications for which it has proven useful are highlighted.
Pattern RecognitionRecognition of handwritten numerals with multiple feature and multistage classifier
144 Citations1995Jun Cao, Majid Ahmadi +1 more
Experimental results on a large set of data show the efficiency and robustness of the proposed multiple experts system using neural networks.
IEEE Transactions on Pattern Analysis and Machine IntelligenceEdge-labeling using dictionary-based relaxation
133 Citations1990Edwin R. Hancock, Josef Kittler
An improved application of probabilistic relaxation to edge labeling is presented, which uses a dictionary to represent permitted labelings of the entire context-conveying neighborhood of each pixel.
International Journal of Pattern Recognition and Artificial IntelligenceCOMBINING EVIDENCE IN PROBABILISTIC RELAXATION
133 Citations1989Josef Kittler, Edwin R. Hancock
The computational realisation of the advocated approach to combining evidence is demonstrated for the application of edge labelling and details of how both the measurement generation process and the world-model may be expressed probabilistically and what the advantages are to be gained from using different forms of support-function are included.
Pattern RecognitionDiscrete relaxation
117 Citations1990Edwin R. Hancock, Josef Kittler
It is demonstrated how it is possible to achieve a globally consistent MAP estimate by iterative label replacement without sacrificing the representational capacity of the label process.
Pattern RecognitionMaximum likelihood discriminant analysis on the plane using a Markovian model of spatial context
92 Citations1985John Haslett
A method for utilising spatial information in performing discriminant analysis on multivariate data at each point on a regular lattice, as for example with LANDSAT, seems to be encouraging.