Gaussian ARTMAP: A Neural Network for Fast Incremental Learning of Noisy Multidimensional Maps
Neural NetworksPublished 1 July 1996Open access
James R. Williamson
Citations312
SJR quartileQ1
SJR score1.49
SNIP2.02
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Simulations are presented which demonstrate that Gaussian ARTMAP consistently obtains a better trade-off of classification rate to number of categories than fuzzy AR TMAP.
Abstract
A new neural network architecture for incremental supervised learning of analog multidimensional maps is introduced. The architecture, called Gaussian ARTMAP, is a synthesis of a Gaussian classifier and an adaptive resonance theory (ART) neural network, achieved by defining the ART choice function as the discriminant function of a Gaussian classifier with separable distributions, and the ART match function as the same, but with the distributions normalized to a unit height. While Gaussian ARTMAP retains the attractive parallel computing and fast learning properties of fuzzy ARTMAP, it learns a more efficient internal representation of a mapping while being more resistant to noise than fuzzy ARTMAP on a number of benchmark databases. SSeveral simulations are presented which demonstrate that Gaussian ARTMAP consistently obtains a better trade-off of classification rate to number of categories than fuzzy ARTMAP. Results on a vowel classification problem are also presented which demonstrate that Gaussian ARTMAP outperforms many other classifiers. Copyright 1996 Elsevier Science Ltd
Keywords
Computer Science
Pattern classification and scene analysis
12,643 Citations1973Richard O. Duda, Peter E. Hart
Springer series in information sciencesSelf-Organization and Associative Memory
8,770 Citations1989Teuvo Kohonen
Complex SystemsRadial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks
3,439 Citations1988David S. Broomhead, David Lowe
The relationship between 'learning' in adaptive layered networks and the fitting of data with high dimensional surfaces is discussed, leading naturally to a picture of 'generalization in terms of interpolation between known data points and suggests a rational approach to the theory of such networks.
Computer Vision Graphics and Image ProcessingA massively parallel architecture for a self-organizing neural pattern recognition machine
2,519 Citations1987Gail A. Carpenter, Stephen Grossberg
A neural network architecture for the learning of recognition categories is derived which circumvents the noise, saturation, capacity, orthogonality, and linear predictability constraints that limit the codes which can be stably learned by alternative recognition models.
IEEE Transactions on Neural NetworksFuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps
1,977 Citations1992Gail A. Carpenter, Stephen Grossberg +3 more
The fuzzy ARTMAP system is compared with Salzberg's NGE systems and with Simpson's FMMC system, and its performance in relation to benchmark backpropagation and generic algorithm systems.
Biological CyberneticsAdaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors
1,916 Citations1976Stephen Grossberg
It is shown how experience can retune feature detectors to respond to a prescribed convex set of spatial patterns, and a classification of adult feature detector properties in terms of a small number of functional principles is suggested.
Neural NetworksFuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system
1,667 Citations1991Gail A. Carpenter, Stephen Grossberg +1 more
This paper aims to demonstrate the efforts towards in-situ applicability of EMMARM, which aims to provide real-time information about concrete mechanical properties such as E-modulus and compressive strength.
Psychological ReviewALCOVE: An exemplar-based connectionist model of category learning.
1,619 Citations1992John K. Kruschke
Alcove selectively attends to relevant stimulus dimensions, can account for a form of base-rate neglect, does not suffer catastrophic forgetting, and can exhibit 3-stage learning of high-frequency exceptions to rules, whereas such effects are not easily accounted for by models using other combinations of representation and learning method.
The Annals of StatisticsOptimal Global Rates of Convergence for Nonparametric Regression
1,485 Citations1982Charles J. Stone
KybernetikSelf-organization of orientation sensitive cells in the striate cortex
1,481 Citations1973Chr. von der Malsburg
A nerve net model for the visual cortex of higher vertebrates is presented and a simple learning procedure is shown to be sufficient for the organization of some essential functional properties of single units.
Neural NetworksGrowing cell structures—A self-organizing network for unsupervised and supervised learning
1,263 Citations1994Bernd Fritzke
A new self-organizing neural network model that has two variants that performs unsupervised learning and can be used for data visualization, clustering, and vector quantization is presented and results on the two-spirals benchmark and a vowel classification problem are presented that are better than any results previously published.
Neural NetworksARTMAP: Supervised real-time learning and classification of nonstationary data by a self-organizing neural network
985 Citations1991Gail A. Carpenter, Stephen Grossberg +1 more
A Theory of Networks for Approximation and Learning
716 Citations1989Tomaso Poggio, Federico Girosi
Machine LearningLetter Recognition Using Holland-Style Adaptive Classifiers
326 Citations1991Peter W. Frey, David J. Slate
This research focused on machine induction techniques for generating IF-THEN classifiers in which the IF part was a list of values for each of the 16 attributes and the THEN part was the correct category, i.e., one of the 26 letters of the alphabet.
Boston studies in the philosophy of scienceA Theory of Human Memory: Self-Organization and Performance of Sensory-Motor Codes, Maps, and Plans
258 Citations1982Stephen Grossberg
A psychophysiological foundation for cognitive theory, and more generally for goal-oriented or purposive behavior, is suggested, which drives deepest into uncharted territory.
Machine LearningLetter recognition using Holland-style adaptive classifiers
255 Citations1991Peter W. Frey, David J. Slate
This research focused on machine induction techniques for generating IF-THEN classifiers in which the IF part was a list of values for each of the 16 attributes and the THEN part was the correct category, i.e., one of the 26 letters of the alphabet.
IEEE Transactions on Neural NetworksART-EMAP: A neural network architecture for object recognition by evidence accumulation
154 Citations1995Gail A. Carpenter, William D. Ross
A new neural network architecture is introduced for the recognition of pattern classes after supervised and unsupervised learning, which achieves a synthesis of adaptive resonance theory (ART) and spatial and temporal evidence integration for dynamic predictive mapping (EMAP).
Connection ScienceRule Extraction: From Neural Architecture to Symbolic Representation
153 Citations1995Gail A. Carpenter, Ah‐Hwee Tan
This paper shows how knowledge, in the form of fuzzy rules, can be derived from a supervised learning neural network called fuzzy ARTMAP.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Novel cluster-based probability model for texture synthesis, classification, and compression</title>
108 Citations1993Kris Popat, Rosalind W. Picard
A new probabilistic modeling technique for high-dimensional vector sources is presented, and its application to the problems of texture synthesis, classification, and compression is considered.
IEEE Transactions on Neural NetworksA fuzzy ARTMAP nonparametric probability estimator for nonstationary pattern recognition problems
94 Citations1995Gail A. Carpenter, Stephen Grossberg +1 more
An incremental, nonparametric probability estimation procedure using the fuzzy ARTMAP (adaptive resonance theory-supervised predictive mapping) neural network is introduced.
Comparative performance measures of fuzzy ARTMAP, learned vector quantization, and back propagation for handwritten character recognition
34 Citations2003Gail A. Carpenter, Stephen Grossberg +1 more
The authors compare the performance of fuzzy ARTMAP with that of learned vector quantization and backpropagation on a handwritten character recognition task and find that voting with fuzzy AR TMAP yielded the highest recognition rates.