Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors
Biological CyberneticsPublished 1 January 1976
Stephen Grossberg
Citations1,916
SJR quartileQ2
SJR score0.52
SNIP0.78
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
It is shown how experience can retune feature detectors to respond to a prescribed convex set of spatial patterns, and a classification of adult feature detector properties in terms of a small number of functional principles is suggested.
Abstract
This paper analyses a model for the parallel development and adult coding of neural feature detectors. The model was introduced in Grossberg (1976). We show how experience can retune feature detectors to respond to a prescribed convex set of spatial patterns. In particular, the detectors automatically respond to average features chosen from the set even if the average features have never been experienced. Using this procedure, any set of arbitrary spatial patterns can be recoded, or transformed, into any other spatial patterns (universal recoding), if there are sufficiently many cells in the network's cortex. The network is built from short term memory (STM) and long term memory (LTM) mechanisms, including mechanisms of adaptation, filtering, contrast enhancement, tuning, and nonspecific arousal. These mechanisms capture some experimental properties of plasticity in the kitten visual cortex. The model also suggests a classification of adult feature detector properties in terms of a small number of functional principles. In particular, experiments on retinal dynamics, including amarcrine cell function, are suggested.
Keywords
NeuroscienceBiochemistry, Genetics and Molecular Biology
KybernetikA theory of biological pattern formation
3,219 Citations1972Alfred Gierer, Hans Meinhardt
It is shown that relatively simple molecular mechanisms based on auto- and cross catalysis can account for a primary pattern of morphogens to determine pattern formation of the tissue, and the theory is applied to quantitative data on hydra and is shown to account for activation and inhibition of secondary head formation.
The Journal of PhysiologyThe period of susceptibility to the physiological effects of unilateral eye closure in kittens
3,029 Citations1970David H. Hubel, T. N. Wiesel
Kittens were visually deprived by suturing the lids of the right eye for various periods of time at different ages to study the effect of monocular eye closure on the number of cells that can be influenced by the previously closed eye.
KybernetikSelf-organization of orientation sensitive cells in the striate cortex
1,481 Citations1973Chr. von der Malsburg
A nerve net model for the visual cortex of higher vertebrates is presented and a simple learning procedure is shown to be sufficient for the organization of some essential functional properties of single units.
NatureDevelopment of the Brain depends on the Visual Environment
1,008 Citations1970Colin Blakemore, Grahame F. Cooper
They reared kittens with one eye viewing vertical stripes, the other horizontal, and found that out of twenty-one neurones with elongated receptive fields all were monocularly driven, and in all but one case the orientation of the receptive field closely matched the pattern experienced by that eye.
Boston studies in the philosophy of scienceContour Enhancement, Short Term Memory, and Constancies in Reverberating Neural Networks
650 Citations1982Stephen Grossberg
It is suggested that competition solves a sensitivity problem that confronts all cellular systems: the noise-saturation dilemma.
Studies in Applied MathematicsContour Enhancement, Short Term Memory, and Constancies in Reverberating Neural Networks
630 Citations1973Stephen Grossberg
A model of the nonlinear dynamics of reverberating on-center off-surround networks of nerve cells, or of cell populations, is analysed and applications to seizure and hallucinatory phenomena, to position codes for mo~or control, to pattern discrimination, to influences of novel events on storage of redundant relevant cues, and to the construction of a sensory-drive heterarchy are mentioned.
ScienceVisual Experience Modifies Distribution of Horizontally and Vertically Oriented Receptive Fields in Cats
594 Citations1970Helmut V. B. Hirsch, Donatella Spinelli
Elongated receptive fields of cells in the visual cortex were horizontally or vertically oriented—no oblique fields were found and units with horizontal fields were activated only by the eye exposed to horizontal lines; units with vertical fieldsonly by the eyes exposed to vertical lines.
Philosophical transactions of the Royal Society of London. Series B, Biological sciencesOrganization of the primate retina: Light microscopy, with an appendix: A second type of midget bipolar cell in the primate retina
537 Citations1969B. B. Boycott, John E. Dowling
The structure of the human, but mainly of the rhesus monkey, retina as examined by Golgi-staining techniques is described and interpreted on evidence from both light and electron microscopy.
Journal of Cell ScienceApplications of a theory of biological pattern formation based on lateral inhibition
472 Citations1974Hans Meinhardt, Alfred Gierer
Model calculations are presented for various problems of development on the basis of a theory of primary pattern formation which involves short-range autocatalytic activation and longer-range inhibition (lateral inhibition) and the effects of symmetry can be included into the formalism in a straightforward manner.
International review of neurobiologyA Neural Model of Attention, Reinforcement and Discrimination Learning
356 Citations1975Stephen Grossberg
Biological CyberneticsPattern formation, contrast control, and oscillations in the short term memory of shunting on-center off-surround networks
277 Citations1975Samuel A. Ellias, Stephen Grossberg
The transformation of spatial patterns and their storage in short term memory by shunting neural networks are studied herein and various mechanisms are described for real-time regulation of the amount of contrast with which a pattern will be stored.
Experimental Brain ResearchModification of the distribution of receptive field orientation in cats by selective visual exposure during development
219 Citations1971HelmutV.B. Hirsch, Donatella Spinelli
A novel procedure was used to rear kittens under conditions of controlled visual experience: one eye was exposedonly to vertical lines while the other eye, simultaneously, was exposed only to horizontal lines, providing evidence for highly selective modification of neuronal connectivity by environmental conditions prevailing during development.
NatureEnvironmental Modification of the Visual Cortex and the Neural Basis of Learning and Memory
198 Citations1973Colin Blakemore, Donald E. Mitchell
These two kittens reared in the dark except for a few hours each day spent in cylindrical chambers painted with black and white stripes at one orientation had no cortical neurones responding to the orientation perpendicular to the stripes that they saw when they were young.
Biological CyberneticsOn the development of feature detectors in the visual cortex with applications to learning and reaction-diffusion systems
178 Citations1976Stephen Grossberg
Developmental mechanisms for tuning of visual cortex are derived from adult learning mechanisms: an adaptational property of shunting on-center off-surround networks that prevents saturation of parallel processed patterns at high input intensities, a contrast enhancement and short-term memory mechanism, and plastic synaptic strengths that compute a time average of presynaptic signals and postsynaptic activities and multiplicatively gate signals.
KybernetikNeural expectation: cerebellar and retinal analogs of cells fired by learnable or unlearned pattern classes
169 Citations1972Stephen Grossberg
Neural networks are introduced which can be taught by classical or instrumental conditioning to fire in response to arbitrary learned classes of patterns, and some adaptation mechanisms, and arousal mechanisms for crispening the pattern weights that can fire a given cell, are noted.
Journal of Theoretical BiologySome developmental and attentional biases in the contrast enhancement and short term memory of recurrent neural networks
167 Citations1975Stephen Grossberg, Daniel S. Levine
This paper studies the global dynamics of neurons, or neuron populations, in a recurrent on-center off-surround anatomy undergoing nonlinear shunting interactions, and finds a mechanism for suppressing the activity of populations whose trigger features are infrequently experienced by the network.
Journal of Theoretical BiologyNeural pattern discrimination
133 Citations1970Stephen Grossberg
Some possible neural mechanisms of pattern discrimination are discussed, leading to neural networks which can discriminate any number of essentially arbitrarily complicated space-time patterns and activate cells which can then learn and perform any number in response to the proper input pattern.
Boston studies in the philosophy of scienceClassical and Instrumental Learning by Neural Networks
128 Citations1982Stephen Grossberg
This article reviews some of my main theoretical advances before 1973 in a self-contained and nontechnical exposition that describes some predictions which still need to be tested.
Proceedings of the National Academy of SciencesNonlinear difference-differential equations in prediction and learning theory.
119 Citations1967S. Grossberg
Some nonlinear difference-differential equations which can be interpreted as a learning theory or, alternatively, as a prediction theory whose goal is to discuss the prediction of individual events, in a fixed order, and at prescribed times are introduced.
Journal of Theoretical BiologyVisual illusions in neural networks: Line neutralization, tilt after effect, and angle expansion
112 Citations1976Daniel S. Levine, Stephen Grossberg
Proceedings of the National Academy of SciencesPavlovian Pattern Learning by Nonlinear Neural Networks
109 Citations1971Stephen Grossberg