Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects
Nature NeurosciencePublished 1 January 1999
Rajesh P. N. Rao, Dana H. Ballard
Citations5,736
SJR quartileQ1
SJR score11.20
SNIP4.70
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Results suggest that rather than being exclusively feedforward phenomena, nonclassical surround effects in the visual cortex may also result from cortico-cortical feedback as a consequence of the visual system using an efficient hierarchical strategy for encoding natural images.
Abstract
We describe a model of visual processing in which feedback connections from a higher- to a lower-order visual cortical area carry predictions of lower-level neural activities, whereas the feedforward connections carry the residual errors between the predictions and the actual lower-level activities. When exposed to natural images, a hierarchical network of model neurons implementing such a model developed simple-cell-like receptive fields. A subset of neurons responsible for carrying the residual errors showed endstopping and other extra-classical receptive-field effects. These results suggest that rather than being exclusively feedforward phenomena, nonclassical surround effects in the visual cortex may also result from cortico-cortical feedback as a consequence of the visual system using an efficient hierarchical strategy for encoding natural images.
Keywords
NeuroscienceBiochemistry, Genetics and Molecular Biology
Cerebral CortexDistributed Hierarchical Processing in the Primate Cerebral Cortex
7,962 Citations1991D.J. Felleman, David C. Van Essen
A summary of the layout of cortical areas associated with vision and with other modalities, a computerized database for storing and representing large amounts of information on connectivity patterns, and the application of these data to the analysis of hierarchical organization of the cerebral cortex are reported on.
The Journal of PhysiologyReceptive fields and functional architecture of monkey striate cortex
6,636 Citations1968David H. Hubel, T. N. Wiesel
The striate cortex was studied in lightly anaesthetized macaque and spider monkeys by recording extracellularly from single units and stimulating the retinas with spots or patterns of light, with response properties very similar to those previously described in the cat.
NatureEmergence of simple-cell receptive field properties by learning a sparse code for natural images
5,840 Citations1996Bruno A. Olshausen, David J. Field
It is shown that a learning algorithm that attempts to find sparse linear codes for natural scenes will develop a complete family of localized, oriented, bandpass receptive fields, similar to those found in the primary visual cortex.
Vision ResearchSparse coding with an overcomplete basis set: A strategy employed by V1?
3,720 Citations1997Bruno A. Olshausen, David J. Field
These deviations from linearity provide a potential explanation for the weak forms of non-linearity observed in the response properties of cortical simple cells, and they further make predictions about the expected interactions among units in response to naturalistic stimuli.
Journal of the Optical Society of America ARelations between the statistics of natural images and the response properties of cortical cells
3,233 Citations1987David Field
The results obtained with six natural images suggest that the orientation and the spatial-frequency tuning of mammalian simple cells are well suited for coding the information in such images if the goal of the code is to convert higher-order redundancy into first- order redundancy.
Psychological ReviewSome informational aspects of visual perception.
2,910 Citations1954Fred Attneave
Special types of lawfulness which may exist in space at a fixed time, and which seem particularly relevant to processes of visual perception are focused on.
Vision ResearchThe “independent components” of natural scenes are edge filters
2,269 Citations1997Anthony J. Bell, T. J. Sejnowski
It is shown that a new unsupervised learning algorithm based on information maximization, a nonlinear "infomax" network, when applied to an ensemble of natural scenes produces sets of visual filters that are localized and oriented.
Neural ComputationThe Helmholtz Machine
1,219 Citations1995Peter Dayan, Geoffrey E. Hinton +2 more
A way of finessing this combinatorial explosion by maximizing an easily computed lower bound on the probability of the observations is described, viewed as a form of hierarchical self-supervised learning that may relate to the function of bottom-up and top-down cortical processing pathways.
The MIT Press eBooksModels of Information Processing in the Basal Ganglia
1,187 Citations1994
Part 1 Fundamentals: information processing in modular circuits linking basal ganglia and cerebral cortex, James C. Houk context-dependent activity in primate striatum reflecting past and future behavioural events and a model of how the basal ganglia generate and use neural signals that predict reinforcement are presented.
Annual Review of NeuroscienceStimulus Specific Responses from Beyond the Classical Receptive Field: Neurophysiological Mechanisms for Local-Global Comparisons in Visual Neurons
1,185 Citations1985John M. Allman, Francis M. Miezin +1 more
The historical development of the evidence of response selectivity for visual stimuli presented beyond the CRF is traced; the anatomical pathways that sub serve these far-reaching surround mechanisms are examined; and the possible relationships between these mechanisms and perception are explored.
Proceedings of the Royal Society of London. Series B, Biological sciencesPredictive coding: a fresh view of inhibition in the retina
1,079 Citations1982Mandyam V. Srinivasan, Simon B. Laughlin +1 more
Comparisons suggest that, in the early stages of processing, the visual system is concerned primarily with coding the visual image to protect against subsequent intrinsic noise, rather than with reconstructing the scene or extracting specific features from it.
Journal of NeurophysiologyNeuronal responses to static texture patterns in area V1 of the alert macaque monkey
1,066 Citations1992James Knierim, David C. Van Essen
Responses from neurons in area V1 of the alert macaque monkey to textured patterns modeled after stimuli used in psychophysical experiments of pop- out are consistent with a possible functional role of V1 cells in the mediation of perceptual pop-out and in the segregation of texture borders.
Biological CyberneticsOn the computational architecture of the neocortex
1,047 Citations1992D. Mumford
A hypothesis on the role of the reciprocal, topographic pathways between two cortical areas, one often a ‘higher’ area dealing with more abstract information about the world, the other ‘lower’, deals with more concrete data is put forward.
Biological CyberneticsOn the computational architecture of the neocortex
968 Citations1991D. Mumford
This paper proposes that each area of the cortex carries on its calculations with the active participation of a nucleus in the thalamus with which it is reciprocally and topographically connected, and plays the role of an ‘active blackboard’ on which the current best reconstruction of some aspect of the world is always displayed.
NatureA network that learns to recognize three-dimensional objects
936 Citations1990Tomaso Poggio, Shimon Edelman
A scheme is developed, based on the theory of approximation of multivariate functions, that learns from a small set of perspective views a function mapping any viewpoint to a standard view, and a network equivalent to this scheme will 'recognize' the object on which it was trained from any viewpoint.
NatureCortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons
892 Citations1998J.-M. Hupe, Andrew C. James +4 more
It is shown that feedback connections facilitate responses to objects moving within the classical receptive field; enhance suppression evoked by background stimuli in the surrounding region; and have the strongest effects for stimuli of low salience.
Journal of NeuroscienceContextual Modulation in Primary Visual Cortex
890 Citations1996Karl Zipser, Victor A. F. Lamme +1 more
Journal of NeuroscienceSegregation of form, color, and stereopsis in primate area 18
840 Citations1987DH Hubel, Margaret S. Livingstone
The physiological properties of the cells in the thin and pale stripes reflect the properties of their antecedent cells in 17, but nevertheless exhibit differences that suggest the kinds of processing that might occur at this stage.
ScienceA Neural Mechanism for Working and Recognition Memory in Inferior Temporal Cortex
725 Citations1991Earl K. Miller, Lin Li +1 more
Single neurons were recorded from IT cortex of two rhesus monkeys performing tasks that required them to hold items in memory while concurrently viewing other items and the neuronal response to an incoming visual stimulus was attenuated if it matched a stimulus actively held in working memory, even when several other stimuli intervened.
Journal of NeurophysiologyVisual properties of neurons in area V4 of the macaque: sensitivity to stimulus form
699 Citations1987Robert Desimone, Stan Schein
The large majority of V4 cells were tuned to the length and width of bars, and the "shape" of the optimal bar varied from cell to cell, as has been reported for cells in the dorsolateral visual area of the owl monkey.
Network Computation in Neural SystemsCould information theory provide an ecological theory of sensory processing?
687 Citations2011Joseph J. Atick
The principle of efficiency of information representation as a design principle for sensory processing is explored and a preliminary discussion on how this principle could be applied in general to predict neural processing is given and some neural systems where it recently has been shown to be successful are discussed.
NatureVisual cortical mechanisms detecting focal orientation discontinuities
665 Citations1995Adam M. Slllito, Kenneth L. Grieve +3 more
A mechanism integrating orientation-dependent information over adjacent areas of visual space to represent focal orientation discontinuities such as junctions or corners is proposed.
Bulletin of the London Mathematical SocietySTOCHASTIC COMPLEXITY IN STATISTICAL INQUIRY
651 Citations1991A. P. Dawid
Proceedings of the Royal Society of London. Series B, Biological sciencesTrichromacy, opponent colours coding and optimum colour information transmission in the retina
516 Citations1983Gershon Buchsbaum, Allan Gottschalk
It is shown that efficient information transmission is achieved by a transformation of the initial three colour mechanisms into an achromatic and two opponent chromatic channels, providing a logical rationale reconciling opponent type processing as an optimal necessary step after the initialThree colour mechanisms.
Journal of NeuroscienceEfficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory
499 Citations1996Yang Dan, Joseph J. Atick +1 more
The results suggest that the early visual pathway is well adapted for efficient coding of information in the natural visual environment, in agreement with the prediction of the computational theory.
Network Computation in Neural SystemsCould information theory provide an ecological theory of sensory processing?
475 Citations1992Joseph J. Atick
Physiological ReviewsAdult Cortical Dynamics
384 Citations1998Charles D. Gilbert
The emerging view is that even at the earliest stages in the cortical processing of visual information, cells are highly mutable in their functional properties and are capable of integrating information over a much larger part of visual space than originally believed.
Neural ComputationDynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex
302 Citations1997Rajesh P. N. Rao, Dana H. Ballard
A hierarchical network model of visual recognition that explains experimental observations regarding neural responses in both free viewing and fixating conditions by using a form of the extended Kalman filter as given by the minimum description length (MDL) principle is described.
NatureEndstopped neurons in the visual cortex as a substrate for calculating curvature
296 Citations1987A. Dobbins, Steven W. Zucker +1 more
A computational theory of orientation selection which shows that measurements of orientation obtained by simple cells are not sufficient because there will be strong, incorrect responses from cells whose receptive fields (RFs) span distinct curves, if estimates of curvature are available, however, these inappropriate responses can be eliminated.
NatureGeneration of end-inhibition in the visual cortex via interlaminar connections
292 Citations1986Jürgen Bolz, Charles D. Gilbert
The functional role of the layer 6 to layer 4 projection is determined by reversible inactivation of layer 6 using the inhibitory transmitter γ-aminobutyric acid (GABA) and cells in layer 4 lost end-inhibition.
Proceedings of the National Academy of SciencesComputational models of cortical visual processing.
289 Citations1996David J. Heeger, Eero P. Simoncelli +1 more
Two related models are presented that share a common structure that operates in the same way on different kinds of input, and instantiate the widely held view that computational strategies are similar throughout the cerebral cortex.
Cerebral CortexPsychophysical and Physiological Evidence for Viewer-centered Object Representations in the Primate
263 Citations1995Nikos K. Logothetis, J Pauls
The perception of 3D novel objects was found to be a function of the object's retinal projection at the time of the recognition encounter, and a number of neurons with remarkable selectivity for individual views of those objects that the monkey had learned to recognize were found.
NatureCorticofugal feedback influences the generation of length tuning in the visual pathway
262 Citations1987P. Murphy, Adam M. Sillito
The data show that corticofugal feedback makes a highly significant contribution to the length tuning of dLGN cells, raising the possibility that length tuning is an emergent property of the geniculo-cortical loop.
Brain Behavior and EvolutionThe Generation and Subtraction of Sensory Expectations within Cerebellum-Like Structures
247 Citations2008Charles E. Bell, David Bodznick +2 more
The generation of sensory expectations within cerebellum-like structures of four distinct groups of fishes, including Mormyridae; Rajidae; Scorpaenidae; and Apteronotidae, is described and it is indicated that the negative image is probably generated by means of anti-Hebbian synaptic plasticity at the parallel fiber to principal cell synapse.
Trends in NeurosciencesVisual brain and visual perception: how does the cortex do perceptual grouping?
224 Citations1997Stephen Grossberg, Ennio Mingolla +1 more
Die NaturwissenschaftenGenerality of the functional structure of the neocortex
209 Citations1977O. Creutzfeldt
The fundamental similarities between various neocortical areas are elaborated by pointing out the common principles of its afferent, intrinsic, and efferent organization, with special emphasis on the generality of thalamocortical circuits.
Trends in NeurosciencesSubjective contours - bridging the gap between psychophysics and physiology
199 Citations1991E. Peterhans, R. von der Heydt
Phenomena of contour, color and movement perception have been used to identify functions of neurons and to reveal functional differences between cortical areas that application of classical receptive-field concepts has not suggested.
Network Computation in Neural SystemsTemporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus
181 Citations1995Dawei Dong, Joseph J. Atick
The hypothesis that the lateral geniculate nucleus is concerned with improving efficiency of visual representation through active temporal decorrelation of the retinal signal much in the same way that the retina improves efficiency by spatially decorrelating incoming images is explored.
Vision ResearchAn optimal estimation approach to visual perception and learning
163 Citations1999Rajesh P. N. Rao
This paper uses the concept of generative models and the statistical theory of Kalman filtering to show how static and dynamic events occurring in the visual environment may be learned and recognized given only the input images.
NeuroreportNeural activity in areas V1, V2 and V4 during free viewing of natural scenes compared to controlled viewing
142 Citations1998Jack L. Gallant, Charles E. Connor +1 more
The reduction of activity during free viewing relative to that obtained with flashed gratings is partly attributable to natural images being less effective stimuli and partly to suppressive spatio-temporal neural mechanisms that are important during natural vision.
NeuroreportNeural activity in areas V1, V2 and V4 during free viewing of natural scenes compared to controlled viewing
88 Citations1998Jack L. Gallant, Charles E. Connor +1 more
The reduction of activity during free viewing relative to that obtained with flashed gratings is partly attributable to natural images being less effective stimuli and partly to suppressive spatio-temporal neural mechanisms that are important during natural vision.
Trends in NeurosciencesPharmacological analysis of cortical circuitry
77 Citations1989Jürgen Bolz, Charles D. Gilbert +1 more
The cortical circuitry of the visual cortex has been worked out in great detail, and Anatomical investigations reveal stereotyped connections within cortical columns and specific long-range connections between distant columns.
IEEE Transactions on Image ProcessingLikelihood calculation for a class of multiscale stochastic models, with application to texture discrimination
65 Citations1995Mark R. Luettgen, Alan S. Willsky
The authors illustrate one possible application to texture discrimination and demonstrate that likelihood-based methods using the algorithm achieve performance comparable to that of Gaussian Markov random field based techniques, which in general are prohibitively complex computationally.
The MIT Press eBooksThe Helmholtz Machine
49 Citations1999Peter Dayan, Geoffrey E. Hinton +2 more
The Helmholtz Machine, a machine that automates the very labor-intensive and therefore time-heavy and expensive process of constructing and maintaining smart grids, is being developed.
Elsevier eBooksRedundancy reduction of a Gabor representation: a possible computational role for feedback from primary visual cortex to lateral geniculate nucleus
21 Citations1992Arthur E.C. Pece
The known physiology of the feedback loop between primary visual cortex and its principal input nucleus suggests a computational role for this feedback, that is to decorrelate the cortical representation of the retinal image.