The statistics of natural images
Network Computation in Neural SystemsPublished 1 January 1994
Daniel Ruderman
Citations874
SJR quartileQ4
SJR score0.33
SNIP0.56
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Previous work on image statistics is summarized and evidence for a hierarchical invariance in natural scenes and symmetries are presented, which provide a powerful description of natural images as they greatly restrict the class of allowed distributions.
Abstract
AbstracL Recently there has been a resurgence of interest in the properties of natural images. Their statistics are important not only in image compression but also far the study of sensory processing in biology, which can be viewed as satisfying cettain ‘design criteria’. This review summarizes previous work on image statistics and presents our own data Perhaps the most notable property of natural images is an invariance to scale. We present data to support this claim as well 35 evidence for a hierarchical invariance in natural scenes. These symmetries provide a powerful description of natunl images as they g ~ d y resttiit the class of allowed d i s Vib ut ions. 1.
Keywords
Computer ScienceNeurosciencePhysics and Astronomy
Bell System Technical JournalA Mathematical Theory of Communication
80,675 Citations1948Claude E. Shannon
IEEE Transactions on Pattern Analysis and Machine IntelligenceStochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
17,980 Citations1984Stuart Geman, Donald Geman
The analogy between images and statistical mechanics systems is made and the analogous operation under the posterior distribution yields the maximum a posteriori (MAP) estimate of the image given the degraded observations, creating a highly parallel ``relaxation'' algorithm for MAP estimation.
Journal of the American Statistical AssociationProbability, Random Variables, and Stochastic Processes.
16,350 Citations1984Julia Abrahams, A. Papoulis
Fundamentals of digital image processing
7,016 Citations1988Anil K. Jain
Quantum Field Theory
5,127 Citations1980C. Itzykson, Jean Bernard Zuber
Journal of the Optical Society of America ARelations between the statistics of natural images and the response properties of cortical cells
3,233 Citations1987David Field
The results obtained with six natural images suggest that the orientation and the spatial-frequency tuning of mammalian simple cells are well suited for coding the information in such images if the goal of the code is to convert higher-order redundancy into first- order redundancy.
Psychological ReviewSome informational aspects of visual perception.
2,910 Citations1954Fred Attneave
Special types of lawfulness which may exist in space at a fixed time, and which seem particularly relevant to processes of visual perception are focused on.
Journal of the American Statistical AssociationTime Series: Data Analysis and Theory.
2,671 Citations1976L. H. Koopmans, David R. Brillinger
Bell System Technical JournalPrediction and Entropy of Printed English
2,623 Citations1951Claude E. Shannon
Visual NeuroscienceNormalization of cell responses in cat striate cortex
1,912 Citations1992David J. Heeger
A modified version of the linear/energy model is presented in which striate cells mutually inhibit one another, effectively normalizing their responses with respect to stimulus contrast, and shows that the new model explains a significantly larger body of physiological data.
The Journal of Comparative NeurologyTopography of ganglion cells in human retina
1,863 Citations1990Christine A. Curcio, Kimberly A. Allen
The spatial distribution of presumed ganglion cells and displaced amacrine cells in unstained whole mounts of six young normal human retinas whose photoreceptor distributions had previously been characterized was quantified, suggesting meridianal differences in convergence onto individual ganglION cells.
IEEE Transactions on Acoustics Speech and Signal ProcessingComplete discrete 2-D Gabor transforms by neural networks for image analysis and compression
1,811 Citations1988John Daugman
A three-layered neural network based on interlaminar interactions involving two layers with fixed weights and one layer with adjustable weights finds coefficients for complete conjoint 2-D Gabor transforms without restrictive conditions for image analysis, segmentation, and compression.
The Journal of PhysiologyOptical and retinal factors affecting visual resolution.
1,595 Citations1965F. W. Campbell, D G Green
An improved version of the well-known interference fringe technique which theoretically allows a sinusoidal pattern of very high contrast to be formed directly on the retina to be obtained without prior modification by the optics of the eye is reported.
Physics Physique FizikaScaling laws for ising models near <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msub><mml:mrow><mml:mi>T</mml:mi></mml:mrow><mml:mrow><mml:mi>c</mml:mi></mml:mrow></mml:msub></mml:math>
1,591 Citations1966Leo P. Kadanoff
Neural NetworksOptimal unsupervised learning in a single-layer linear feedforward neural network
1,516 Citations1989Terence D. Sanger
An optimality principle is proposed which is based upon preserving maximal information in the output units and an algorithm for unsupervised learning based upon a Hebbian learning rule, which achieves the desired optimality is presented.
The Science of Fractal Images
1,425 Citations1988Michael F. Barnsley, Robert L. Devaney +4 more
Neural ComputationWhat Is the Goal of Sensory Coding?
1,225 Citations1994David J. Field
It is proposed that compact coding schemes are insufficient to account for the receptive field properties of cells in the mammalian visual pathway and suggested that natural scenes, to a first approximation, can be considered as a sum of self-similar local functions (the inverse of a wavelet).
Proceedings of the Royal Society of London. Series B, Biological sciencesPredictive coding: a fresh view of inhibition in the retina
1,079 Citations1982Mandyam V. Srinivasan, Simon B. Laughlin +1 more
Comparisons suggest that, in the early stages of processing, the visual system is concerned primarily with coding the visual image to protect against subsequent intrinsic noise, rather than with reconstructing the scene or extracting specific features from it.
Zeitschrift für Naturforschung CA Simple Coding Procedure Enhances a Neuron's Information Capacity
1,041 Citations1981Simon B. Laughlin
The contrast-response function of a class of first order intemeurons in the fly's compound eye approximates to the cumulative probability distribution of contrast levels in natural scenes, showing that this matching enables the neurons to encode contrast fluctuations most efficiently.
NatureDevelopment of the Brain depends on the Visual Environment
1,008 Citations1970Colin Blakemore, Grahame F. Cooper
They reared kittens with one eye viewing vertical stripes, the other horizontal, and found that out of twenty-one neurones with elongated receptive fields all were monocularly driven, and in all but one case the orientation of the receptive field closely matched the pattern experienced by that eye.
Physical Review LettersStatistics of natural images: Scaling in the woods
945 Citations1994Daniel Ruderman, William Bialek
This work gathers images from the woods and finds that these scenes possess an ensemble scale invariance, and this non-Gaussian character cannot be removed through local linear filtering, meaning information is maximized at fixed channel variance.
The Journal of PhysiologyOptical quality of the human eye
816 Citations1966F. W. Campbell, R. W. Gubisch
Optical quality of the eye was measured at eight pupil sizes between 1·5 and 6·6 mm diameter by recording the faint light emerging from the eye; this light was reflected from the bright image of a thin line on the fundus.
Proceedings of the IEEESignal compression based on models of human perception
797 Citations1993N. Jayant, James D. Johnston +1 more
It is proposed that fundamental limits in the science can be expressed by the semiquantitative concepts of perceptual entropy and the perceptual distortion-rate function, and current compression technology is examined in that framework.
Physica D Nonlinear PhenomenaVelocity probability density functions of high Reynolds number turbulence
772 Citations1990B. Castaing, Y. Gagne +1 more
Neural ComputationWhat Does the Retina Know about Natural Scenes?
748 Citations1992Joseph J. Atick, Amanda Redlich
It is argued that the retinal goal is to transform the visual input as much as possible into a statistically independent basis as the first step in creating a redundancy reduced representation in the cortex, as suggested by Barlow.
Journal of the Optical Society of America AEvaluation of linear models of surface spectral reflectance with small numbers of parameters
741 Citations1986Laurence T. Maloney
The results suggest that constraints on possible surface-reflectance functions and the "filtering" properties of the shapes of the spectral-sensitivity curves of photoreceptors can both contribute to color constancy.
Network Computation in Neural SystemsCould information theory provide an ecological theory of sensory processing?
687 Citations2011Joseph J. Atick
The principle of efficiency of information representation as a design principle for sensory processing is explored and a preliminary discussion on how this principle could be applied in general to predict neural processing is given and some neural systems where it recently has been shown to be successful are discussed.
Comparative Biochemistry and Physiology Part A PhysiologyVision: Coding and efficiency
675 Citations1991
Neural ComputationTowards a Theory of Early Visual Processing
591 Citations1990Joseph J. Atick, Amanda Redlich
A theory of the early processing in the mammalian visual pathway is proposed and the solution for the class of encodings to which the parvocellular retinal processing belongs, namely linear and nondivergent transformations is found.
Handbook of sensory physiologyThe Topography of Vision in Mammals of Contrasting Life Style: Comparative Optics and Retinal Organisation
581 Citations1977Austin Hughes
Journal of NeurophysiologyContrast gain control in the cat's visual system
528 Citations1985Izumi Ohzawa, G. Sclar +1 more
The idea that the adaptation of cortical neurons to local contrast levels in a visual stimulus is functionally advantageous is examined, and contrast-response functions of cells in striate cortex are measured while systematically adapting them to different contrast levels of stimulus gratings.
Proceedings of the Royal Society of London. Series B, Biological sciencesTrichromacy, opponent colours coding and optimum colour information transmission in the retina
516 Citations1983Gershon Buchsbaum, Allan Gottschalk
It is shown that efficient information transmission is achieved by a transformation of the initial three colour mechanisms into an achromatic and two opponent chromatic channels, providing a logical rationale reconciling opponent type processing as an optimal necessary step after the initialThree colour mechanisms.
Applied OpticsColor and spatial structure in natural scenes
514 Citations1987G. J. Burton, Ian R. Moorhead
It is shown that the scene amplitude spectra follow an approximate reciprocal variation with frequency, and that the correlation function can be described by a one-step autoregressive model.
Ophthalmic and Physiological OpticsAmplitude spectra of natural images
511 Citations1992D.J. Tolhurst, Yoav Tadmor +1 more
The amplitude spectra of 135 digitized photographs of natural scenes are examined and it is found that relatively few images conform exactly to the suggestion.
Choice Reviews OnlineDigital pictures: representation and compression
509 Citations1988
Books, as a source that may involve the facts, opinion, literature, religion, and many others are the great friends to join with, becomes what you need to get.
Proceedings of the IEEEFractal image coding: a review
479 Citations1993A. Jacquin
An approach to image coding based on a fractal theory of iterated contractive transformations defined piecewise is described, and the design of a system for the encoding of monochrome digital images at rates below 1 b/pixel is described.
Network Computation in Neural SystemsCould information theory provide an ecological theory of sensory processing?
475 Citations1992Joseph J. Atick
Journal of Comparative Physiology AThe evolutionary adaptation of flower colours and the insect pollinators' colour vision
443 Citations1992Lars Chıttka, Randolf Menzel
Straight-forward model calculations determine the optimal set of 3 spectral photoreceptor types for discrimination of floral colour signals on the basis of perceptual difference values and show good agreement with the sets of photoreceptors characterized electrophysiologically in 40 species of Hymenoptera.
Digital Pictures
428 Citations1988Arun N. Netravali, Barry G. Haskell
Annual Review of PsychologyVisual Neural Development
414 Citations1981J. Anthony Movshon, Richard C. Van Sluyters
The results show clear trends in normal development and effects of deprivation, which are related to species isolation, rearing, and electrophysiology.
The Journal of the Acoustical Society of America’’1/<i>f</i> noise’’ in music: Music from 1/<i>f</i> noise
380 Citations1978Richard F. Voss, John Clarke
Biological CyberneticsA theory of maximizing sensory information
272 Citations1992J. H. van Hateren
A theory is developed on the assumption that early sensory processing aims at maximizing the information rate in the channels connecting the sensory system to more central parts of the brain, where it is assumed that these channels are noisy and have a limited dynamic range.
Neural ComputationHow to Generate Ordered Maps by Maximizing the Mutual Information between Input and Output Signals
262 Citations1989Ralph Linsker
A learning rule that performs gradient ascent in the average mutual information between input and an output signal is derived for a system having feedforward and lateral interactions and provides new links between unsupervised learning and information-theoretic optimization in a system whose properties are biologically motivated.
Annual Review of NeurosciencePerceptual Neural Organization: Some Approaches Based on Network Models and Information Theory
253 Citations1990R Linsker
Article de synthese a propos of the modelisation of l'information and l'expression des lois regissant les interactions entre les neurones sous formes d'algorithmes afin ofrendre l'organisation nerveuse depuis le niveau subcellulaire jusqu'au nivesau systemique.
Archives of OphthalmologyThe Retina: An Approachable Part of the Brain
253 Citations1988D. G. Cogan
John Dowling is a preeminent neurobiologist and morphologist with a rich background in electron microscopy, electrophysiology, and small-animal experimentation and presents an authoritative and thoroughly readable text, well illustrated with graphs, explanatory diagrams, and electron micrographs.
Vision ResearchWhat causes trichromacy? A theoretical analysis using comb-filtered spectra
240 Citations1982H. B. Barlow
A treatment of colour vision in terms of the system's responses to spectral energy distributions that are sinusoidal functions of wavelength, called comb-filtered spectra, gives some insight into the reasons for trichromacy, the advantages of oil droplets, and the narrow of the red and green mechanisms.
Network Computation in Neural SystemsThe principal components of natural images
239 Citations1992Peter Hancock, Roland Baddeley +1 more
Bell System Technical JournalStatistics of Television Signals
222 Citations1952E. R. Kretzmer
The results are used to estimate the amount by which the channel capacity required for television transmission may be reduced through exploitation of the statistics measured.
Experimental Brain ResearchModification of the distribution of receptive field orientation in cats by selective visual exposure during development
219 Citations1971HelmutV.B. Hirsch, Donatella Spinelli
A novel procedure was used to rear kittens under conditions of controlled visual experience: one eye was exposedonly to vertical lines while the other eye, simultaneously, was exposed only to horizontal lines, providing evidence for highly selective modification of neuronal connectivity by environmental conditions prevailing during development.
Journal of Comparative Physiology AAcuity of compound eyes: Physical limitations and design
214 Citations1977Allan W. Snyder
Various strategies for dark-adaptation are considered with the conclusion that neural pooling combined with a widening of the acceptance angle is most effective for coping with reduced intensities.
IEEE Transactions on Signal ProcessingCompound Gauss-Markov random fields for image estimation
182 Citations1991Fure-Ching Jeng, John W. Woods
The authors consider both the maximum a posteriori probability (MAP) estimate and the minimum mean-squared error (MMSE) estimate for image estimation and image restoration for images modeled as compound Gauss-Markov random fields.
Journal of Comparative Physiology ASpatial information capacity of compound eyes
179 Citations1977Allan W. Snyder, Doekele G. Stavenga +1 more
The capacity of the compound eye to perceive its spatial environment is quantified by determining the number of different pictures that can be reconstructed by its array of retinula cells, and an optimum parameterp is found, which is approximately that found by Snyder (1977) for threshold resolution of a sinusoidal grating at the ommatidial sampling frequency.
Europhysics Letters (EPL)Entropy and Long-Range Correlations in Literary English
163 Citations1994W. Ebeling, Thorsten Pöschel
NatureThe spatial arrangement of cones in the primate fovea
159 Citations1992J. D. Mollon, James K. Bowmaker
Direct microspectrophotometric measurements of patches of foveal retina from Old World monkeys are made, and it is reported here that the distribu tion of long- and middle-wave cones is locally random.
Neural ComputationUnderstanding Retinal Color Coding from First Principles
159 Citations1992Joseph J. Atick, Li Zhaoping +1 more
The predicted kernels show the nontrivial mixing of space-time with color coding observed in experiments, and differences in color-coding between species are found to be due to differences among the chromatic autocorrelators for natural scenes in different environments.
Proceedings of the National Academy of SciencesFractal geometry of music.
157 Citations1990K. J. Hsü, Astrid Hsu
The purpose of this short note is to suggest that the mathematics is, at least in part, Mandelbrot's fractal geometry and the precision is the deviation from a log-log linear plot.
Progress in Retinal and Eye ResearchMatching coding, circuits, cells, and molecules to signals: General principles of retinal design in the fly's eye
145 Citations1994Simon B. Laughlin
Visual NeurosciencePacking geometry of human cone photoreceptors: Variation with eccentricity and evidence for local anisotropy
132 Citations1992Christine A. Curcio, Kenneth R. Sloan
Local anisotropy of the cone mosaic is qualitatively consistent with the meridional resolution effect previously described for the discrimination of gratings and implies that high spatial frequencies may be sampled even in peripheral retina.
Proceedings of the IEEEComparison of international standards for lossless still image compression
121 Citations1994R. Arps, T. K. Truong
This overview focuses on a comparison of lossless compression capabilities of the international standard algorithms for still image compression known as MH, MR, MMR, JBIG, and JPEC.
Neural ComputationToward a Theory of the Striate Cortex
98 Citations1994Li Zhaoping, Joseph J. Atick
The hypothesis that linear cortical neurons are concerned with building a particular type of representation of the visual world one that not only preserves the information and the efficiency achieved by the retina, but in addition preserves spatial relationships in the input both in the plane of vision and in the depth dimension is explored.
Network Computation in Neural SystemsEfficient stereo coding in the multiscale representation
96 Citations1994Li Zhaoping, Joseph J. Atick
It is shown that multiscale coding combined with a binocular decorrelation strategy leads to a rich diversity of cell types, including monocular/binocular cells as well as a family of disparity selective cells, among which one can identify cells that are tuned-zero-excitatory, near, far, and tuned inhibitory.
Europhysics Letters (EPL)Coding Efficiency and Information Rates in Sensory Neurons
95 Citations1993Fred Rieke, David K. Warland +1 more
By learning to estimate time-dependent sensory input signals from the spike trains of single neurons, this work is able to measure the rate at which the spike train convey information about the sensory inputs.
Biological CyberneticsHuman cone-pigment spectral sensitivities and the reflectances of natural surfaces
93 Citations1992Daniel Osorio, Terry Bossomaier
Observations of reflectance spectra of surfaces in the animal's environment have some clear implications for the understanding of the evolution of trichomacy and the trade-off between chromatic and luminance vision in Old-World Primates.
Ophthalmic and Physiological OpticsRetinal information capacity and the function of the pupil
83 Citations1992Simon B. Laughlin
The benefits of correctly adjusting the pupil suggest that the primary function of the pupillary light reflex is to maximize acuity over a wide range of luminances.
Journal of the Optical Society of America ASpectral reflectance of natural objects: how many basis functions are necessary?
71 Citations1992James L. Dannemiller
IEEE Transactions on Signal ProcessingAmbient noise statistics
47 Citations1993Roger Webster
Signal processing algorithms optimized for Gaussian noise may degrade significantly in a non-Gaussian noise environment, so it is important to characterize the noise accurately before including its structure in the formulation of algorithms.
Pattern RecognitionGroup invariant pattern recognition
36 Citations1990Reiner Lenz
This paper develops a group theoretical model for the feature extraction part of pattern recognition systems and shows why the so found filter functions often appear as solutions to optimality problems and why they often have some nice properties such as invariance under Fourier transformation.
Network Computation in Neural SystemsDesigning receptive fields for highest fidelity
34 Citations1994Daniel Ruderman
A basic problem for neural encoding is formulated: the stimulus should be accurately represented in the neural responses, and this criterion is used to design the optimal receptive fields of a model visual system.
Neural Information Processing SystemsOptimal Sampling of Natural Images: A Design Principle for the Visual System
27 Citations1990William Bialek, Daniel Ruderman +1 more
The resulting optimal filters are remarkably similar to those observed in the mammalian visual cortex and the retinal ganglion cells of lower vertebrates.
Neural ComputationSeeing Beyond the Nyquist Limit
25 Citations1992Daniel Ruderman, William Bialek
It is shown that if the organism has knowledge of the probability distribution from which the signals are drawn, outputs from a discrete receptor array can be used to estimate signals beyond the Nyquist limit, and the estimated signal above the Nyquire cutoff is in fact coherent with the real signal at these high frequencies.
Image Descriptors for Displays
23 Citations1975Roger W. Cohen, I. Görög +1 more
VisionFeature detection in biological and artificial visual systems
20 Citations1991David C. Burr, Maria Concetta Morrone
Network Computation in Neural SystemsCompetitive learning, natural images and cortical cells
12 Citations1991C. J. S. Webber
It is argued that the winner-take-all paradigm of competitive learning is not adequate to account for the distribution of responses in the domain of spatial frequency that is necessary to form a complete representation of the information contained in images.
Physica A Statistical Mechanics and its ApplicationsConformal invariance and critical behavior
11 Citations1986John Cardy
Optimal Filtering in the Salamander Retina
11 Citations1992Fred Riekea, W. Geoffrey Owen +1 more
An optimal signal processor is designed which estimates the time-varying light intensity at the retina based on the rod signals and identifies the output with the intracellular voltage response of the bipolar cell, the first anatomical stage in retinal signal processing.
Sensory Processing and Information Theory
10 Citations1994Ralph Linsker
This optimization principle of ‘maximum information preservation’ is applied to a couple of model systems to illustrate how the principle generates ordered maps and processing units (filters) whose properties are similar to those found in biological systems, as well as being useful for constructing artificial learning networks.
…