The principal components of natural images
Network Computation in Neural SystemsPublished 1 January 1992
Peter Hancock, Roland Baddeley, Leslie S. Smith
Citations239
SJR quartileQ4
SJR score0.33
SNIP0.56
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
A neural net was used to analyse samples of natural images and text. For the natural images, components resemble derivatives of Gaussian operators, similar to those found in visual cortex and inferred from psychophysics. While the results from natural images do not depend on scale, those from text images are highly scale dependent. Convolution of one of the text components with an original image shows that it is sensitive to inter-word gaps.
Keywords
Computer ScienceNeuroscience
Journal of Mathematical BiologySimplified neuron model as a principal component analyzer
2,343 Citations1982Erkki Oja
A simple linear neuron model with constrained Hebbian-type synaptic modification is analyzed and a new class of unconstrained learning rules is derived.
Neural NetworksOptimal unsupervised learning in a single-layer linear feedforward neural network
1,516 Citations1989Terence D. Sanger
An optimality principle is proposed which is based upon preserving maximal information in the output units and an algorithm for unsupervised learning based upon a Hebbian learning rule, which achieves the desired optimality is presented.
ComputerSelf-organization in a perceptual network
1,514 Citations1988Ralph Linsker
It is shown that even a single developing cell of a layered network exhibits a remarkable set of optimization properties that are closely related to issues in statistics, theoretical physics, adaptive signal processing, the formation of knowledge representation in artificial intelligence, and information theory.
Studies of brain functionNeuronal Operations in the Visual Cortex
410 Citations1984Guy A. Orban
The Visual System of Cat and Monkey Compared, a comparison of the Basic Layout of the Visual System in Cat, Owl Monkey, and Rhesus Monkey, reveals a similar structure to the Retinotopic Organization in the Primary Complex.
Biological CyberneticsDevelopment of feature detectors by self-organization
174 Citations1990Jeanne Rubner, Klaus Schulten
A two-layered network of linear neurons that organizes itself as to extract the complete information contained in a set of presented patterns, and the output units become detectors of orthogonal features, similar to ones found in the brain of mammals.
Proceedings of the Royal Society B Biological SciencesAsymmetries in oriented-line detection indicate two orthogonal filters in early vision
160 Citations1991David Foster, Patrick Ward
Proceedings of the Royal Society B Biological SciencesA statistical analysis of natural images matches psychophysically derived orientation tuning curves
96 Citations1991Roland Baddeley, Peter Hancock
A neural net method is used to extract principal components from real-world images and two of the components are ‘bar-detectors’, which are similar to that suggested by Foster & Ward to account for brief-exposure psychophysical data.
Network Computation in Neural SystemsAnalysis of Linsker's application of Hebbian rules to linear networks
83 Citations1990David Mackay, Kenneth D. Miller
The authors analyse the dynamics of the learning rule of a Hebb-type synaptic plasticity rule in a feedforward linear network in terms of the eigenvectors of this matrix, which represent independently evolving weight structures.
Neural ComputationAnalysis of Linsker's Simulations of Hebbian Rules
67 Citations1990David Mackay, Kenneth D. Miller
Analytic and computational results for Linsker's covariance matrices, and some general theorems, lead to an explanation of the emergence of center-surround and certain oriented structures.