Surface consistency constraints in vision
Computer Vision Graphics and Image ProcessingPublished 1 October 1983
W. Eric L. Grimson
Citations68
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Abstract Most computational theories of early visual processing require, as a first stage, the extraction of a symbolic representation (called theprimal sketch) of noticeable changes in image irradiance. For example, thezero-crossings of a Laplacian of a Gaussian operator applied to the image form the basis of one possible representation. Computational theories of stereo or motion correspondence only specify the computation of three-dimensional surface information at such points. Yet, the visual perception, consistent for different viewers, is clearly of complete surfaces. Since in principle the class of surface which could pass through the known boundary points provided by feature point correspondence is infinite and contains widely varying surfaces, the visual system must incorporate some additional constraints besides the known points to compute the complete surface. Using the image irradiance equation, asurface consistency constraint, referred to informally asno news is good news is derived. The constraint implies that the surface must agree with the correspondence information, andnot vary radically between these points. An explicit form of this surface consistency constraint is derived, by relating the probability of a zero-crossing in a region of the image to the variation in the local surface orientation of the surface, provided that the surface albedo and the illumination are roughly constant. The surface consistency constraint is informally supported by Logan's theorem, which essentially states that all the critical information of a signal is generally contained in its zero-crossings, and by the demonstration that the transformation from surface shape to image irradiance generally preserves zero-crossings. Hence, it is argued that surface shape is implicitly encoded in the positions of the zero-crossings of the convolved images, and further, that the encoding can be at least partially inverted to construct an approximation to the viewed surface from the correspondence information.
Keywords
Computer ScienceNeurosciencePhysics and Astronomy
Proceedings of the Royal Society of London. Series B, Biological sciencesTheory of edge detection
6,193 Citations1980David Marr, Ellen C. Hildreth
The theory of edge detection explains several basic psychophysical findings, and the operation of forming oriented zero-crossing segments from the output of centre-surround ∇2G filters acting on the image forms the basis for a physiological model of simple cells.
Elsevier eBooksDigital Picture Processing
4,622 Citations1982
The rapid rate at which the field of digital picture processing has grown in the past five years had necessitated extensive revisions and the introduction of topics not found in the original edition.
Psychological ReviewSome informational aspects of visual perception.
2,910 Citations1954Fred Attneave
Special types of lawfulness which may exist in space at a fixed time, and which seem particularly relevant to processes of visual perception are focused on.
The American Journal of PsychologyFoundations of Cyclopean Perception
2,414 Citations1973Whitman Richards, Béla Julesz
Proceedings of the Royal Society of London. Series B, Biological sciencesA computational theory of human stereo vision
1,803 Citations1979David Marr, Tomaso Poggio
It is shown that this proposal provides a theoretical framework for most existing psychophysical and neurophysiological data about stereopsis and several critical experimental predictions are made, for instance about the size of Panum’s area under various conditions.
The American Journal of PsychologyThe Interpretation of Visual Motion
1,772 Citations1980Peter J. Burt, Shimon Ullman
Proceedings of the Royal Society of London. Series B, Biological sciencesThe interpretation of a moving retinal image
1,427 Citations1980Hugh Christopher Longuet-Higgins, K. Prazdny
It is shown that from a monocular view of a rigid, textured, curved surface it is possible, in principle, to determine the gradient of the surface at any point, and the motion of the eye relative to it, from the velocity field of the changing retinal image, and its first and second spatial derivatives.
Philosophical Transactions of the Royal Society of LondonXVIII. Contributions to the physiology of vision. —Part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision
1,323 Citations1838Charles Wheatstone
There is no difference between the visual appearance of an object in relief and its perspective projection on a plane surface; and hence pictorial representations of distant objects, when those circumstances which would prevent or disturb the illusion are carefully excluded, may be rendered such perfect resemblances of the objects they are intended to represent as to be mistaken for them.
Proceedings of the IEEEHill shading and the reflectance map
1,274 Citations1981Berthold K. P. Horn
A brief review of the history of manual methods is followed by a discussion of a number of methods that have been proposed for the automatic generation of shaded overlays, compared using the reflectance map as a common representation for the dependence of tone or gray level on the orientation of surface elements.
Ecological studiesDigital Picture Processing
1,216 Citations1976P. Hartl
From an analysis point of view an image can be considered as a two-dimensional area of picture elements (pixels), each of which is characterized by a gray level, which are assumed to represent the radiant energy of some electromagnetic spectral range.
Philosophical transactions of the Royal Society of London. Series B, Biological sciencesEarly processing of visual information
1,043 Citations1976David Marr
It is argued that "non-attentive" vision is in practice implemented by these grouping operations and first order discriminations acting on the primal sketch, and implies that such knowledge should influence the control of, rather than interfering with, the actual data-processing that is taking place lower down.
Journal of Experimental PsychologyThe kinetic depth effect.
996 Citations1953Hans Wallach, D. N. O'connell
The problem of how three-dimensional form is perceived in spite of the fact that pertinent stimulation consists only in two-dimensional retinal images has been only partly solved.
b'Geometrical Considerations and Nomenclature for Reflectance'
780 Citations1977F. E.' b'Nicodemus, J. C.' b'Richmond +3 more
Cancer MedicineRECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES
717 Citations1978Harry G. Barrow, Jay M. Tenenbaum
CH25H was revealed to reduce the proliferation, activity, invasion, and migration of LSCC cells while increasing their apoptosis levels, thus enhancing the apoptosis of LSCC cells.
Artificial IntelligenceUnderstanding image intensities
693 Citations1977Berthold K. P. Horn
The gradient space, popularized by Huffman and Mackworth in a slightly different context, is a helpful tool in the development of new methods for exploiting three-dimensional shape information in image intensities.
DSpace@MIT (Massachusetts Institute of Technology)SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW
550 Citations1970Berthold K. P. Horn
A method will be described for finding the shape of a smooth opaque object from a monocular image, given a knowledge of the surface photometry, the position of the light-source and certain auxiliary information to resolve ambiguities, complementary to the use of stereoscopy.
Artificial IntelligencePsychophysical and computational studies towards a theory of human stereopsis
390 Citations1981John E. W. Mayhew, John P. Frisby
Psychophysical studies are described which pose a strong challenge to models of human stereopsis based on the processing of disparity information within independent spatial frequency tuned binocular channels and support the proposal that the processes of human binocular combination integrally relate the extraction of disparities information with the construction of raw primal sketch assertions.
Computer Graphics and Image ProcessingFrom images to surfaces: A computational study of the human early visual system
318 Citations1982
Impossible Objects as Nonsense Sentences
311 Citations2012David A. Huffman
The βCDTriazole and βCDGAL ligands were found to form weaker inclusion complexes with the positively charged drug DNR at an acidic pH than in a neutral medium in which the drug dissociates to its neutral, uncharged form.
DSpace@MIT (Massachusetts Institute of Technology)A Theory of Human Stereo Vision
310 Citations1977David Marr, Tomaso Poggio
This proposal provides a theoretical framework for most existing phychophysical and neurophysiological data about stereopsis, and several critical experimental predictions are made, for instance, about the wsize of Panum?s area under various conditions.
Artificial IntelligenceInterpreting pictures of polyhedral scenes☆
285 Citations1973Alan Macworth
A computer program that achieves the interpretation of line drawings as polyhedral scenes without using specific object prototypes is described, primarily based on general coherence rules that the orientations of the surfaces and edges must satisfy.
Applied OpticsCalculating the reflectance map
282 Citations1979Berthold K. P. Horn, Robert W. Sjoberg
The reflectance map is derived in terms of the bidirectional reflectance-distribution function (BRDF) and the distribution of source radiance in order to improve the understanding of image formation.
Philosophical transactions of the Royal Society of London. Series B, Biological sciencesA computer implementation of a theory of human stereo vision
266 Citations1981W. Eric L. Grimson
To support the adequacy of the Marr-Poggio model of human stereo vision, the implementation was tested on a wide range of stereograms from the human stereopsis literature and was illustrated and compared with human perception.
Bell System Technical JournalInformation in the Zero Crossings of Bandpass Signals
255 Citations1977B. F. Logan
DSpace@MIT (Massachusetts Institute of Technology)Determining Shape and Reflectance Using Multiple Images
196 Citations1978Berthold K. P. Horn, Robert J. Woodham +1 more
Computer Vision Graphics and Image ProcessingThe detection of intensity changes by computer and biological vision systems
176 Citations1983Ellen C. Hildreth
The implementation of a theory for the detection of intensity changes, proposed by Marr and Hildreth, where the image is first processed independently through a set of different size operators, whose shape is the Laplacian of a Gaussian, ▿2G(x, y).
Computer Vision Graphics and Image ProcessingAn implementation of a computational theory of visual surface interpolation
174 Citations1983W. Eric L. Grimson
Algorithms for computing the minimal surface are derived from a computational theory of the interpolation of surfaces from visual information presented in Grimson and examples of the differences between minimal surfaces computed using quadratic variation and those computed using the square Laplacian are illustrated.
Scandinavian Journal of PsychologyPERCEPTION OF MOTION AND CHANGING FORM: <i>A study of visual perception from continuous transformations of a solid angle of light at the eye</i>
168 Citations1964Gunnar Johansson
Philosophical transactions of the Royal Society of London. Series B, Biological sciencesA computational theory of visual surface interpolation
136 Citations1982W. Eric L. Grimson
A computational theory of the interpolation of surfaces from visual information is presented, and it is shown that there is a vector space of possible functionals that measure surface consistency, this vector space being spanned by thefunctional of quadratic variation and the functional of square Laplacian.
Journal of the Optical Society of AmericaBandpass channels, zero-crossings, and early visual information processing
120 Citations1979David Marr, Shimon Ullman +1 more
Under appropriate conditions zero-crossings of a bandpass signal are very rich in information and may contain sufficient information for much of the subsequent processing in the early stages of visual information processing.
DSpace@MIT (Massachusetts Institute of Technology)Reflectance map techniques for analyzing surface defects in metal castings
96 Citations1978Robert J. Woodham
This paper presents a meta-modelling system that automates the very labor-intensive and therefore time-heavy and therefore expensive and expensive process of computer programming called “hacking”.
DSpace@MIT (Massachusetts Institute of Technology)An Information Processing Approach to Understanding the Visual Cortex
91 Citations1980Francis Crick, David C. Marr +1 more
Communications of the ACMUsing synthetic images to register real images with surface models
78 Citations1978Berthold K. P. Horn, Brett L. Bachman
This work achieves the required alignment by matching the real image with a synthetic image obtained from a surface model and known positions of the light sources, and illustrates the technique using LANDSAT images and digital terrain models.
Springer series in information sciencesMultilevel Reconstruction of Visual Surfaces: Variational Principles and Finite-Element Representations
66 Citations1984Demetri Terzopoulos
A multi-level structure is extended to encompass the subsequent task of reconstructing full surface descriptions from the sparse information, and the basic surface approximation problem is revisited in a broader mathematical context whose implications are of relevance to vision.
DSpace@MIT (Massachusetts Institute of Technology)Implementation Of A Theory Of Edge Detection
65 Citations1980Ellen C. Hildreth
DSpace@MIT (Massachusetts Institute of Technology)Determining shape and reflectance using multiple images
46 Citations1980Silver, William M
DSpace@MIT (Massachusetts Institute of Technology)The Perception of Subjective Surfaces
30 Citations1981Michael Brady, W. Eric L. Grimson
Lecture notes in biomathematicsTrigger Features or Fourier Analysis in Early Vision: A New Point of View
27 Citations1982Tomaso Poggio
The relevance of zero-crossings in the output of independent spatial-frequency-tuned channels may contain sufficient information for most of the subsequent processing of visual information processing is examined.