Stereoscopic shading: integrating multi-frame shape cues in a variational framework
Published 7 November 2002
Hang Jin, Anthony Yezzi, Stefano Soatto
Citations17
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This work addresses the problem of integrating multi-frame stereo and shading cues within the framework of optimization in the infinite-dimensional space of piecewise smooth surfaces, and proposes an iterative optimization algorithm, which is implemented using ultra-narrowband level set methods.
Abstract
© 2000 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Keywords
Computer ScienceEngineering
Journal of Computational PhysicsFronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulations
13,901 Citations1988Stanley Osher, James A. Sethian
New numerical algorithms, called PSC algorithms, are devised for following fronts propagating with curvature-dependent speed, which approximate Hamilton-Jacobi equations with parabolic right-hand sides by using techniques from hyperbolic conservation laws.
Measuring and modeling anisotropic reflection
936 Citations1992Gregory J. Ward
A new device for measuring the spatial reflectancedistributions of surfaces is introduced, along with a new mathematical model of sniaorropic reflectance, which is both simple and accurate, permitting efficient reflectance data reduction in production.
IEEE Transactions on Pattern Analysis and Machine IntelligenceSurface reflection: physical and geometrical perspectives
649 Citations1991Shree K. Nayar, Katsushi Ikeuchi +1 more
Reflectance models based on physical optics and geometrical optics are studied and a reflectance framework comprising three components is proposed: the diffuse lobe, the specular lobe, andThe specular spike is proposed.
MIT Press eBooksShape from shading
619 Citations1989Berthold K. P. Horn, Michael J. Brooks
This book is the first to provide a comprehensive review of shape from shading, bringing together all of the seminal papers on the subject, shows how recent work relates to more traditional approaches, and provides a comprehensive annotated bibliography.
Computer Vision Graphics and Image ProcessingThe variational approach to shape from shading
588 Citations1986Berthold K. P. Horn, Michael J. Brooks
A systematic approach to the discovery of parallel iterative schemes for solving the shape-from-shading problem on a grid is developed, and it is shown that such a scheme can be derived if, instead of strictly enforcing the constraint, a penalty term derived from the constraint is adopted.
ACM SIGGRAPH Computer GraphicsMeasuring and modeling anisotropic reflection
579 Citations1992Gregory J. Ward
SIAM Journal on Numerical AnalysisRiemann Solvers, the Entropy Condition, and Difference
468 Citations1984Stanley Osher
A condition on the numerical flux for semidiscrete approximations to scalar, nonconvex conservation laws is introduced, and shown to guarantee convergence to the correct physical solution.
IEEE Transactions on Image ProcessingVariational principles, surface evolution, PDEs, level set methods, and the stereo problem
426 Citations1998Olivier Faugeras, Renaud Keriven
IEEE Transactions on Pattern Analysis and Machine IntelligenceEstimation of illuminant direction, albedo, and shape from shading
386 Citations1991Qian Zheng, Rama Chellappa
IEEE Transactions on Pattern Analysis and Machine IntelligenceLocal Shading Analysis
375 Citations1984Alex Pentland
Algorithms to recover illuminant direction and estimate surface orientation have been evaluated on both natural and synthesized images, and have been found to produce useful information about the scene.
Optica Acta International Journal of OpticsPhotometric Invariants Related to Solid Shape
265 Citations1980Jan J. Koenderink, Andrea J. van Doorn
Variational principles, surface evolution, PDE's, level set methods and the stereo problem
249 Citations2005Olivier Faugeras, Renaud Keriven
International Journal of Computer VisionObject-centered surface reconstruction: Combining multi-image stereo and shading
246 Citations1995Pascal Fua, Y.G. Leclerc
It is argued that an object-centered representation is most appropriate for this purpose because it naturally accommodates multiple sources of data, multiple images (including motion sequences of a rigid object), and self-occlusions.
IEEE Transactions on Pattern Analysis and Machine IntelligenceDirect analytical methods for solving Poisson equations in computer vision problems
243 Citations1990T. Simchony, Rama Chellappa +1 more
Direct analytical methods are discussed for solving Poisson equations of the general form Delta u=f on a rectangular domain and experiments indicate that results comparable to those using multigrid can be obtained in a very small number of iterations.
Computer Vision and Image UnderstandingTracking Level Sets by Level Sets: A Method for Solving the Shape from Shading Problem
159 Citations1995Ron Kimmel, Alfred M. Bruckstein⋆
A new algorithm for recovering depth to a Lambertian L1 smooth object given its gray-level image under uniform illumination from the viewing direction is presented, and the level set approach of implementing the contour propagation overcomes numerical problems and some the topology problems of the evolving contours.
The direct computation of height from shading
126 Citations2002Y.G. Leclerc, Aaron Bobick
A method for recovering shape from shading that solves directly for the surface height by using a discrete formulation of the problem, and a smoothness constraint is used only to drive the system towards a good solution.
Journal of the Optical Society of America AShape-from-shading on a cloudy day
122 Citations1994Michael Langer, Steven W. Zucker
It is shown how to use this constraint to recover a depth map from an image efficiently and a curious difference from the classical shape-from-shading problem is uncovered.
Numerische MathematikShape-from-shading, viscosity solutions and edges
113 Citations1993Pierre‐Louis Lions, Elisabeth Rouy +1 more
Computer Vision Graphics and Image ProcessingOn shape from shading
106 Citations1988Alfred M. Bruckstein⋆
A new method is presented for the recovery of a bivariate function H(x, y) that describes a “nice,” almost everywhere differentiable height profile, from shading information, based on a recursive way of determining equal-height or level contours of the surface starting at a given level curve.
Shape and albedo from multiple images using integrability
106 Citations2002Alan Yuille, D. Snow
This paper shows how the approach for estimating shape and albedo from multiple images assuming Lambertian reflectance with single light sources can be generalized to include ambient background illumination, and demonstrates the use of the integrability constraint for solving this problem.
Pattern RecognitionIntegration of shape from shading and stereo
80 Citations1995J.E. Cryer, Ping-Sing Tsai +1 more
This work presents a method for integrating the high frequncy information from the shape from shading and the low frequency information from stereo, and results obtained with a variety of synthetic and real images are discussed.
IEEE Transactions on Pattern Analysis and Machine IntelligenceReflections on shading
79 Citations1991David Forsyth, Andrew Zisserman
It is argued that it is not possible to obtain veridical dense depth or normal maps from a shading analysis, however, discontinuities in radiance are tractably related to scene geometry and, moreover, can be detected.
A global algorithm for shape from shading
75 Citations2002J. Oliensis, Paul Dupuis
A global algorithm for reconstructing shape from shading is described, capable of determining this information automatically, and thus can reconstruct a general surface from shading with no a priori information on the surface.
International Journal of Computer VisionShape from shading: Level set propagation and viscosity solutions
69 Citations1995Ron Kimmel, Kaleem Siddiqi +2 more
The method imports techniques from differential geometry, fluid dynamics, and numerical analysis and provides an accurate shape from shading algorithm and solves some topological problems and gracefully handles cases of non-smooth surfaces that give rise to shocks in the propagating contours.
Analysis of shape from shading techniques
61 Citations1994Ruo Zhang, Pin-Sing Tsai +2 more
This paper provides comparison and analysis of different approaches to shape-from-shading techniques and finds that some of them improve existing techniques, while others are completely new approaches.
IEEE Transactions on Pattern Analysis and Machine IntelligenceImpossible shaded images
52 Citations1993Berthold K. P. Horn, Richard Szeliski +1 more
It is shown that shaded images that cannot have originated from a uniformly illuminated, smooth continuous surface with uniform albedo exist and can be established by counting the number of extrema inside a region corresponding to an isolated surface patch.
Estimation of shape, reflection coefficients and illuminant direction from image sequences
37 Citations2002Naoki Mukawa
A comprehensive scene analysis algorithm that extracts object shape, reflection coefficients and illuminant direction from just sequential images expressed as luminance values is proposed.
IEEE Transactions on Image ProcessingRecovery of surfaces with discontinuities by fusing shading and range data within a variational framework
31 Citations1996J. Shah, Homer Pien +1 more
This work provides a variational framework for fusing range and intensity data for recovering regularized surfaces that results in a new shape-from-shading formulation in the absence of range data, and provides a new fusion paradigm when range data is incorporated.
Image and Vision ComputingRobust shape from shading
30 Citations1994AG Jones, Chris Taylor
This work presents a new paradigm for shape from shading based upon a scale space surface representation, which becomes one of forming a surface from Gaussian basis functions in such a way that the shading in the original image is explained.
IEEE Transactions on Pattern Analysis and Machine IntelligenceNonlinear multiresolution: a shape-from-shading example
25 Citations1990Bezalel Peleg, G. Ron
It is concluded that for accurate shape-from-shading one needs to know the distance from the object, and the shape should also be known in advance, and that resolution reduction based only on image intensities can be inferior to resolution reduction using knowledge of the surface reflectance.
Pattern RecognitionShape from shading using the facet model
18 Citations1989Ting-Chuen Pong, Robert M. Haralick +1 more
The facet model is used in the recovery of surface orientation from single and multiple images, and local surface orientation is determined uniquely by a linear optimization procedure.
Integration of shape from X modules: combining stereo and shading
17 Citations2002J.E. Cryer, P.-S. Tsai +1 more
A method is presented for integrating the high-frequency information from the shape from shading and the low frequency information from stereo in order to compute a better depth map.
Local shape approximation from shading
2 Citations2003Daphna Weinshall