3D position, attitude and shape input using video tracking of hands and lips
Published 1 January 1994
Andrew Blake, Michael Isard
Citations89
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The system described here can track accurately the curved silhouettes of moving non-polyhedral objects at frame-rate, for example hands, lips, legs, vehicles, fruit, and without any special hardware beyond a desktop workstation and a video-camera and framestore.
Abstract
Recent developments in video-tracking allow the outlines of moving, natural objects in a video-camera input stream to be tracked live, at full video-rate. Previous systems have been available to do this for specially illuminated objects or for naturally illuminated but polyhedral objects. Other systems have been able to track nonpolyhedral objects in motion, in some cases from live video, but following only centroids or key-points rather than tracking whole curves. The system described here can track accurately the curved silhouettes of moving non-polyhedral objects at frame-rate, for example hands, lips, legs, vehicles, fruit, and without any special hardware beyond a desktop workstation and a video-camera and framestore.
Keywords
Computer ScienceEngineering
International Journal of Computer VisionSnakes: Active contour models
16,951 Citations1988Michael Kass, Andrew Witkin +1 more
This work uses snakes for interactive interpretation, in which user-imposed constraint forces guide the snake near features of interest, and uses scale-space continuation to enlarge the capture region surrounding a feature.
CERN Document Server (European Organization for Nuclear Research)Applied Optimal Estimation
6,388 Citations1974A. Gelb
This is the first book on the optimal estimation that places its major emphasis on practical applications, treating the subject more from an engineering than a mathematical orientation, and the theory and practice of optimal estimation is presented.
Adaptive Control
5,020 Citations1989Karl Johan Åström, Björn Wittenmark
Robot Vision
3,632 Citations1986Berthold K. P. Horn
This book presents a coherent approach to the fast-moving field of computer vision, using a consistent notation based on a detailed understanding of the image formation process, and will provide a useful and current reference for professionals working in the fields of machine vision, image processing, and pattern recognition.
The Journal of the Acoustical Society of America<i>Tracking and Data Association</i>
3,079 Citations1990Yaakov Bar‐Shalom, Thomas Fortmann +1 more
IEEE Transactions on ComputersThe Representation and Matching of Pictorial Structures
1,313 Citations1973Martin A. Fischler, R.A. Elschlager
The primary problem dealt with in this paper is the specification of a descriptive scheme, and a metric on which to base the decision of "goodness" of matching or detection.
An Introduction to Splines for Use in Computer Graphics and Geometric Modeling
1,147 Citations1987Richard H. Bartels, John C. Beatty +1 more
A simple Approximation Technique - Uniform Cubic B-splines and an Explicity Formulation for Cubic Beta-splines are presented.
Journal of the Optical Society of America AAffine structure from motion
875 Citations1991Jan J. Koenderink, Andrea J. van Doorn
It is indicated how solutions of the structure-from-motion problem can be stratified in such a way that one explicitly knows at which stages various a priori assumptions enter and specific geometrical expertise is required.
IEEE Transactions on Pattern Analysis and Machine IntelligenceRecognition by linear combinations of models
817 Citations1991Shimon Ullman, Ronen Basri
An approach to visual object recognition in which a 3D object is represented by the linear combination of 2D images of the object is proposed and it is shown that for objects with sharp edges as well as with smooth bounding contours, the set of possible images of a given object is embedded in a linear space spanned by a small number of views.
The Journal of Visualization and Computer AnimationPhysically‐based facial modelling, analysis, and animation
545 Citations1990Demetri Terzopoulos, Keith Waters
A new 3D hierarchical model of the human face is developed that incorporates a physically-based approximation to facial tissue and a set of anatomically-motivated facial muscle actuators and is efficient enough to produce facial animation at interactive rates on a high-end graphics workstation.
Performance-driven facial animation
420 Citations2006Lance R. Williams
International Journal of Computer VisionA framework for spatiotemporal control in the tracking of visual contours
383 Citations1993Andrew Blake, R. Curwen +1 more
This article combines themes from tracking theory—elastic models and stochastic filtering—with the notion of affine invariance to synthesize a substantially new and demonstrably effective framework for contour tracking.
Medical Entomology and ZoologyHands: A Pattern Theoretic Study of Biological Shapes
324 Citations1990Ulf Grenander, Y. K. Chow +1 more
The text develops a global shape model and applies it to the analysis of real pictures acquired with a visible light camera under varying conditions of optical degradation to develop methods for image understanding based on structured restoration, for example automatic detection of abnormalities.
International Journal of Computer VisionRobust model-based motion tracking through the integration of search and estimation
308 Citations1992David Lowe
A computer vision system has been developed for real-time motion tracking of 3-D objects, including those with variable internal parameters, which can robustly track models with many degrees of freedom while running on relatively inexpensive hardware.
Machine Vision and ApplicationsApplications of dynamic monocular machine vision
280 Citations1988Ernst D. Dickmanns, Volker Graefe
The 4-D approach to real-time machine vision presented in the companion paper (Dickmanns and Graefe 1988, this volume) is applied here to two problem areas of widespread interest in robotics.
IEEE Transactions on Pattern Analysis and Machine IntelligenceVisually controlled graphics
187 Citations1993A. Azarbayejani, Thad Starner +2 more
Interactive graphics systems that are driven by visual input and an extension to the basic technique to include structure recovery is discussed, quantitatively comparing the accuracy of the visual technique with traditional sensing.
Systems and Computers in JapanAutomatic lipreading by optical‐flow analysis
165 Citations1991Kenji Mase, Alex Pentland
A computer system is developed for automatic recognition of continuously spoken words by using only visual data, and the pattern of muscle action is used to recognize the spoken words.
The dynamic analysis of apparent contours
119 Citations2002Roberto Cipolla, Andrew Blake
It is shown that focusing attention by means of snakes allows rapid, robust computation of surface curvature, including discrimination of extremal and occluding contours.
Building and using flexible models incorporating grey-level information
94 Citations2002T.F. Cootes, Chris Taylor +3 more
A technique for building compact models of the shape and appearance of flexible objects seen in 2-D images derived from the statistics of sets of labeled images of example objects, which have proved useful in a wide variety of applications.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIEPhysically based and probabilistic models for computer vision
36 Citations1991Richard Szeliski, Demetri Terzopoulos
A framework for combining the essential elements of both the physically-based and probabilistic approaches is proposed, a Kalman filter which incorporates physically- based models as part of the prior and system dynamics and is able to integrate noisy data over time.
University of New Hampshire Scholars Repository (University of New Hampshire at Manchester)Using the BAT: A six dimensional mouse for object placement
24 Citations1988Colin Ware, D. R. Jessome