Tracking objects using recognition
Published 25 June 2003
Randal C. Nelson, I.A. Green
Citations26
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A memory assistance tool is developed that uses this approach to help people with slight to moderate memory loss keep track of important objects around the house and is currently deployed in a prototype smart home.
Abstract
Tracking is frequently considered a frame-to-frame operation. As such, object recognition techniques are generally too slow to be used for tracking. There are domains, however where the objects of interest do not move most of the time. In these domains, it is possible to watch for activity in the scene and then apply object recognition techniques to find the object's new location. This makes tracking a discrete process of watching for object disappearances and reappearances. We have developed a memory assistance tool that uses this approach to help people with slight to moderate memory loss keep track of important objects around the house. The system is currently deployed in a prototype smart home.
Keywords
Computer Science
Object recognition from local scale-invariant features
16,195 Citations1999David Lowe
Experimental results show that robust object recognition can be achieved in cluttered partially occluded images with a computation time of under 2 seconds.
Good features to track
6,858 Citations1994Jianbo Shi, Tomasi
A feature selection criterion that is optimal by construction because it is based on how the tracker works, and a feature monitoring method that can detect occlusions, disocclusions, and features that do not correspond to points in the world are proposed.
Face recognition using eigenfaces
5,211 Citations2002Matthew Turk, Alex Pentland
An approach to the detection and identification of human faces is presented, and a working, near-real-time face recognition system which tracks a subject's head and then recognizes the person by comparing characteristics of the face to those of known individuals is described.
IEEE Transactions on Pattern Analysis and Machine IntelligencePfinder: real-time tracking of the human body
4,147 Citations1997Christopher R. Wren, A. Azarbayejani +2 more
IEEE Transactions on Pattern Analysis and Machine IntelligenceLearning patterns of activity using real-time tracking
3,235 Citations2000Chris Stauffer, W. Eric L. Grimson
This paper focuses on motion tracking and shows how one can use observed motion to learn patterns of activity in a site and create a hierarchical binary-tree classification of the representations within a sequence.
The Journal of the Acoustical Society of America<i>Tracking and Data Association</i>
3,079 Citations1990Yaakov Bar‐Shalom, Thomas Fortmann +1 more
IEEE Transactions on Pattern Analysis and Machine IntelligenceW/sup 4/: real-time surveillance of people and their activities
2,514 Citations2000I. Haritaoglu, David Harwood +1 more
W/sup 4/ employs a combination of shape analysis and tracking to locate people and their parts and to create models of people's appearance so that they can be tracked through interactions such as occlusions.
International Journal of Computer VisionVisual learning and recognition of 3-d objects from appearance
1,891 Citations1995Hiroshi Murase, Shree K. Nayar
A near real-time recognition system with 20 complex objects in the database has been developed and a compact representation of object appearance is proposed that is parametrized by pose and illumination.
IEEE Transactions on Pattern Analysis and Machine IntelligenceA Bayesian computer vision system for modeling human interactions
1,567 Citations2000Nuria Oliver, Barbara Rosario +1 more
A real-time computer vision and machine learning system for modeling and recognizing human behaviors in a visual surveillance task and the ability to use these a priori models to accurately classify real human behaviors and interactions with no additional tuning or training is demonstrated.
A System for Video Surveillance and Monitoring
1,245 Citations2000Robert T. Collins, Alan J. Lipton +9 more
An overview of theVSAM system, which uses multiple, cooperative video sensors to provide continuous coverage of people and vehicles in a cluttered environment, is presented.
Coupled hidden Markov models for complex action recognition
1,059 Citations2002Matthew Brand, Nuria Oliver +1 more
Algorithms for coupling and training hidden Markov models (HMMs) to model interacting processes, and demonstrate their superiority to conventional HMMs in a vision task classifying two-handed actions are presented.
NatureA network that learns to recognize three-dimensional objects
936 Citations1990Tomaso Poggio, Shimon Edelman
A scheme is developed, based on the theory of approximation of multivariate functions, that learns from a small set of perspective views a function mapping any viewpoint to a standard view, and a network equivalent to this scheme will 'recognize' the object on which it was trained from any viewpoint.
Active Contours
746 Citations1998A. Blake, Michael Isard
Active Contours deals with the analysis of moving images - a topic of growing importance within the computer graphics industry and its aim is to develop and analyse these modelling tools in depth and within a consistent framework.
IEEE Transactions on Pattern Analysis and Machine IntelligenceRecursive estimation of motion, structure, and focal length
483 Citations1995A. Azarbayejani, Alex Pentland
Presents a formulation for recursive recovery of motion, pointwise structure, and focal length from feature correspondences tracked through an image sequence, yielding a stable and accurate estimation framework which applies uniformly to both true perspective and orthographic projection.
Edinburgh Research Archive (University of Edinburgh)The Architecture of the Festival Speech Synthesis System
335 Citations1998Paul Taylor, Alan W. Black +1 more
A new formalism for storing linguistic data in a text to speech system that describes the design goals when building a synthesis architecture, and some problems with previous architectures are described.
Proceedings of the IEEEVideo indexing based on mosaic representations
275 Citations1998M. Irani, P. Anandan
A new set of methods for indexing into the video sequence based on the scene-based representation, based on geometric and dynamic information contained in the video, complement the more traditional content-based indexing methods.
Pattern RecognitionAutomatic video indexing via object motion analysis
135 Citations1997Jonathan D. Courtney
To assist human analysis of video data, a technique has been developed to perform automatic, content-based video indexing from object motion to analyse the semantic content of the video.
A cubist approach to object recognition
97 Citations2002Randal C. Nelson, Andrea Selinger
An appearance-based object recognition system using a keyed, multi-level contest representation reminiscent of certain aspects of cubist art, demonstrates good recognition of a variety of 3-D shapes, ranging from sports cars and fighter planes to snakes and lizards with full orthographic invariance.
Combining greyvalue invariants with local constraints for object recognition
97 Citations1996C. Schmid, Roger Mohr
The method is based on local characteristics which are invariant to similarity transformations in the image and computed at automatically detected keypoints using the greyvalue signal and works on images such as paintings for which geometry based recognition fails.
Vision for a smart kiosk
92 Citations2002James M. Rehg, Michael Loughlin +1 more
A novel computer vision application: vision-based human sensing for a Smart Kiosk interface and a prototype kiosk which uses color stereo tracking and graphical output to interact with several users is described.
Computer Vision and Image UnderstandingA Perceptual Grouping Hierarchy for Appearance-Based 3D Object Recognition
83 Citations1999Andrea Selinger, Randal C. Nelson
An appearance-based system that uses four distinct levels of perceptual grouping to represent 3D objects in a form that allows not only recognition, but reasoning about 3D manipulation of a sort that has been supported in the past only by 3D geometric models is described.
Object recognition using appearance-based parts and relations
76 Citations2002Chien-Yuan Huang, Octavia Camps +1 more
This paper proposes a representation using appearance-based parts and relations to overcome problems of recognition of general three-dimensional objects in cluttered scenes and its design has been a stumbling block in achieving success.
Vision ResearchLarge-scale tests of a keyed, appearance-based 3-D object recognition system
59 Citations1998Randal C. Nelson, Andrea Selinger
An appearance-based 3-D object recognition system that avoids some of the problems of previous appearance- based schemes is described and a protocol that permits performance in the presence of quantifiable amounts of clutter and occlusion to be predicted on the basis of simple score statistics derived from clean test images and pure clutter images is established.
International Journal of Computer VisionStatistical Models of Object Interaction
47 Citations2000Richard J. Morris, David Hogg
Dynamic appearance-based recognition
39 Citations2002Rajesh P. N. Rao
The method, which implements a robust hierarchical form of the Kalman filter derived from the Minimum Description Length (MDL) principle, includes as a special case several well-known object encoding techniques including eigenspace methods for static recognition.
Real-time motion tracking of three-dimensional objects
15 Citations2002G. Verghese, Karey Lynch Gale +1 more
Two parallel algorithms which use feature-based, short-range (spatiotemporally local) motion processes to achieve real-time tracking of modeled objects are presented.
Learning 3D recognition models for general objects from unlabeled imagery: an experiment in intelligent brute force
9 Citations2002Randal C. Nelson, Andrea Selinger
The problem of training a general, 3D abject recognition system from unlabeled imagery is explored and critical issues and stumbling blocks associated with minimizing the supervision necessary to train such a system are identified.