Automated visual surveillance in computer vision
Published 23 March 2009
B. Anandampilai, Krishna Kalyanam
Citations1
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Progress in the field of automated visual surveillance is reviewed and some of the major remaining problems in automated video surveillance are considered.
Abstract
Abstract. The usefulness of networks of surveillance cameras is primarily limited by the demand placed on human supervisors to monitor many real time video feeds simultaneously. The goal of automated visual surveillance is to reduce the burden on operators by including software in a surveillance system that can analyze behavior automatically. This paper reviews progress in the field and considers some of the major remaining problems in automated video surveillance.
Keywords
Computer Science
International Journal of Computer VisionSnakes: Active contour models
16,951 Citations1988Michael Kass, Andrew Witkin +1 more
This work uses snakes for interactive interpretation, in which user-imposed constraint forces guide the snake near features of interest, and uses scale-space continuation to enlarge the capture region surrounding a feature.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Determining Optical Flow</title>
7,496 Citations1981Berthold K. P. Horn, Brian G. Schunck
An iterative implementation is shown which successfully computes the optical flow for a number of synthetic image sequences and is robust in that it can handle image sequences that are quantized rather coarsely in space and time.
International Journal of Computer VisionCONDENSATION—Conditional Density Propagation for Visual Tracking
4,885 Citations1998Michael Isard, Andrew Blake
The Condensation algorithm uses “factored sampling”, previously applied to the interpretation of static images, in which the probability distribution of possible interpretations is represented by a randomly generated set.
IEEE Transactions on Pattern Analysis and Machine IntelligenceW/sup 4/: real-time surveillance of people and their activities
2,514 Citations2000I. Haritaoglu, David Harwood +1 more
W/sup 4/ employs a combination of shape analysis and tracking to locate people and their parts and to create models of people's appearance so that they can be tracked through interactions such as occlusions.
Human motion analysis: a review
1,408 Citations2002J.K. Aggarwal, Q. Cai
The paper gives an overview of the various tasks involved in motion analysis of the human body, and focuses on three major areas related to interpreting human motion: motion analysis involving human body parts, tracking of human motion using single or multiple cameras, and recognizing human activities from image sequences.
A System for Video Surveillance and Monitoring
1,245 Citations2000Robert T. Collins, Alan J. Lipton +9 more
An overview of theVSAM system, which uses multiple, cooperative video sensors to provide continuous coverage of people and vehicles in a cluttered environment, is presented.
Computer Vision and Image UnderstandingHuman Motion Analysis: A Review
1,145 Citations1999J.K. Aggarwal, Q. Cai
IEEE Transactions on Pattern Analysis and Machine IntelligenceRobust real-time periodic motion detection, analysis, and applications
692 Citations2000Ross Cutler, L.S. Davis
New techniques to detect and analyze periodic motion as seen from both a static and a moving camera are described and the periodicity is analyzed robustly using the 2D lattice structures inherent in similarity matrices.
IEEE Transactions on Pattern Analysis and Machine IntelligenceRecognition of visual activities and interactions by stochastic parsing
648 Citations2000Yuri Ivanov, Aaron Bobick
A probabilistic syntactic approach to the detection and recognition of temporally extended activities and interactions between multiple agents and how the system correctly interprets activities of multiple interacting objects is demonstrated.
IEEE Transactions on Pattern Analysis and Machine IntelligenceIntroduction to the special section on video surveillance
417 Citations2000Robert T. Collins, Alan J. Lipton +1 more
The 11 papers in this special section illustrate topics and techniques at the forefront of video surveillance research, touching on many of the core topics of computer vision, pattern analysis, and aritificial intelligence.
A hierarchical approach to robust background subtraction using color and gradient information
388 Citations2003Omar Javed, Khurram Shafique +1 more
This method provides the solution to some of the common problems that are not addressed by most background subtraction algorithms, such as fast illumination changes, repositioning of static background objects, and initialization of background model with moving objects present in the scene.
IEEE Transactions on Pattern Analysis and Machine IntelligenceMonitoring activities from multiple video streams: establishing a common coordinate frame
360 Citations2000L. Lee, R. Romano +1 more
This paper tackles the problem of automatic external calibration of multiple cameras in an extended scene, that is, full recovery of their 3D relative positions and orientations by robustly matching and fitting tracked objects to a planar model.
International Journal of Computer VisionNatural Language Description of Human Activities from Video Images Based on Concept Hierarchy of Actions
356 Citations2002Atsuhiro Kojima, Takeshi Tamura +1 more
A method for describing human activities from video images based on concept hierarchies of actions based on semantic primitives, which demonstrates the performance of the proposed method by several experiments.
IEEE Transactions on Pattern Analysis and Machine IntelligenceDiscovery and segmentation of activities in video
296 Citations2000Matthew Brand, V. Kettnaker
It is shown that by minimizing the entropy of the joint distribution, an HMM's internal state machine can be made to organize observed activity into meaningful states, which has uses in video monitoring and annotation, low bit-rate coding of scene activity, and detection of anomalous behavior.
Bayesian multi-camera surveillance
279 Citations2003V. Kettnaker, Ramin Zabih
A Bayesian formalization of the task of multicamera surveillance, where the optimal solution is the set of object paths with the highest posterior probability given the observed data, is presented.
International Journal of Computer VisionSequential Updating of Projective and Affine Structure from Motion
239 Citations1997Paul Beardsley, Andrew Zisserman +1 more
A specialisation of the algorithm to recover structure and camera position modulo an affine transformation is described, together with a method to periodically update the affine coordinate frame to prevent drift over time.
Continuous tracking within and across camera streams
183 Citations2003Jinman Kang, I. Cohen +1 more
This paper presents a new approach for continuous tracking of moving objects observed by multiple, heterogeneous cameras that allows deriving a more accurate motion measurement for objects simultaneously viewed by the two cameras and an automatic handling of occlusions, errors in the detection and camera handoff.
Tracking human motion using multiple cameras
176 Citations1996Q. Cai, J.K. Aggarwal
Experimental results from real data show the robustness of the algorithm and its potential for real time applications.
Object identification in a Bayesian context
167 Citations1997Timothy Huang, Stuart Russell
Image and Vision ComputingLearning and understanding dynamic scene activity: a review
155 Citations2003Hilary Buxton
Progress in the development of flexible, generative models that can explain visual input as a combination of hidden variables and can adapt to new types of input are reviewed.
Image and Vision ComputingMonitoring human behavior from video taken in an office environment
137 Citations2001Douglas Ayers, Mubarak Shah
A system which automatically recognizes human actions from video sequences taken of a room by using prior knowledge about the layout of the room, which is essentially content-based video compression.
Human tracking in multiple cameras
119 Citations2002Saad Khan, Omar Javed +2 more
A system for tracking people in multiple uncalibrated cameras that is able to discover spatial relationships between the camera fields of view and use this information to correspond between different perspective views of the same person.
An architecture for multiple perspective interactive video
113 Citations1995Patrick Kelly, Arun Katkere +3 more
International Journal of Computer VisionVisual Surveillance for Moving Vehicles
105 Citations2000James Ferryman, Stephen J. Maybank +1 more
An overview is given of a vision system for locating, recognising and tracking multiple vehicles, using an image sequence taken by a single camera mounted on a moving vehicle, using a template correlation approach.
Camera handoff: tracking in multiple uncalibrated stationary cameras
53 Citations2002Omar Javed, S. Khan +2 more
A system for tracking people using multiple uncalibrated cameras that is able to discover spatial relationships between the cameras' fields of view and to use this information to correspond between different perspective views of the same person.
Detecting suspicious background changes in video surveillance of busy scenes
33 Citations2002Daniel Gibbins, Garry N. Newsam +1 more
A statistical approach to automatically detecting long term changes to the stationary component of a scene, and a prototype system which has been used to successfully demonstrate the feasibility of this approach are outlined.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Visual surveillance of human activity</title>
30 Citations1998I. Haritaoglu, David A. Harwood +1 more
W4 is a real time visual surveillance system for detecting and tracking people and monitoring their activities in an outdoor environment that employs a combination of shape analysis and tracking to create models of people's appearance so that they can be tracked through interactions such as occlusion.
Lecture notes in computer science‘Dynamism of a Dog on a Leash’ or Behavior Classification by Eigen-Decomposition of Periodic Motions
11 Citations2002Roman Goldenberg, Ron Kimmel +2 more
This work shows examples of object as well as behavior classification based on the eigen-decomposition of the binary silhouette sequence, which serves as a basis for behavior classification by principle component analysis.
International Journal of Computer VisionTemporal Analysis of Motion in Video Sequences through Predictive Operators
5 Citations1998Philippe Burlina, Rama Chellappa
A result stating that, for monocular observers undergoing arbitrary polynomial laws, these parameters are visually observable, is presented, which suggests an alternate temporal representation of visual looming information.