Multi-frame infinitesimal motion model for the reconstruction of (dynamic) scenes with multiple linearly moving objects

Published 13 November 2002

Amnon Shashua, Anat Levin

DOI10.1109/iccv.2001.937680

Citations23

TL;DR

A reconstruction algorithm of camera motion, scene structure, and point trajectories embedded into a multi-frame factorization principle which requires the minimum of 11 images and 7 points.

Abstract

We introduce new small-motion multi-frame equations applicable to the reconstruction of dynamic scenes in which points are allowed to move along straight-line paths with constant velocity. The motion equations apply to both static and dynamic points, thus prior segmentation is not necessary. We present a reconstruction algorithm of camera motion, scene structure, and point trajectories embedded into a multi-frame factorization principle which requires the minimum of 11 images and 7 points (out of which at feast 3 are dynamic).

Keywords

Computer Science

International Journal of Computer VisionShape and motion from image streams under orthography: a factorization method

2,884 Citations1992Carlo Tomasi, Takeo Kanade

A factorization method is developed that can overcome the difficulty by recovering shape and motion under orthography without computing depth as an intermediate step, and gives accurate results.

Proceedings of the Royal Society of London. Series B, Biological sciencesThe interpretation of a moving retinal image

1,427 Citations1980Hugh Christopher Longuet-Higgins, K. Prazdny

It is shown that from a monocular view of a rigid, textured, curved surface it is possible, in principle, to determine the gradient of the surface at any point, and the motion of the eye relative to it, from the velocity field of the changing retinal image, and its first and second spatial derivatives.

International Journal of Computer VisionA Multibody Factorization Method for Independently Moving Objects

688 Citations1998João Paulo Costeira, Takeo Kanade

A new method for separating and recovering the motion and shape of multiple independently moving objects in a sequence of images by introducing a mathematical construct of object shapes, called the shape interaction matrix, which is invariant to both the object motions and the selection of coordinate systems.

IEEE Transactions on Pattern Analysis and Machine IntelligenceTrajectory triangulation: 3D reconstruction of moving points from a monocular image sequence

191 Citations2000Shai Avidan, Amnon Shashua

The problem of reconstructing the 3D coordinates of a moving point seen from a monocular moving camera is considered, i.e., to reconstruct moving objects from line-of-sight measurements only, and the solutions for points moving along a straight-line and along conic-section trajectories are investigated.

Multi-frame optical flow estimation using subspace constraints

140 Citations1999M. Irani

This paper develops a method for simultaneous estimation of optical flow across multiple frames, which uses multi-frame subspace constraints to constrain the 2D correspondence estimation process itself, and not for 3D recovery.

Reconstruction of a scene with multiple linearly moving objects

81 Citations2002Mei Han, Takeo Kanade

Lecture notes in computer scienceHomography Tensors: On Algebraic Entities That Represent Three Views of Static or Moving Planar Points

68 Citations2000Amnon Shashua, Lior Wolf

A 3 ×3 × 3 × 3 tensor Hijk and its dual Hijk which represent the 2D projective mapping of points across three projections (views) and it concatenates two homography matrices to represent the joint mapping across three views.

Multi-frame alignment of planes

20 Citations2003Lihi Zelnik‐Manor, M. Irani