2-D triangular mesh-based mosaicking for object tracking in the presence of occlusion
Date
1997Source Title
Proceedings of SPIE Vol. 3024, Visual Communications and Image Processing'97
Print ISSN
0277-786X
Publisher
SPIE
Volume
3024
Pages
328 - 337
Language
English
Type
Conference PaperItem Usage Stats
155
views
views
324
downloads
downloads
Abstract
In this paper, we describe a method for temporal tracking of video objects in video clips. We employ a 2D triangular mesh to represent each video object, which allows us to describe the motion of the object by the displacements of the node points of the mesh, and to describe any intensity variations by the contrast and brightness parameters estimated for each node point. Using the temporal history of the node point locations, we continue tracking the nodes of the 2D mesh even when they become invisible because of self-occlusion or occlusion by another object. Uncovered parts of the object in the subsequent frames of the sequence are detected by means of an active contour which contains a novel shape preserving energy term. The proposed shape preserving energy term is found to be successful in tracking the boundary of an object in video sequences with complex backgrounds. By adding new nodes or updating the 2D triangular mesh we incrementally append the uncovered parts of the object detected during the tracking process to the one of the objects to generate a static mosaic of the object. Also, by texture mapping the covered pixels into the current frame of the video clip we can generate a dynamic mosaic of the object. The proposed mosaicing technique is more general than those reported in the literature because it allows for local motion and out-of-plane rotations of the object that results in self-occlusions. Experimental results demonstrate the successful tracking of the objects with deformable boundaries in the presence of occlusion.
Keywords
CommunicationDigital image storage
Image communication systems
Image processing
Imaging systems
Motion estimation
Video cameras
Video recording
Visual communication
Active contours
Complex backgrounds
Current frames
Deformable boundaries
Intensity variations
Local motions