Simultaneous 3-D motion estimation and wire-frame model adaptation including photometric effects for knowledge-based video coding
Author
Bozdağı, Gözde
Tekalp, A. M.
Onural, Levent
Date
1994Source Title
Proceedings of the 19th International Conference on Acoustics, Speech and Signal Processing, IEEE 1994
Print ISSN
1520-6149
Publisher
IEEE
Pages
V413 - V416
Language
English
Type
Conference PaperItem Usage Stats
147
views
views
192
downloads
downloads
Abstract
We address the problem of 3-D motion estimation in the context of knowledge-based coding of facial image sequences. The proposed method handles the global and local motion estimation and the adaptation of a generic wire-frame to a particular speaker simultaneously within an optical flow based framework including the photometric effects of motion. We use a flexible wire-frame model whose local structure is characterized by the normal vectors of the patches which are related to the coordinates of the nodes. Geometrical constraints that describe the propagation of the movement of the nodes are introduced, which are then efficiently utilized to reduce the number of independent structure parameters. A stochastic relaxation algorithm has been used to determine optimum global motion estimates and the parameters describing the structure of the wire-frame model. For the initialization of the motion and structure parameters, a modified feature based algorithm is used. Experimental results with simulated facial image sequences are given.
Keywords
Facial image sequenceFeature-based algorithm
Geometrical constraints
Local motion estimations
Model Adaptation
Motion and structure
Stochastic relaxation
Structure parameter
Algorithms
Computer vision
Image coding
Knowledge based systems
Photometry
Stochastic models
Wire
Motion estimation