3-D motion estimation and wireframe adaptation including photometric effects for model-based coding of facial image sequences

Date
1994-06
Authors
Bozdağı, G.
Tekalp, A. M.
Onural, L.
Advisor
Supervisor
Co-Advisor
Co-Supervisor
Instructor
Source Title
IEEE Transactions On Circuits And Systems For Video Technology
Print ISSN
1051-8215
Electronic ISSN
1558-2205
Publisher
IEEE
Volume
4
Issue
3
Pages
246 - 256
Language
English
Type
Article
Journal Title
Journal ISSN
Volume Title
Series
Abstract

We propose a novel formulation where 3-D global and local motion estimation and the adaptation of a generic wireframe model to a particular speaker are considered simultaneously within an optical flow based framework including the photometric effects of the motion. We use a flexible wireframe model whose local structure is characterized by the normal vectors of the patches which are related to the coordinates of the nodes. Geometrical constraints that describe the propagation of the movement of the nodes are introduced, which are then efficiently utilized to reduce the number of independent structure parameters. A stochastic relaxation algorithm has been used to determine optimum global motion estimates and the parameters describing the structure of the wireframe model. Results with both simulated and real facial image sequences are provided.

Course
Other identifiers
Book Title
Keywords
Motion estimation, Geometrical optics, Optical variables control, Image motion analysis, Photometry, Optical propagation, Stochastic processes, Parameter estimation, Image sequences
Citation
Published Version (Please cite this version)