Adaptive mixture methods based on Bregman divergences
Author
Donmez, M. A.
Inan, H. A.
Kozat, S. S.
Date
2013Source Title
Digital Signal Processing: A Review Journal
Print ISSN
1051-2004
Publisher
Elsevier
Volume
23
Issue
1
Pages
86 - 97
Language
English
Type
ArticleItem Usage Stats
121
views
views
85
downloads
downloads
Abstract
We investigate adaptive mixture methods that linearly combine outputs of m constituent filters running in parallel to model a desired signal. We use Bregman divergences and obtain certain multiplicative updates to train the linear combination weights under an affine constraint or without any constraints. We use unnormalized relative entropy and relative entropy to define two different Bregman divergences that produce an unnormalized exponentiated gradient update and a normalized exponentiated gradient update on the mixture weights, respectively. We then carry out the mean and the mean-square transient analysis of these adaptive algorithms when they are used to combine outputs of m constituent filters. We illustrate the accuracy of our results and demonstrate the effectiveness of these updates for sparse mixture systems.
Keywords
Adaptive mixtureAffine mixture
Bregman divergence
Multiplicative update
Affine Constraints
Bregman divergences
Desired signal
Linear combinations
Mean-square
Mixture method
Multiplicative updates
Relative entropy
Running-in
Adaptive algorithms
Entropy
Mixtures
Permalink
http://hdl.handle.net/11693/21144Published Version (Please cite this version)
http://dx.doi.org/10.1016/j.dsp.2012.09.006Collections
Related items
Showing items related by title, author, creator and subject.
-
Vortices in trapped boson-fermion mixtures
Taşgin, M. E.; Subaşi, A. L.; Oktel, M. Ö.; Tanatar, Bilal (Springer, 2005)We consider a trapped system of atomic boson-fermion mixture with a quantized vortex. We investigate the density profiles of bosonic and fermionic components as functions of the boson-boson and boson-fermion short-range ... -
Spectrum sensing via restricted neyman-pearson approach in the presence of non-Gaussian noise
Turgut, Esma; Gezici, Sinan (IEEE, 2013)In this paper, spectrum sensing in cognitive radio systems is studied for non-Gaussian channels in the presence of prior distribution uncertainty. In most practical cases, some amount of prior information about signals of ... -
Experimental investigation of critical Casimir forces in binary liquid mixtures by blinking optical tweezers
Magazzu, Alessandro; Schmidt, F.; Callegari, Agnese; Gambassi, A.; Dietrich, S.; Volpe, Giovanni (OSA, 2017)We investigate, for the first time and by blinking optical tweezers, the effects of critical Casimir forces (CCFs) on the free dynamics of a pair of spherical colloidal particles, immersed in binary liquid mixtures upon ...