Adaptive mixture methods based on Bregman divergences
Donmez, M. A.
Inan, H. A.
Kozat, S. S.
Digital Signal Processing: A Review Journal
86 - 97
MetadataShow full item record
Please cite this item using this persistent URLhttp://hdl.handle.net/11693/21144
We investigate adaptive mixture methods that linearly combine outputs of m constituent filters running in parallel to model a desired signal. We use Bregman divergences and obtain certain multiplicative updates to train the linear combination weights under an affine constraint or without any constraints. We use unnormalized relative entropy and relative entropy to define two different Bregman divergences that produce an unnormalized exponentiated gradient update and a normalized exponentiated gradient update on the mixture weights, respectively. We then carry out the mean and the mean-square transient analysis of these adaptive algorithms when they are used to combine outputs of m constituent filters. We illustrate the accuracy of our results and demonstrate the effectiveness of these updates for sparse mixture systems.
Showing items related by title, author, creator and subject.
Mercan, Caner (Bilkent University, 2014-07)Density estimation is the process of estimating the parameters of a probability density function from data. The Gaussian mixture model (GMM) is one of the most preferred density families. We study the estimation of a ...
Turgut, E.; Gezici, S. (2013)In this paper, spectrum sensing in cognitive radio systems is studied for non-Gaussian channels in the presence of prior distribution uncertainty. In most practical cases, some amount of prior information about signals of ...
Experimental investigation of critical Casimir forces in binary liquid mixtures by blinking optical tweezers Magazzù A.; Schmidt F.; Callegari A.; Gambassi A.; Dietrich S.; Volpe G. (OSA - The Optical Society, 2017)We investigate, for the first time and by blinking optical tweezers, the effects of critical Casimir forces (CCFs) on the free dynamics of a pair of spherical colloidal particles, immersed in binary liquid mixtures upon ...