Maximum likelihood estimation of Gaussian mixture models using stochastic search
MetadataShow full item record
Please cite this item using this persistent URLhttp://hdl.handle.net/11693/21405
Gaussian mixture models (GMM), commonly used in pattern recognition and machine learning, provide a flexible probabilistic model for the data. The conventional expectationmaximization (EM) algorithm for the maximum likelihood estimation of the parameters of GMMs is very sensitive to initialization and easily gets trapped in local maxima. Stochastic search algorithms have been popular alternatives for global optimization but their uses for GMM estimation have been limited to constrained models using identity or diagonal covariance matrices. Our major contributions in this paper are twofold. First, we present a novel parametrization for arbitrary covariance matrices that allow independent updating of individual parameters while retaining validity of the resultant matrices. Second, we propose an effective parameter matching technique to mitigate the issues related with the existence of multiple candidate solutions that are equivalent under permutations of the GMM components. Experiments on synthetic and real data sets show that the proposed framework has a robust performance and achieves significantly higher likelihood values than the EM algorithm. © 2012 Elsevier Ltd. All rights reserved.
- Research Paper 7144
Showing items related by title, author, creator and subject.
Simon F.; Guillen P.; Sagaut P.; Lucor, D. (2010)The present paper focus on the stochastic response of a two-dimensional transonic airfoil to parametric uncertainties. Both the freestream Mach number and the angle of attack are considered as random parameters and the ...
Dayar, T.; Pekergin, N.; Younès, S. (2006)The problem of computing bounds on the conditional steady-state probability vector of a subset of states in finite, ergodic discrete-time Markov chains (DTMCs) is considered. An improved algorithm utilizing the strong ...
Kabanov, Y.; Pergamenshchikov, S. (1997)A limit of attainability sets is found for a linear two-scale stochastic system for the case when the diffusion coefficient of the fast variable is of order ε1/2. The attainability set is defined as the set of distributions ...