arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1508.06388stat.MLcs.LG
收藏

分量均值约束在预选子空间的高斯混合模型

Gaussian Mixture Models with Component Means Constrained in Pre-selected Subspaces

IBM Almaden Research Center(IBM阿尔马登研究中心);The Pennsylvania State University(宾夕法尼亚州立大学)

Mu Qiao, Jia Li

摘要:

本文研究了一个分量均值约束在一个预先选定的子空间中的高斯混合模型。分类和聚类的应用进行了探讨。EM型估计算法的推导。我们证明了包含具有公共协方差阵的GMM的分量均值的子空间也包含密度和类均值的模。这促使我们通过对核密度和类均值的模式应用加权主成分分析来找到子空间。为了避免核带宽难以确定的困难,我们从基于带宽序列的核密度中获得多个子空间。对每个子空间约束下的GMM进行估计,并选择产生极大似然的模型。一个降维属性被证明在意义上的分类或聚类的信息。在真实数据集和模拟数据集上进行了实验,研究了几种确定子空间的方法,并与降秩混合判别分析(MDA)进行了比较。我们的新方法与简单的技术,跨越子空间,只有类的手段往往优于降秩MDA时,子空间维数很低,使它特别吸引人的可视化。

英文摘要:

We investigate a Gaussian mixture model (GMM) with component means constrained in a pre-selected subspace. Applications to classification and clustering are explored. An EM-type estimation algorithm is derived. We prove that the subspace containing the component means of a GMM with a common covariance matrix also contains the modes of the density and the class means. This motivates us to find a subspace by applying weighted principal component analysis to the modes of a kernel density and the class means. To circumvent the difficulty of deciding the kernel bandwidth, we acquire multiple subspaces from the kernel densities based on a sequence of bandwidths. The GMM constrained by each subspace is estimated; and the model yielding the maximum likelihood is chosen. A dimension reduction property is proved in the sense of being informative for classification or clustering. Experiments on real and simulated data sets are conducted to examine several ways of determining the subspace and to compare with the reduced rank mixture discriminant analysis (MDA). Our new method with the simple technique of spanning the subspace only by class means often outperforms the reduced rank MDA when the subspace dimension is very low, making it particularly appealing for visualization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑