arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.00361cs.LG
收藏

用于信息融合的判别多重典型相关分析

Discriminative Multiple Canonical Correlation Analysis for Information Fusion

Ryerson University(瑞尔森大学);Zhengzhou University(郑州大学)

Lei Gao, Lin Qi, Enqing Chen, Ling Guan

摘要:

本文提出了判别式多典型相关分析(DMCCA)用于多模态信息分析与融合。DMCCA能够从多模态信息表示中提取更具鉴别力的特征。具体来说,它发现的投影方向,同时最大化类内相关性和最小化类间相关性,从而更好地利用多模态信息。在这个过程中,我们分析表明,最佳投影的尺寸由DMCCA可以相当准确地预测,导致卓越的性能和大幅降低计算成本。进一步验证了典型相关分析(CCA)、多重典型相关分析(MCCA)和判别典型相关分析(DCCA)是DMCCA的特例,从而建立了一个统一的典型相关分析框架。我们实现了一个DMCCA的原型,以证明其在手写数字识别和人类情感识别的性能。实验结果表明,DMCCA方法优于传统的串行融合方法、CCA、MCCA和DCCA。

英文摘要:

In this paper, we propose the Discriminative Multiple Canonical Correlation Analysis (DMCCA) for multimodal information analysis and fusion. DMCCA is capable of extracting more discriminative characteristics from multimodal information representations. Specifically, it finds the projected directions which simultaneously maximize the within-class correlation and minimize the between-class correlation, leading to better utilization of the multimodal information. In the process, we analytically demonstrate that the optimally projected dimension by DMCCA can be quite accurately predicted, leading to both superior performance and substantial reduction in computational cost. We further verify that Canonical Correlation Analysis (CCA), Multiple Canonical Correlation Analysis (MCCA) and Discriminative Canonical Correlation Analysis (DCCA) are special cases of DMCCA, thus establishing a unified framework for Canonical Correlation Analysis. We implement a prototype of DMCCA to demonstrate its performance in handwritten digit recognition and human emotion recognition. Extensive experiments show that DMCCA outperforms the traditional methods of serial fusion, CCA, MCCA and DCCA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑