arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.00359cs.CVcs.LG
收藏

用于信息融合的标记多重典型相关分析

The Labeled Multiple Canonical Correlation Analysis for Information Fusion

Ryerson University(瑞尔森大学);Epson Canada(爱普生加拿大公司);Zhengzhou University(郑州大学)

Lei Gao, Rui Zhang, Lin Qi, Enqing Chen, Ling Guan

摘要:

多模态信息融合的目的是对不同来源的信息进行数学分析,并产生一种新的表示,这种表示将更有效地用于模式识别和其他多媒体信息处理任务。本文提出了一种基于标记多重典型相关分析(LMCCA)的多模态信息融合与表示方法。通过引入训练样本的类标签信息,建议LMCCA确保融合的特征携带多模态信息表示的区别性特征,并且能够提供优异的识别性能。我们实现了一个原型的LMCCA手写数字识别,人脸识别和对象识别,利用多个功能,双峰人类情感识别,涉及信息从音频和视觉域的有效性。LMCCA的通用性使其能够将通过任何方式提取的特征作为输入,包括通过深度学习(DL)方法提取的特征。实验结果表明,该方法提高了统计机器学习(SML)方法和基于DL的方法的性能。

英文摘要:

The objective of multimodal information fusion is to mathematically analyze information carried in different sources and create a new representation which will be more effectively utilized in pattern recognition and other multimedia information processing tasks. In this paper, we introduce a new method for multimodal information fusion and representation based on the Labeled Multiple Canonical Correlation Analysis (LMCCA). By incorporating class label information of the training samples,the proposed LMCCA ensures that the fused features carry discriminative characteristics of the multimodal information representations, and are capable of providing superior recognition performance. We implement a prototype of LMCCA to demonstrate its effectiveness on handwritten digit recognition,face recognition and object recognition utilizing multiple features,bimodal human emotion recognition involving information from both audio and visual domains. The generic nature of LMCCA allows it to take as input features extracted by any means,including those by deep learning (DL) methods. Experimental results show that the proposed method enhanced the performance of both statistical machine learning (SML) methods, and methods based on DL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑