arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.03022cs.LG
收藏

SEHFS: 结构熵引导的多视图多标签特征选择中的高阶相关性学习

SEHFS: Structural Entropy-Guided High-Order Correlation Learning for Multi-View Multi-Label Feature Selection

College of Software, Jilin University(吉林大学软件学院);College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);Key Laboratory of Symbolic Computation and Knowledge Engineering of the Ministry of Education(教育部符号计算与知识工程重点实验室);School of Computing and Artificial Intelligence, Southwestern University of Finance and Economics(西南财经大学计算机与人工智能学院);Engineering Research Center of Intelligent Finance, Ministry of Education(教育部智能金融工程研究中心);Shenzhen Key Laboratory of Visual Object Detection and Recognition, Harbin Institute of Technology(哈尔滨工业大学深圳视觉对象检测与识别重点实验室);School of Artificial Intelligence and Computer Science, Nantong University(南通大学人工智能与计算机科学学院);Faculty of Data Science, City University of Macau(澳门城市大学数据科学学院)

Cheng Peng, Yonghao Li, Wanfu Gao, Jie Wen, Weiping Ding

AI总结:

SEHFS通过结构熵引导的高阶相关性学习,提升多视图多标签特征选择的性能。

摘要:

近年来,由于其与现实世界场景的紧密契合,多视图多标签学习(MVML)受到了广泛关注。信息论方法因其在学习非线性相关性方面的优势而备受瞩目。然而,仍然存在两个关键挑战:首先,现实数据中的特征通常表现出高阶结构相关性,但现有信息论方法难以学习此类相关性;其次,通常依赖启发式优化,信息论方法容易收敛到局部极值。为了解决这两个挑战,我们提出了一种新的方法,称为结构熵引导的多视图多标签特征选择中的高阶相关性学习(SEHFS)。SEHFS的核心思想是将特征图转换为一个结构熵最小化的编码树,量化高阶依赖的信息成本,从而学习超越成对相关性的高阶特征相关性。具体而言,在编码树中,表现出强高阶冗余的特征被分组到同一个簇中,而簇间特征的相关性被最小化,从而在簇内和簇间消除冗余。此外,采用了一种基于信息论与矩阵方法融合的新框架,该框架学习了一个共享的语义矩阵和视图特定的贡献矩阵,以重建一个全局视图矩阵,从而增强信息论方法并平衡全局和局部优化。结构熵学习高阶相关性的能力在理论上得到了确立,并且在八个来自不同领域的数据集上的实验以及消融研究均表明,SEHFS在特征选择上实现了优越的性能。

英文摘要:

In recent years, multi-view multi-label learning (MVML) has attracted extensive attention due to its close alignment to real-world scenarios. Information-theoretic methods have gained prominence for learning nonlinear correlations. However, two key challenges persist: first, features in real-world data commonly exhibit high-order structural correlations, but existing information-theoretic methods struggle to learn such correlations; second, commonly relying on heuristic optimization, information-theoretic methods are prone to converging to local optima. To address these two challenges, we propose a novel method called Structural Entropy Guided High-Order Correlation Learning for Multi-View Multi-Label Feature Selection (SEHFS). The core idea of SEHFS is to convert the feature graph into a structural-entropy-minimizing encoding tree, quantifying the information cost of high-order dependencies and thus learning high-order feature correlations beyond pairwise correlations. Specifically, features exhibiting strong high-order redundancy are grouped into a single cluster within the encoding tree, while inter-cluster feaeture correlations are minimized, thereby eliminating redundancy both within and across clusters. Furthermore, a new framework based on the fusion of information theory and matrix methods is adopted, which learns a shared semantic matrix and view-specific contribution matrices to reconstruct a global view matrix, thereby enhancing the information-theoretic method and balancing the global and local optimization. The ability of structural entropy to learn high-order correlations is theoretically established, and and both experiments on eight datasets from various domains and ablation studies demonstrate that SEHFS achieves superior performance in feature selection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑