arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.06251cs.LGcs.ITmath.IT
收藏

面向多视图集成学习的语义保持特征划分

Semantic-Preserving Feature Partitioning for Multi-View Ensemble Learning

University of Technology Sydney(悉尼科技大学);Sultan Qaboos University(苏丹卡布斯大学);Obuda University(欧布达大学)

Mohammad Sadegh Khorshidi, Navid Yazdanjue, Hassan Gharoun, Danial Yazdani, Mohammad Reza Nikoo, Fang Chen, Amir H. Gandomi

AI总结:

本文提出基于信息论的语义保持特征划分算法SPFP,通过构建语义一致的多视图提升集成学习性能,并在八个数据集上验证其能兼顾准确率与不确定性度量,同时降低计算需求。

摘要:

在机器学习中,数据的指数级增长以及与之相关的“维度灾难”带来了重大挑战,尤其是在规模庞大但稀疏的数据集上。为应对这些挑战,多视图集成学习(MEL)已成为一种变革性方法,其中特征划分(FP)在为MEL构建人工视图方面发挥着关键作用。本研究提出了语义保持特征划分(SPFP)算法,这是一种基于信息论的新方法。SPFP算法能够有效地将数据集划分为多个语义一致的视图,从而增强MEL过程。通过在八个真实世界数据集上进行广泛实验,覆盖从高维少样本到低维多样本的不同情形,我们的方法展现出显著效果。在能够实现高泛化性能的场景中,它在保持模型准确率的同时显著改善了不确定性度量;而在高泛化准确率较难获得的场景中,它在保持不确定性度量的同时提升了准确率。效应量分析进一步表明,SPFP算法以较大的效应量优于基准模型,并通过有效的降维降低了计算需求。大多数实验中观察到的大效应量凸显了该算法在模型性能上的显著提升。

英文摘要:

In machine learning, the exponential growth of data and the associated ``curse of dimensionality'' pose significant challenges, particularly with expansive yet sparse datasets. Addressing these challenges, multi-view ensemble learning (MEL) has emerged as a transformative approach, with feature partitioning (FP) playing a pivotal role in constructing artificial views for MEL. Our study introduces the Semantic-Preserving Feature Partitioning (SPFP) algorithm, a novel method grounded in information theory. The SPFP algorithm effectively partitions datasets into multiple semantically consistent views, enhancing the MEL process. Through extensive experiments on eight real-world datasets, ranging from high-dimensional with limited instances to low-dimensional with high instances, our method demonstrates notable efficacy. It maintains model accuracy while significantly improving uncertainty measures in scenarios where high generalization performance is achievable. Conversely, it retains uncertainty metrics while enhancing accuracy where high generalization accuracy is less attainable. An effect size analysis further reveals that the SPFP algorithm outperforms benchmark models by large effect size and reduces computational demands through effective dimensionality reduction. The substantial effect sizes observed in most experiments underscore the algorithm's significant improvements in model performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑