arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.08982cs.LGcs.AIcs.NE
收藏

MEL:面向高维特征选择的高效多任务进化学习

MEL: Efficient Multi-Task Evolutionary Learning for High-Dimensional Feature Selection

Hong Kong Baptist University(香港浸会大学);Institute of Artificial Intelligence and Future Networks, Beijing Normal University (Zhuhai campus)(北京师范大学(珠海校区)人工智能与未来网络研究院)

Xubin Wang, Haojiong Shangguan, Fengyi Huang, Shangrui Wu, Weijia Jia

AI总结:

针对高维特征选择中的维度灾难和进化计算方法信息共享不足的问题,提出基于PSO的多任务进化学习框架MEL,通过跨任务信息共享提升学习效率,在22个数据集上表现出强竞争力。

摘要:

特征选择是数据挖掘中通过降低数据维度来提升模型性能的关键步骤。然而,采集数据维度的不断增加加剧了被称为“维度灾难”的挑战,即计算量随维度数量呈指数级增长。为解决此问题,进化计算(EC)方法因其简单性和适用性而日益受到欢迎。遗憾的是,EC方法多样的设计导致其处理不同数据的能力各异,常常未能充分利用并有效共享信息。在本文中,我们提出了一种名为基于PSO的多任务进化学习(MEL)的新方法,利用多任务学习来应对这些挑战。通过在不同特征选择任务之间引入信息共享机制,MEL实现了学习能力和效率的提升。我们通过在22个高维数据集上的大量实验评估了MEL的有效性。与24种EC方法相比,我们的方法展现出强大的竞争力。此外,我们已在GitHub上开源了代码:https://github.com/wangxb96/MEL。

英文摘要:

Feature selection is a crucial step in data mining to enhance model performance by reducing data dimensionality. However, the increasing dimensionality of collected data exacerbates the challenge known as the "curse of dimensionality", where computation grows exponentially with the number of dimensions. To tackle this issue, evolutionary computational (EC) approaches have gained popularity due to their simplicity and applicability. Unfortunately, the diverse designs of EC methods result in varying abilities to handle different data, often underutilizing and not sharing information effectively. In this paper, we propose a novel approach called PSO-based Multi-task Evolutionary Learning (MEL) that leverages multi-task learning to address these challenges. By incorporating information sharing between different feature selection tasks, MEL achieves enhanced learning ability and efficiency. We evaluate the effectiveness of MEL through extensive experiments on 22 high-dimensional datasets. Comparing against 24 EC approaches, our method exhibits strong competitiveness. Additionally, we have open-sourced our code on GitHub at https://github.com/wangxb96/MEL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑