arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.04153cs.LG
收藏

用于自动化特征工程的学习特征重要性分数

Learned Feature Importance Scores for Automated Feature Engineering

Google(谷歌)

Yihe Dong, Sercan Arik, Nathanael Yoder, Tomas Pfister

AI总结:

本文提出AutoMAN框架,通过学习特征重要性掩码实现端到端的自动化特征工程,无需显式生成变换特征,在保证高精度和低延迟的同时支持异构与时变数据。

摘要:

特征工程已在许多机器学习工作流中展现出显著效用,例如在小数据场景或分布偏移严重的情况下。因此,自动化这一能力可以减轻大量人工工作并提升模型性能。为此,我们提出AutoMAN,即基于掩码的自动化特征工程(Automated Mask-based Feature Engineering),这是一个自动化特征工程框架,能够实现高精度、低延迟,并可扩展到异构和时变数据。AutoMAN基于对候选变换空间的有效探索,而无需显式地生成变换后的特征。这是通过学习特征重要性掩码来实现的,该掩码可以扩展以支持时间序列等其他模态。AutoMAN以端到端方式学习特征变换的重要性,将数据集的任务目标直接纳入特征工程,从而实现了最先进的性能,并且与替代方案相比延迟显著降低。

英文摘要:

Feature engineering has demonstrated substantial utility for many machine learning workflows, such as in the small data regime or when distribution shifts are severe. Thus automating this capability can relieve much manual effort and improve model performance. Towards this, we propose AutoMAN, or Automated Mask-based Feature Engineering, an automated feature engineering framework that achieves high accuracy, low latency, and can be extended to heterogeneous and time-varying data. AutoMAN is based on effectively exploring the candidate transforms space, without explicitly manifesting transformed features. This is achieved by learning feature importance masks, which can be extended to support other modalities such as time series. AutoMAN learns feature transform importance end-to-end, incorporating a dataset's task target directly into feature engineering, resulting in state-of-the-art performance with significantly lower latency compared to alternatives.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑