arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.04115cs.LG
收藏

AutoSmart:一个高效的时态关系数据自动机器学习框架

AutoSmart: An Efficient and Automatic Machine Learning framework for Temporal Relational Data

DeepBlue Technology(深兰科技);Peking University(北京大学)

Zhipeng Luo, Zhixing He, Jin Wang, Manqing Dong, Jianqiang Huang, Mingjian Chen, Bohang Zheng

摘要:

时态关系数据可能是工业机器学习应用中最常用的数据类型,需要劳动密集型的特征工程和数据分析来提供精确的模型预测。需要一个自动的机器学习框架来减轻手动微调模型的工作,以便专家可以更多地关注真正需要人类参与的其他问题,例如问题定义,部署和业务服务。然而,时态关系数据的自动化解决方案面临着三个主要挑战:1)如何有效地自动从多个表中挖掘出有用的信息,并从这些表中挖掘出关系。2)如何自我调节,将时间和内存消耗控制在一定的预算内?以及3)如何对广泛的任务给出通用的解决方案?在这项工作中,我们提出了我们的解决方案,成功地解决了上述问题,在一个端到端的自动方式。拟议的框架AutoSmart是AutoML赛道KDD Cup 2019的获胜解决方案,这是迄今为止最大的AutoML比赛之一(860支球队,约4,955份参赛作品)。该框架包括自动数据处理,表合并,特征工程,模型调整,与时间\存储器控制器,有效地和自动制定的模型。拟议的框架在各个领域的多个数据集上显着优于基线解决方案。

英文摘要:

Temporal relational data, perhaps the most commonly used data type in industrial machine learning applications, needs labor-intensive feature engineering and data analyzing for giving precise model predictions. An automatic machine learning framework is needed to ease the manual efforts in fine-tuning the models so that the experts can focus more on other problems that really need humans' engagement such as problem definition, deployment, and business services. However, there are three main challenges for building automatic solutions for temporal relational data: 1) how to effectively and automatically mining useful information from the multiple tables and the relations from them? 2) how to be self-adjustable to control the time and memory consumption within a certain budget? and 3) how to give generic solutions to a wide range of tasks? In this work, we propose our solution that successfully addresses the above issues in an end-to-end automatic way. The proposed framework, AutoSmart, is the winning solution to the KDD Cup 2019 of the AutoML Track, which is one of the largest AutoML competition to date (860 teams with around 4,955 submissions). The framework includes automatic data processing, table merging, feature engineering, and model tuning, with a time\&memory controller for efficiently and automatically formulating the models. The proposed framework outperforms the baseline solution significantly on several datasets in various domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑