时态关系数据可能是工业机器学习应用中最常用的数据类型,需要劳动密集型的特征工程和数据分析来提供精确的模型预测。需要一个自动的机器学习框架来减轻手动微调模型的工作,以便专家可以更多地关注真正需要人类参与的其他问题,例如问题定义,部署和业务服务。然而,时态关系数据的自动化解决方案面临着三个主要挑战:1)如何有效地自动从多个表中挖掘出有用的信息,并从这些表中挖掘出关系。2)如何自我调节,将时间和内存消耗控制在一定的预算内?以及3)如何对广泛的任务给出通用的解决方案?在这项工作中,我们提出了我们的解决方案,成功地解决了上述问题,在一个端到端的自动方式。拟议的框架AutoSmart是AutoML赛道KDD Cup 2019的获胜解决方案,这是迄今为止最大的AutoML比赛之一(860支球队,约4,955份参赛作品)。该框架包括自动数据处理,表合并,特征工程,模型调整,与时间\存储器控制器,有效地和自动制定的模型。拟议的框架在各个领域的多个数据集上显着优于基线解决方案。
英文摘要:
Temporal relational data, perhaps the most commonly used data type in industrial machine learning applications, needs labor-intensive feature engineering and data analyzing for giving precise model predictions. An automatic machine learning framework is needed to ease the manual efforts in fine-tuning the models so that the experts can focus more on other problems that really need humans' engagement such as problem definition, deployment, and business services. However, there are three main challenges for building automatic solutions for temporal relational data: 1) how to effectively and automatically mining useful information from the multiple tables and the relations from them? 2) how to be self-adjustable to control the time and memory consumption within a certain budget? and 3) how to give generic solutions to a wide range of tasks? In this work, we propose our solution that successfully addresses the above issues in an end-to-end automatic way. The proposed framework, AutoSmart, is the winning solution to the KDD Cup 2019 of the AutoML Track, which is one of the largest AutoML competition to date (860 teams with around 4,955 submissions). The framework includes automatic data processing, table merging, feature engineering, and model tuning, with a time\&memory controller for efficiently and automatically formulating the models. The proposed framework outperforms the baseline solution significantly on several datasets in various domains.
Supervised Learning on Relational Databases with Graph Neural Networks
Amazon Web Services(亚马逊云服务)
大多数数据科学家和机器学习从业者在工作中使用关系数据[State of ML and Data Science 2017,Kaggle,Inc.]。但是在存储在关系数据库中的数据上训练机器学习模型需要大量的数据提取和特征工程工作。这些工作不仅代价高昂,而且还破坏了数据中潜在的重要关系结构。我们介绍了一种方法,使用图神经网络来克服这些挑战。我们提出的方法在三个数据集中的两个数据集上的性能优于最先进的自动特征工程方法。
University of Chinese Academy of Sciences(中国科学院大学);University of Rochester(罗切斯特大学);University of Science and Technology of China(中国科学技术大学);Peng Cheng Laboratory(鹏城实验室)
Relational Deep Learning: Graph Representation Learning on Relational Databases
Stanford University(斯坦福大学);Max Planck Institute for Informatics(马克斯·普朗克信息学研究所);Yale University(耶鲁大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
本文提出 Relational Deep Learning,将关系数据库建模为主外键连接的时序异构图,并用消息传递 GNN 端到端学习,配合 RelBench 基准实现多表数据的直接建模。
Deep Two-Way Matrix Reordering for Relational Data Analysis
Graduate School of Information Science Technology, The University of Tokyo(东京大学信息科学技术研究生院);Center for Advanced Intelligence Project (AIP), RIKEN(先进智能项目中心(AIP),RIKEN)
Self-Reinforcing Controllable Synthesis of Rare Relational Data via Bayesian Calibration
Henan University, China(河南大学);Department of Statistics, LMU Munich(慕尼黑大学统计系);MCML Munich(慕尼黑MCML);CISPA Helmholtz Center for Information Security, Saarbrücken, Germany(萨尔布吕肯德国海德堡中心信息安全研究所)