arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1706.00327cs.DBcs.AI
收藏

用于在关系数据库中自动化特征工程的一键机

One button machine for automating feature engineering in relational databases

IBM Research(IBM研究院)

Hoang Thanh Lam, Johann-Michael Thiebaut, Mathieu Sinn, Bei Chen, Tiep Mai, Oznur Alkan

摘要:

特征工程是预测分析项目中最重要和最耗时的任务之一。它涉及理解领域知识和数据探索,以从原始数据中发现相关的手工特征。在本文中,我们介绍了一个系统,称为一个按钮机,或OneBM的简称,它自动化的特征发现在关系数据库。OneBM自动执行数据科学家的一项关键活动,即连接数据库表并应用高级数据转换从数据中提取有用的特征。我们在Kaggle竞赛中验证了OneBM,其中OneBM在三次Kaggle竞赛中的表现与前16%至24%的数据科学家一样好。更重要的是,OneBM在Kaggle竞赛中的预测准确率和Kaggle排行榜排名方面优于最先进的系统。结果表明,OneBM对数据科学家和非专家都很有用。它可以帮助数据科学家减少数据探索时间,使他们能够在短时间内尝试和错误的想法。另一方面,它使不熟悉数据科学的非专家能够快速地从数据中提取价值,只需付出很少的努力,时间和成本。

英文摘要:

Feature engineering is one of the most important and time consuming tasks in predictive analytics projects. It involves understanding domain knowledge and data exploration to discover relevant hand-crafted features from raw data. In this paper, we introduce a system called One Button Machine, or OneBM for short, which automates feature discovery in relational databases. OneBM automatically performs a key activity of data scientists, namely, joining of database tables and applying advanced data transformations to extract useful features from data. We validated OneBM in Kaggle competitions in which OneBM achieved performance as good as top 16% to 24% data scientists in three Kaggle competitions. More importantly, OneBM outperformed the state-of-the-art system in a Kaggle competition in terms of prediction accuracy and ranking on Kaggle leaderboard. The results show that OneBM can be useful for both data scientists and non-experts. It helps data scientists reduce data exploration time allowing them to try and error many ideas in short time. On the other hand, it enables non-experts, who are not familiar with data science, to quickly extract value from their data with a little effort, time and cost.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑