arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1402.6076cs.LGcs.MSstat.ML
收藏

大规模的机器学习

Machine Learning at Scale

Collective, Inc.(Collective公司)

Sergei Izrailev, Jeremy M. Stanley

摘要:

即使有大量的现代机器学习算法和现成的计算资源,也需要技能来构建有意义的预测模型。如果需要处理数百TB的数据以生成训练数据集,则构建模型变得具有挑战性。在数字广告技术环境中,我们面临着构建数千个此类模型的需求,这些模型可以在24/7混乱的实时生产环境中预测用户行为并为广告活动提供动力。作为数据科学家,我们还必须说服其他对实施成功至关重要的内部部门、我们的管理层和我们的客户,我们的机器学习系统是有效的。在本文中,我们提出了一个自动化的,强大的机器学习平台,每月影响数十亿的广告印象的设计和实施的细节。该平台使我们能够针对不同的性能目标,在多个大洲对数亿用户的数千个广告系列进行持续优化。

英文摘要:

It takes skill to build a meaningful predictive model even with the abundance of implementations of modern machine learning algorithms and readily available computing resources. Building a model becomes challenging if hundreds of terabytes of data need to be processed to produce the training data set. In a digital advertising technology setting, we are faced with the need to build thousands of such models that predict user behavior and power advertising campaigns in a 24/7 chaotic real-time production environment. As data scientists, we also have to convince other internal departments critical to implementation success, our management, and our customers that our machine learning system works. In this paper, we present the details of the design and implementation of an automated, robust machine learning platform that impacts billions of advertising impressions monthly. This platform enables us to continuously optimize thousands of campaigns over hundreds of millions of users, on multiple continents, against varying performance objectives.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑