arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1303.3517cs.DCcs.DBcs.LG
收藏

大规模机器学习的迭代MapReduce

Iterative MapReduce for Large Scale Machine Learning

University of California, Santa Cruz(加州大学圣克鲁兹分校);University of California, Irvine(加州大学欧文分校);Yahoo! Research(雅虎研究院)

Joshua Rosen, Neoklis Polyzotis, Vinayak Borkar, Yingyi Bu, Michael J. Carey, Markus Weimer, Tyson Condie, Raghu Ramakrishnan

摘要:

大型数据集(“大数据”)正变得无处不在,因为跨广泛的商业和科学应用从数据中获得见解的潜在价值越来越被认识到。特别是,大数据上的机器学习--数据分析、总结和推理的基础学科之一--已经成为大多数运营大型云的组织的常规,这些云通常基于支持MapReduce编程范式的Hadoop等系统。现在人们普遍认识到,虽然MapReduce是高度可扩展的,但它有一个机器学习的关键弱点:它不支持迭代。因此,人们不得不围绕这个限制进行编程,导致脆弱,低效的代码。此外,在多租户的云环境中,对程序员的依赖是固有的缺陷,因为程序员在他或她的程序执行时无法看到系统的状态。先前的工作试图通过开发针对程式化应用程序的专门系统来解决这个问题,或者通过在MapReduce中增加对跨迭代保存状态的特殊支持(由外部循环驱动)。在本文中,我们提倡支持循环作为一个一流的结构,并提出了一个扩展的MapReduce编程范式称为{ \em迭代MapReduce}。然后,我们开发了一类迭代MapReduce程序,涵盖了大多数机器学习技术的优化器,为关键的优化步骤提供理论依据,并实证证明,系统优化的程序显着的机器学习任务与国家的最先进的专业解决方案的竞争力。

英文摘要:

Large datasets ("Big Data") are becoming ubiquitous because the potential value in deriving insights from data, across a wide range of business and scientific applications, is increasingly recognized. In particular, machine learning - one of the foundational disciplines for data analysis, summarization and inference - on Big Data has become routine at most organizations that operate large clouds, usually based on systems such as Hadoop that support the MapReduce programming paradigm. It is now widely recognized that while MapReduce is highly scalable, it suffers from a critical weakness for machine learning: it does not support iteration. Consequently, one has to program around this limitation, leading to fragile, inefficient code. Further, reliance on the programmer is inherently flawed in a multi-tenanted cloud environment, since the programmer does not have visibility into the state of the system when his or her program executes. Prior work has sought to address this problem by either developing specialized systems aimed at stylized applications, or by augmenting MapReduce with ad hoc support for saving state across iterations (driven by an external loop). In this paper, we advocate support for looping as a first-class construct, and propose an extension of the MapReduce programming paradigm called {\em Iterative MapReduce}. We then develop an optimizer for a class of Iterative MapReduce programs that cover most machine learning techniques, provide theoretical justifications for the key optimization steps, and empirically demonstrate that system-optimized programs for significant machine learning tasks are competitive with state-of-the-art specialized solutions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑