arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.03911cs.LGstat.ML
收藏

大规模机器学习研究综述

A Survey on Large-scale Machine Learning

Hefei University of Technology(合肥工业大学);University of Science and Technology of China(中国科学技术大学)

Meng Wang, Weijie Fu, Xiangnan He, Shijie Hao, Xindong Wu

摘要:

机器学习可以提供对数据的深入洞察,使机器能够做出高质量的预测,并已广泛应用于现实世界的应用,如文本挖掘,视觉分类和推荐系统。然而,大多数复杂的机器学习方法在对大规模数据进行操作时都会面临巨大的时间成本。这个问题需要{大规模机器学习}(LML),其目的是从大数据中有效地学习具有可比性能的模式。在本文中,我们提供了一个系统的调查现有的LML方法,提供了一个蓝图,为未来的发展,这一领域。我们首先根据提高可扩展性的方式将这些LML方法划分为:1)基于计算复杂性的模型简化,2)基于计算效率的优化近似,3)基于计算能力的计算并行。然后,我们在每一个角度的方法进行分类,根据其目标场景,并介绍了代表性的方法与内在的战略。最后,我们分析了它们的局限性,并讨论了潜在的方向以及有希望在未来解决的开放问题。

英文摘要:

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However, most sophisticated machine learning approaches suffer from huge time costs when operating on large-scale data. This issue calls for the need of {Large-scale Machine Learning} (LML), which aims to learn patterns from big data with comparable performance efficiently. In this paper, we offer a systematic survey on existing LML methods to provide a blueprint for the future developments of this area. We first divide these LML methods according to the ways of improving the scalability: 1) model simplification on computational complexities, 2) optimization approximation on computational efficiency, and 3) computation parallelism on computational capabilities. Then we categorize the methods in each perspective according to their targeted scenarios and introduce representative methods in line with intrinsic strategies. Lastly, we analyze their limitations and discuss potential directions as well as open issues that are promising to address in the future.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑