面向高度分布和快速增长数据的机器学习系统
Machine Learning Systems for Highly-Distributed and Rapidly-Growing Data
摘要:
任何机器学习(ML)应用程序的可用性和实用性在很大程度上受到两个关键但难以实现的因素的影响:低延迟和低成本。不幸的是,当ML依赖于高度分布和快速增长的真实世界数据(例如,全世界的移动电话和摄像机收集的数据)。这些真实世界的数据在通信和计算方面提出了许多挑战。例如,当训练数据分布在跨越多个大陆的数据中心时,数据中心之间的通信可以容易地压倒有限的广域网带宽,导致过高的延迟和高成本。在这篇论文中,我们证明了ML在高度分布和快速增长的数据上的延迟和成本可以通过设计利用ML算法,ML模型结构和ML训练/服务数据特性的ML系统来提高一到两个数量级。我们用三个贡献来支持这一论点。首先,我们设计了一个系统,在大规模和持续增长的数据集(如视频)上提供低延迟和低成本的ML服务(推理)。其次,我们构建了一个系统,使地理分布数据集上的ML训练与单个数据中心内的训练一样快。第三,我们对一个基本的、在很大程度上被忽视的问题提出了第一个详细的研究和系统级的解决方案:非IID上的ML训练(即,非独立且相同分布的)数据分区(例如,由相机收集的面部图像根据每个相机的位置的人口统计而变化)。
英文摘要:
The usability and practicality of any machine learning (ML) applications are largely influenced by two critical but hard-to-attain factors: low latency and low cost. Unfortunately, achieving low latency and low cost is very challenging when ML depends on real-world data that are highly distributed and rapidly growing (e.g., data collected by mobile phones and video cameras all over the world). Such real-world data pose many challenges in communication and computation. For example, when training data are distributed across data centers that span multiple continents, communication among data centers can easily overwhelm the limited wide-area network bandwidth, leading to prohibitively high latency and high cost. In this dissertation, we demonstrate that the latency and cost of ML on highly-distributed and rapidly-growing data can be improved by one to two orders of magnitude by designing ML systems that exploit the characteristics of ML algorithms, ML model structures, and ML training/serving data. We support this thesis statement with three contributions. First, we design a system that provides both low-latency and low-cost ML serving (inferencing) over large-scale and continuously-growing datasets, such as videos. Second, we build a system that makes ML training over geo-distributed datasets as fast as training within a single data center. Third, we present a first detailed study and a system-level solution on a fundamental and largely overlooked problem: ML training over non-IID (i.e., not independent and identically distributed) data partitions (e.g., facial images collected by cameras varies according to the demographics of each camera's location).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。