arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.08895cs.LGcs.DCcs.PF
收藏

cedar:优化且统一的机器学习输入数据管道

cedar: Optimized and Unified Machine Learning Input Data Pipelines

Stanford University(斯坦福大学)

Mark Zhao, Emanuel Adamiak, Christos Kozyrakis

AI总结:

针对机器学习输入数据系统无法充分利用性能优化、导致资源低效或加速器未被充分利用的问题,提出优化且统一的编程框架cedar,通过可组合算子、可扩展优化器等提升性能,在八个管道中性能提升1.87倍至10.65倍。

摘要:

输入数据管道是每个机器学习(ML)训练任务的核心组件,负责读取海量训练数据、通过复杂变换处理样本批次,并以低延迟和高吞吐量将其加载到训练节点。在数据量激增和训练吞吐量需求飙升的推动下,高性能输入数据系统变得愈发关键。然而,当前输入数据系统无法充分利用关键性能优化,导致基础设施效率极低,需大量资源,甚至更糟的是,昂贵的加速器未被充分利用。为满足这些需求,我们提出cedar,一种针对ML输入数据管道的优化且统一的编程框架。cedar允许用户使用可组合算子定义输入数据管道,支持任意ML框架和库。它引入可扩展优化器,系统应用复杂优化组合(如卸载、缓存、预取、融合和重排序),无需用户干预即可跨可定制的本地和分布式计算资源协调处理,以提升处理性能和效率。在八个管道中,与最先进的输入数据系统相比,cedar将性能提升了1.87倍至10.65倍。

英文摘要:

The input data pipeline is an essential component of each machine learning (ML) training job. It is responsible for reading massive amounts of training data, processing batches of samples using complex transformations, and loading them onto training nodes at low latency and high throughput. Performant input data systems are becoming increasingly critical, driven by skyrocketing data volumes and training throughput demands. Unfortunately, current input data systems cannot fully leverage key performance optimizations, resulting in hugely inefficient infrastructures that require significant resources - or worse - underutilize expensive accelerators. To address these demands, we present cedar, an optimized and unified programming framework for ML input data pipelines. cedar allows users to define input data pipelines using composable operators that support arbitrary ML frameworks and libraries. cedar introduces an extensible optimizer that systematically applies a complex combination of optimizations (e.g., offloading, caching, prefetching, fusion, and reordering). It orchestrates processing across a customizable set of local and distributed compute resources in order to improve processing performance and efficiency, all without user input. Across eight pipelines, cedar improves performance by up to 1.87x to 10.65x compared to state-of-the-art input data systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑