arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.10911cs.DCcs.AI
收藏

组合系统上深度学习工作负载的性能分析

Performance Analysis of Deep Learning Workloads on a Composable System

IBM T. J. Watson Research Center(IBM TJ·沃森研究中心);IBM Systems(IBM系统部)

Kauotar El Maghraoui, Lorraine M. Herger, Chekuri Choudary, Kim Tran, Todd Deshane, David Hanson

摘要:

可组合基础设施被定义为资源,如计算、存储、加速器和网络,这些资源在池中共享,并且可以按各种配置进行分组以满足应用程序要求。这种动态“混合和匹配”资源的自由允许在设计周期的早期,在系统的最终架构设计或硬件实现之前进行实验。这种设计提供了灵活性,以服务于各种工作负载,并提供了一个动态的协同设计平台,允许以受控的方式进行实验和测量。例如,关键的性能瓶颈可以在实验阶段早期发现,从而避免代价高昂和耗时的错误。此外,在试验新的片上系统(SoC)和新的加速器类型时,可以评估各种系统级拓扑。本文详细介绍了我们在IBM Research AI硬件中心(AIHC)实施并提供给合作伙伴的企业可组合基础设施的设计。我们对可组合系统的实验评估深入了解了系统的工作原理,并评估了各种资源聚合和重新配置对代表性深度学习基准的影响。

英文摘要:

A composable infrastructure is defined as resources, such as compute, storage, accelerators and networking, that are shared in a pool and that can be grouped in various configurations to meet application requirements. This freedom to 'mix and match' resources dynamically allows for experimentation early in the design cycle, prior to the final architectural design or hardware implementation of a system. This design provides flexibility to serve a variety of workloads and provides a dynamic co-design platform that allows experiments and measurements in a controlled manner. For instance, key performance bottlenecks can be revealed early on in the experimentation phase thus avoiding costly and time consuming mistakes. Additionally, various system-level topologies can be evaluated when experimenting with new System on Chip (SoCs) and new accelerator types. This paper details the design of an enterprise composable infrastructure that we have implemented and made available to our partners in the IBM Research AI Hardware Center (AIHC). Our experimental evaluations on the composable system give insights into how the system works and evaluates the impact of various resource aggregations and reconfigurations on representative deep learning benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑