arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2003.10688cs.DCcs.LG
收藏

SOL:无需Source Code更改即可轻松支持AI框架

SOL: Effortless Device Support for AI Frameworks without Source Code Changes

NEC Laboratories Europe(NEC欧洲实验室)

Nicolas Weber, Felipe Huici

摘要:

现代高性能计算集群严重依赖加速器来克服CPU有限的计算能力。这些超级计算机运行来自不同领域的各种应用程序,如模拟,数值应用或人工智能(AI)。因此,供应商需要能够在其硬件上有效地运行各种工作负载。在人工智能领域,许多流行框架(例如PyTorch、TensorFlow等)的存在尤其加剧了这种情况。它们没有共同的代码基础,功能可能会有所不同。这些框架的代码发展很快,这使得跟上所有变化的成本很高,并可能迫使开发人员不断进行上游开发。在本文中,我们将探讨如何在不更改框架源代码的情况下在AI框架中提供硬件支持,以最大限度地减少维护开销。我们介绍SOL,这是一个AI加速中间件,它提供了一个硬件抽象层,允许我们透明地支持异构硬件。作为概念验证,我们使用三个后端为PyTorch实现了SOL:CPU,GPU和向量处理器。

英文摘要:

Modern high performance computing clusters heavily rely on accelerators to overcome the limited compute power of CPUs. These supercomputers run various applications from different domains such as simulations, numerical applications or artificial intelligence (AI). As a result, vendors need to be able to efficiently run a wide variety of workloads on their hardware. In the AI domain this is in particular exacerbated by the existence of a number of popular frameworks (e.g, PyTorch, TensorFlow, etc.) that have no common code base, and can vary in functionality. The code of these frameworks evolves quickly, making it expensive to keep up with all changes and potentially forcing developers to go through constant rounds of upstreaming. In this paper we explore how to provide hardware support in AI frameworks without changing the framework's source code in order to minimize maintenance overhead. We introduce SOL, an AI acceleration middleware that provides a hardware abstraction layer that allows us to transparently support heterogeneous hardware. As a proof of concept, we implemented SOL for PyTorch with three backends: CPUs, GPUs and vector processors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑