arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1908.09291cs.DC
收藏

用流水线执行扩展TensorFlow的语义

Extending TensorFlow's Semantics with Pipelined Execution

Sam Whitlock, James Larus, Edouard Bugnion

摘要:

TensorFlow是一个流行的云计算框架,目标是机器学习应用程序。它将应用程序逻辑的规范(在一个简单的图中)与逻辑的执行分开。TensorFlow的原生运行时在各种硬件(包括CPU、GPU和ASIC)上以低开销执行应用程序。虽然支持这些功能的底层底层的XML引擎可以应用于机器学习之外的计算,但某些设计决策限制了这种更广泛的应用,例如应用程序无法区分并发请求中的数据项。本文介绍了Pipelined TensorFlow(PTF),这是一个扩展TensorFlow语义的系统,为更广泛的应用程序逻辑提供支持。特别是,PTF支持在单个实例化上并发处理有限批数据的应用程序。PTF添加这些语义的方法是将图划分为一个更小的图的管道,并使用元数据标记每个数据项。这些较小的图由门(gate)分隔:PTF中的新数据结构,用于缓冲图之间的数据项,并解释元数据以应用新的语义。PTF的流水线架构在未经修改的TensorFlow运行时上执行,保持与许多现有TensorFlow库函数的兼容性。我们的评估表明,PTF的流水线机制可以增加生物信息学应用程序的吞吐量4 $\times$,而只增加其延迟0.13 $\times$。这导致持续的基因组比对和排序速度为321兆字节/秒,使用20台计算机的计算和I/O资源。

英文摘要:

TensorFlow is a popular cloud computing framework that targets machine learning applications. It separates the specification of application logic (in a dataflow graph) from the execution of the logic. TensorFlow's native runtime executes the application with low overhead across a diverse set of hardware including CPUs, GPUs, and ASICs. Although the underlying dataflow engine supporting these features could be applied to computations beyond machine learning, certain design decisions limit this broader application, such as the inability for an application to differentiate between data items across concurrent requests. This paper introduces Pipelined TensorFlow (PTF), a system that extends TensorFlow's semantics to provide support for a broader variety of application logic. In particular, PTF supports applications that concurrently process finite batches of data on a single instantiation. PTF adds these semantics by partitioning the dataflow graph into a pipeline of smaller graphs and tagging each data item with metadata. These smaller graphs are separated by gates: new data structures in PTF that buffer data items between graphs and interpret the metadata to apply the new semantics. PTF's pipeline architecture executes on an unmodified TensorFlow runtime, maintaining compatibility with many existing TensorFlow library functions. Our evaluation shows that the pipelining mechanism of PTF can increase the throughput of a bioinformatics application by 4$\times$ while only increasing its latency by 0.13$\times$. This results in a sustained genome alignment and sorting rate of 321 megabases/second, using the compute and I/O resources of 20 computers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑