arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1903.04243cs.DCcs.LGcs.MS
收藏

自动向量化TensorFlow图:雅可比、自动批处理及其他

Auto-Vectorizing TensorFlow Graphs: Jacobians, Auto-Batching And Beyond

Google Inc(谷歌公司)

Ashish Agarwal, Igor Ganichev

摘要:

我们在TensorFlow等框架所使用的高级别递归低IR之上提出了一种静态循环向量化优化。在TensorFlow之上提供了一种新的静态矢量化并行抽象,用于从自动缩放和每个示例梯度到雅可比计算、优化的映射函数和输入管道优化等应用。我们报告了巨大的加速比基于循环的实现,以及运行时采用的DyNet框架。

英文摘要:

We propose a static loop vectorization optimization on top of high level dataflow IR used by frameworks like TensorFlow. A new statically vectorized parallel-for abstraction is provided on top of TensorFlow, and used for applications ranging from auto-batching and per-example gradients, to jacobian computation, optimized map functions and input pipeline optimization. We report huge speedups compared to both loop based implementations, as well as run-time batching adopted by the DyNet framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑