自动向量化TensorFlow图:雅可比、自动批处理及其他
Auto-Vectorizing TensorFlow Graphs: Jacobians, Auto-Batching And Beyond
摘要:
我们在TensorFlow等框架所使用的高级别递归低IR之上提出了一种静态循环向量化优化。在TensorFlow之上提供了一种新的静态矢量化并行抽象,用于从自动缩放和每个示例梯度到雅可比计算、优化的映射函数和输入管道优化等应用。我们报告了巨大的加速比基于循环的实现,以及运行时采用的DyNet框架。
英文摘要:
We propose a static loop vectorization optimization on top of high level dataflow IR used by frameworks like TensorFlow. A new statically vectorized parallel-for abstraction is provided on top of TensorFlow, and used for applications ranging from auto-batching and per-example gradients, to jacobian computation, optimized map functions and input pipeline optimization. We report huge speedups compared to both loop based implementations, as well as run-time batching adopted by the DyNet framework.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。