LoopStack:一个轻量级张量代数编译器栈
LoopStack: a Lightweight Tensor Algebra Compiler Stack
摘要:
我们提出了LoopStack,一个域特定的编译器堆栈张量操作,由前端,LoopTool,和一个高效的优化代码生成器,LoopNest。这个堆栈使我们能够编译整个神经网络并生成针对AVX 2、AVX 512、NEON和NEONfp 16指令集的代码,同时结合其他机器学习编译器后端经常缺少的优化。我们在一组完整的神经网络和常用的网络块以及单个运算符上评估了我们的堆栈,并表明LoopStack生成的机器码在这两种情况下都能匹配并经常超过最先进的机器学习框架的性能。我们还表明,对于大量的时间表LoopNest的编译速度比LLVM快几个数量级,同时导致相等或改进的运行时间性能。此外,LoopStack具有非常小的内存占用-二进制大小为245 KB,有效代码不到30 K行,非常适合在移动和嵌入式设备上使用。
英文摘要:
We present LoopStack, a domain specific compiler stack for tensor operations, composed of a frontend, LoopTool, and an efficient optimizing code generator, LoopNest. This stack enables us to compile entire neural networks and generate code targeting the AVX2, AVX512, NEON, and NEONfp16 instruction sets while incorporating optimizations often missing from other machine learning compiler backends. We evaluate our stack on a collection of full neural networks and commonly used network blocks as well as individual operators, and show that LoopStack generates machine code that matches and frequently exceeds the performance of in state-of-the-art machine learning frameworks in both cases. We also show that for a large collection of schedules LoopNest's compilation is orders of magnitude faster than LLVM, while resulting in equal or improved run time performance. Additionally, LoopStack has a very small memory footprint - a binary size of 245KB, and under 30K lines of effective code makes it ideal for use on mobile and embedded devices.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。