arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.00266cs.ARcs.DC
收藏

通过自定义处理器架构加速概率推理

Acceleration of probabilistic reasoning through custom processor architecture

Nimish Shah, Laura I. Galindez Olascoaga, Wannes Meert, Marian Verhelst

摘要:

概率推理是鲁棒决策系统的重要工具,因为它能够显式地处理现实世界的不确定性,约束和因果关系。因此,研究人员正在通过将深度学习与概率推理相结合来开发混合模型,用于自动驾驶车辆、自动无人机等安全关键型应用。因此,本文提出了一种自定义的可编程处理器,以加速和积网络,一个重要的概率推理执行内核。该处理器具有针对和积网络执行而优化的优化数据路径架构和存储层次结构。实验结果表明,该处理器在需要更少的计算和内存单元的同时,实现了比Nvidia Jetson TX2嵌入式GPU平台高12倍的吞吐量优势。

英文摘要:

Probabilistic reasoning is an essential tool for robust decision-making systems because of its ability to explicitly handle real-world uncertainty, constraints and causal relations. Consequently, researchers are developing hybrid models by combining Deep Learning with probabilistic reasoning for safety-critical applications like self-driving vehicles, autonomous drones, etc. However, probabilistic reasoning kernels do not execute efficiently on CPUs or GPUs. This paper, therefore, proposes a custom programmable processor to accelerate sum-product networks, an important probabilistic reasoning execution kernel. The processor has an optimized datapath architecture and memory hierarchy optimized for sum-product networks execution. Experimental results show that the processor, while requiring fewer computational and memory units, achieves a 12x throughput benefit over the Nvidia Jetson TX2 embedded GPU platform.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑