LionHeart:面向含模拟存算一体瓦片的异构系统的基于层的映射框架
LionHeart: A Layer-based Mapping Framework for Heterogeneous Systems with Analog In-Memory Computing Tiles
AI总结:
针对模拟存算一体的非理想特性导致精度随时间下降的问题,提出LionHeart框架生成精度约束的混合数模映射,在多类网络上实现超6倍的运行时间缩短与能效提升。
摘要:
当以交叉阵列结构排列时,阻变存储器件可用于以恒定时间复杂度执行矩阵-向量乘法(MVM)——这是众多机器学习(ML)算法中最占主导地位的运算。然而,在模拟域执行计算时,由于非理想的电路和器件特性,会在算术精度和随机性方面带来新的挑战。此外,这些非理想特性具有时间维度,会导致应用精度随时间下降。面对这些挑战,我们提出了一个名为LionHeart的新型框架,用于获取混合数模映射,以利用异构加速器执行深度学习(DL)推理工作负载。LionHeart生成的受精度约束的映射在不同卷积神经网络(CNN)和一个基于transformer的网络上展现出高精度和加速潜力。全系统仿真结果表明,在用户定义的、以全数字浮点实现为基准的精度阈值下,运行时间缩短幅度和能效提升均超过6倍。LionHeart已在以下地址开源:https://github.com/IBM/lionheart。
英文摘要:
When arranged in a crossbar configuration, resistive memory devices can be used to execute Matrix-Vector Multiplications (MVMs), the most dominant operation of many Machine Learning (ML) algorithms, in constant time complexity. Nonetheless, when performing computations in the analog domain, novel challenges are introduced in terms of arithmetic precision and stochasticity, due to non-ideal circuit and device behaviour. Moreover, these non-idealities have a temporal dimension, resulting in a degrading application accuracy over time. Facing these challenges, we propose a novel framework, named LionHeart, to obtain hybrid analog-digital mappings to execute Deep Learning (DL) inference workloads using heterogeneous accelerators. The accuracy-constrained mappings derived by LionHeart showcase, across different Convolutional Neural Networks (CNNs) and one transformer-based network, high accuracy and potential for speedup. The results of the full system simulations highlight run-time reductions and energy efficiency gains that exceed 6X, with a user-defined accuracy threshold for a fully digital floating point implementation. LionHeart is open-sourced here: https://github.com/IBM/lionheart.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。