arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2307.09357cs.ETcs.LG
收藏

使用IBM模拟内存硬件加速工具包进行神经网络训练与推理

Using the IBM Analog In-Memory Hardware Acceleration Kit for Neural Network Training and Inference

IBM Research Europe(IBM欧洲研究院);IBM Research - Yorktown Heights(IBM约克镇高地研究院);IBM Research - Almaden(IBM阿尔马登研究院)

Manuel Le Gallo, Corey Lammie, Julian Buechel, Fabio Carta, Omobayode Fagbohungbe, Charles Mackin, Hsinyu Tsai, Vijay Narayanan, Abu Sebastian, Kaoutar El Maghraoui, Malte J. Rasch

AI总结:

本教程介绍了IBM推出的免费Python库AIHWKit,可模拟基于模拟内存计算的深度神经网络训练与推理,还介绍了配套云平台及扩展方法,助力DNN适配模拟内存硬件以实现低延迟低能耗计算。

摘要:

模拟内存计算(Analog In-Memory Computing, AIMC)是降低深度神经网络(Deep Neural Network, DNN)推理与训练延迟及能耗的一种极具前景的方法。然而,AIMC芯片中器件的噪声特性、非线性特性以及非理想外围电路,要求对部署在该类硬件上的DNN进行适配,才能达到与数字计算相当的精度。本教程深入探讨了如何利用最新发布的IBM模拟硬件加速工具包(AIHWKit,可在https://github.com/IBM/aihwkit免费获取)实现并评估这类适配。AIHWKit是一个Python库,可模拟基于AIMC的DNN推理与训练过程。本文详细介绍了AIHWKit的设计、功能以及正确开展推理与训练的最佳实践,同时概述了模拟AI云编排器(Analog AI Cloud Composer)——这一平台可在全托管云环境中提供AIHWKit模拟的使用优势,还支持访问实体AIMC硬件,可在https://aihw-composer.draco.res.ibm.com免费使用。最后,本文展示了用户如何根据自身需求扩展和定制AIHWKit的示例。本教程配套了可通过AIHWKit运行的完整Jupyter Notebook代码示例,可从https://github.com/IBM/aihwkit/tree/master/notebooks/tutorial下载。

英文摘要:

Analog In-Memory Computing (AIMC) is a promising approach to reduce the latency and energy consumption of Deep Neural Network (DNN) inference and training. However, the noisy and non-linear device characteristics, and the non-ideal peripheral circuitry in AIMC chips, require adapting DNNs to be deployed on such hardware to achieve equivalent accuracy to digital computing. In this tutorial, we provide a deep dive into how such adaptations can be achieved and evaluated using the recently released IBM Analog Hardware Acceleration Kit (AIHWKit), freely available at https://github.com/IBM/aihwkit. The AIHWKit is a Python library that simulates inference and training of DNNs using AIMC. We present an in-depth description of the AIHWKit design, functionality, and best practices to properly perform inference and training. We also present an overview of the Analog AI Cloud Composer, a platform that provides the benefits of using the AIHWKit simulation in a fully managed cloud setting along with physical AIMC hardware access, freely available at https://aihw-composer.draco.res.ibm.com. Finally, we show examples on how users can expand and customize AIHWKit for their own needs. This tutorial is accompanied by comprehensive Jupyter Notebook code examples that can be run using AIHWKit, which can be downloaded from https://github.com/IBM/aihwkit/tree/master/notebooks/tutorial.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑