arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.01475cs.ARcs.LG
收藏

探索面向MX及更广范围的FPGA设计

Exploring FPGA designs for MX and beyond

Imperial College London(帝国理工学院);AMD(超威半导体公司)

Ebby Samson, Naveen Mellempudi, Wayne Luk, George A. Constantinides

AI总结:

本文提出首个开源FPGA实现的OCP MX低精度算术设计,并配套发布集成Brevitas的PyTorch量化库,通过ResNet-18在ImageNet上的实验证明MX对INT5、FP6等GPU不原生支持格式的有效性,凸显FPGA在定制数据通路和面积效率上的优势。

摘要:

多家公司近期合作发布了新的开放计算项目MX低精度计算标准,旨在高效实现神经网络。本文描述并评估了该标准所定义算术的首个开源FPGA实现。我们的设计全面支持该标准中用于MX格式相互转换及标准定义算术运算的所有具体格式,并支持任意定点数和浮点数格式。该标准的某些要素留作实现定义,我们提出了首个受FPGA启发的具体选择,并在文中加以概述。我们的优化硬件组件库以开源形式提供,可用于构建更大规模系统。为此,我们还描述并发布了一个面向新标准量化的开源PyTorch库,该库与Brevitas库集成,使社区能够开发以MX格式量化为目标的新型神经网络设计。我们通过在ImageNet ILSVRC12数据集上实现ResNet-18等示例神经网络,展示了这些库的可用性和有效性。我们的测试表明,MX对于GPU不原生支持的INT5或FP6等格式非常有效。这使FPGA具有优势,因为它们能够灵活实现定制数据通路,并利用这些格式提供的更小面积占用。

英文摘要:

A number of companies recently worked together to release the new Open Compute Project MX standard for low-precision computation, aimed at efficient neural network implementation. In this paper, we describe and evaluate the first open-source FPGA implementation of the arithmetic defined in the standard. Our designs fully support all the standard's concrete formats for conversion into and out of MX formats and for the standard-defined arithmetic operations, as well as arbitrary fixed-point and floating-point formats. Certain elements of the standard are left as implementation-defined, and we present the first concrete FPGA-inspired choices for these elements, which we outline in the paper. Our library of optimized hardware components is available open source, and can be used to build larger systems. For this purpose, we also describe and release an open-source Pytorch library for quantization into the new standard, integrated with the Brevitas library so that the community can develop novel neural network designs quantized with MX formats in mind. We demonstrate the usability and efficacy of our libraries via the implementation of example neural networks such as ResNet-18 on the ImageNet ILSVRC12 dataset. Our testing shows that MX is very effective for formats such as INT5 or FP6 which are not natively supported on GPUs. This gives FPGAs an advantage as they have the flexibility to implement a custom datapath and take advantage of the smaller area footprints offered by these formats.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑