Jack Unit:一种支持多种数据格式的面积与能效优化乘法累加(MAC)单元
Jack Unit: An Area- and Energy-Efficient Multiply-Accumulate (MAC) Unit Supporting Diverse Data Formats
AI总结:
本研究提出支持INT、FP、MX等多数据格式的面积与能效优化MAC单元Jack Unit,通过精度可扩展CSM等技术提升硬件效率,实验表明其面积、功耗优于基准,配备该单元的AI加速器能效显著提升。
摘要:
本研究提出一种面积与能效优化的乘法累加(MAC)单元Jack Unit,它是“多面手”,支持整数(INT)、浮点(FP)和微缩放数据格式(MX)等多种数据格式。其通过三点提升硬件效率并提供位级灵活性:i)将FP乘法器中的进位保存乘法器(CSM)替换为精度可扩展CSM;ii)基于CSM内的指数差调整有效数;iii)利用二维子字并行性。为评估效果,我们实现了Jack Unit和三个基准MAC单元的布局,并设计了配备Jack Unit的AI加速器,与支持多种数据格式的最先进AI加速器进行比较。所提MAC单元的面积比基准MAC单元小1.17~2.01倍,功耗低1.05~1.84倍;在五个AI基准测试中,配备Jack Unit的加速器在多种数据格式下的能效比基准提升1.32~5.41倍。
英文摘要:
In this work, we introduce an area- and energy-efficient multiply-accumulate (MAC) unit, named Jack unit, that is a jack-of-all-trades, supporting various data formats such as integer (INT), floating point (FP), and microscaling data format (MX). It provides bit-level flexibility and enhances hardware efficiency by i) replacing the carry-save multiplier (CSM) in the FP multiplier with a precision-scalable CSM, ii) performing the adjustment of significands based on the exponent differences within the CSM, and iii) utilizing 2D sub-word parallelism. To assess effectiveness, we implemented the layout of the Jack unit and three baseline MAC units. Additionally, we designed an AI accelerator equipped with our Jack units to compare with a state-of-the-art AI accelerator supporting various data formats. The proposed MAC unit occupies 1.17~2.01x smaller area and consumes 1.05~1.84x lower power compared to the baseline MAC units. On five AI benchmarks, the accelerator designed with our Jack units improves energy efficiency by 1.32~5.41x over the baseline across various data formats.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。