arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2610.21695cs.LG
收藏

ShiftQAT:面向固定功能边缘CNN加速器数值契约的量化感知训练

ShiftQAT: Quantization-Aware Training for the Numerical Contract of a Fixed-Function Edge CNN Accelerator

Analog Devices, Inc.(亚德诺半导体公司)

Oguzhan Buyuksolak, Osman Erman Okman, Mehmet Gorkem Ulkar

AI总结:

针对MAX7800x系列固定功能边缘CNN加速器的数值契约,提出ShiftQAT量化感知训练流程,可生成符合契约的网络,在ImageNet上精度损失小,且在MAX78002芯片上推理高效。

摘要:

固定功能CNN加速器使边缘推理快速且能效高,但仅能执行符合精确数值契约的网络。在MAX7800x系列上,该契约要求使用二值化、按张量的对称缩放、8位激活值和偏置、纯整数算术,且每层有一个静态配置的移位操作。我们提出ShiftQAT,这是为该系列开发的量化感知训练(QAT)流程,可生成天生符合该契约的网络,它是该系列开源训练工具链ai8x-training的默认训练路径。ShiftQAT解决了残差、拼接和权重共享依赖,使激活缩放能静态传播,且每层的重量化可简化为一个离线配置的移位操作;它还在适配8位偏置预算的联合二值化网格上训练权重和偏置。在对比方法中,仅ShiftQAT满足契约的所有缩放约束,包括有符号8位激活值存储。即便如此,在ImageNet上,它的W8A8精度下降与约束更少的QAT方法相当,且在W4A8设置下与FP32的精度差距不超过2.9个百分点。在MAX78002芯片上,经ShiftQAT训练的MobileNetV2和ResNet-18对ImageNet图像的推理时间分别为14.6ms和8.4ms,每次推理的能耗分别为5.1mJ和2.8mJ。

英文摘要:

Fixed-function CNN accelerators make edge inference fast and energy-efficient, but they execute only networks that obey a precise numerical contract. On the MAX7800x family, this contract requires power-of-two, per-tensor, symmetric scales, 8-bit activations and biases, integer-only arithmetic, and one statically configured shift per layer. We present ShiftQAT, the quantization-aware training (QAT) flow we developed for this family, which produces networks satisfying the contract by construction. It is the default training path of ai8x-training, the family's open-source training toolchain. ShiftQAT resolves residual, concatenation, and weight-sharing dependencies so that activation scales propagate statically and each layer's requantization reduces to one offline-configured shift. It also trains weights and biases on a joint power-of-two grid that fits the 8-bit bias budget. Among the compared methods, only ShiftQAT satisfies all of the contract's scaling constraints, including signed 8-bit activation storage. Even so, on ImageNet it matches the W8A8 accuracy drop of less constrained QAT methods and stays within 2.9 percentage points of FP32 at W4A8. On MAX78002 silicon, ShiftQAT-trained MobileNetV2 and ResNet-18 classify ImageNet images in 14.6 and 8.4 ms at 5.1 and 2.8 mJ per inference.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑