arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.12295cs.AR
收藏

面向少样本学习的量化感知边缘AI硬件设计环境

Design Environment of Quantization-Aware Edge AI Hardware for Few-Shot Learning

Research Institute of Electrical Communication, Tohoku University(东北大学电气通信研究所);Graduate School of Engineering, Tohoku University(东北大学工学院);IMT Atlantique, Lab-STICC, UMR CNRS 6285(大西洋高等矿业学院,实验室-STICC,法国国家科学研究中心联合研究单位6285)

R. Kanda, N. Onizawa, M. Leonardon, V. Gripon, T. Hanyu

AI总结:

本研究提出了一种面向少样本学习的边缘AI硬件设计环境,通过定点数据处理实现精度一致性,展示了在低位宽下维持高性能的潜力。

摘要:

本研究旨在通过在预训练和评估阶段实施定点数据处理,确保边缘AI硬件在少样本学习中的整体设计流程中保持准确性的一致性。具体而言,量化模块Brevitas被应用于实现定点数据处理,允许对整数和分数部分的位宽进行任意指定。Brevitas利用了两种定点数据量化方法,即量化感知训练(QAT)和后训练量化(PTQ)。在当前设计流程中使用Tensil时,整数和分数部分的位宽需要分别为8位或16位,但性能验证显示,即使使用6位或5位的位宽,也能维持与浮点运算相当的精度,表明有进一步减少计算资源的潜力。这些结果显然有助于创建一个适用于少样本学习的边缘AI硬件设计和评估环境。

英文摘要:

This study aims to ensure consistency in accuracy throughout the entire design flow in the implementation of edge AI hardware for few-shot learning, by implementing fixed-point data processing in the pre-training and evaluation phases. Specifically, the quantization module, called Brevitas, is applied to implement fixed-point data processing, which allows for arbitrary specification of the bit widths for the integer and fractional parts. Two methods of fixed-point data quantization, quantization-aware training (QAT) and post-training quantization (PTQ), are utilized in Brevitas. With Tensil, which is used in the current design flow, the bit widths of the integer and fractional parts need to be 8 bits each or 16 bits each when implemented in hardware, but performance validation has shown that accuracy comparable to floating-point operations can be maintained even with 6 bits or 5 bits each, indicating potential for further reduction in computational resources. These results clearly contribute to the creation of a versatile design and evaluation environment for edge AI hardware for few-shot learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑