arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.16336cs.LGcs.AI
收藏

HAWX:一种面向硬件的框架,用于快速且可扩展的深度神经网络近似

HAWX: A Hardware-Aware FrameWork for Fast and Scalable ApproXimation of DNNs

University of Zanjan(赞詹大学);Brandenburg Technical University(勃兰登堡技术大学);Tallinn University of Technology(塔林技术大学);Shahid Bahonar University(沙希德·巴霍纳大学)

Samira Nazari, Mohammad Saeed Almasi, Mahdi Taheri, Ali Azarpeyvand, Ali Mokhtari, Ali Mahani, Christian Herglotz

AI总结:

HAWX通过多级敏感度评分和预测模型,实现深度神经网络近似的快速且可扩展优化,提升效率并支持多种硬件架构。

摘要:

本文提出了HAWX,一种面向硬件的可扩展探索框架,通过在不同深度神经网络抽象层次(操作符、滤波器、层和模型)上进行多级敏感度评分,指导选择性集成异构AxC块。通过准确性、功率和面积的预测模型支持,HAWX加速了候选配置的评估,在层级搜索中使用两个候选近似块可实现超过23倍的速度提升,在滤波器级搜索中仅针对LeNet-5即可实现超过3*10^6倍的速度提升,同时保持与穷举搜索相当的准确性。在VGG-11、ResNet-18和EfficientNetLite等最先进的深度神经网络基准测试中,HAWX的效率收益随着网络规模呈指数级增长。HAWX面向硬件的搜索算法支持空间和时间加速器架构,利用现成的近似组件或定制化设计。

英文摘要:

This work presents HAWX, a hardware-aware scalable exploration framework that employs multi-level sensitivity scoring at different DNN abstraction levels (operator, filter, layer, and model) to guide selective integration of heterogeneous AxC blocks. Supported by predictive models for accuracy, power, and area, HAWX accelerates the evaluation of candidate configurations, achieving over 23* speedup in a layer-level search with two candidate approximate blocks and more than (3*106)* speedup at the filter-level search only for LeNet-5, while maintaining accuracy comparable to exhaustive search. Experiments across state-of-the-art DNN benchmarks such as VGG-11, ResNet-18, and EfficientNetLite demonstrate that the efficiency benefits of HAWX scale exponentially with network size. The HAWX hardware-aware search algorithm supports both spatial and temporal accelerator architectures, leveraging either off-the-shelf approximate components or customized designs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑