arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.12847cs.AR
收藏

DPUConfig: 使用强化学习优化FPGA上的机器学习推理

DPUConfig: Optimizing ML Inference in FPGAs Using Reinforcement Learning

University of Thessaly(色萨利大学)

Alexandros Patras, Spyros Lalis, Christos D. Antonopoulos, Nikolaos Bellas

AI总结:

DPUConfig通过强化学习动态优化FPGA上的机器学习推理配置,提升能效和性能。

摘要:

异构嵌入式系统,具有各种计算元件和加速器(如FPGA),为快速灵活的机器学习推理提供了有前景的平台,这对于自动驾驶和增强现实等服务至关重要,其中延迟可能代价高昂。然而,在基于FPGA的系统中为深度学习应用高效分配计算资源是一项具有挑战性的任务。深度学习处理器单元(DPU)是一种参数化的FPGA加速模块,优化于机器学习推理。它支持广泛的机器学习模型,并可以在单个FPGA中多次实例化以实现并发执行。本文介绍了一种新的运行时管理框架DPUConfig,基于定制的强化学习(RL)代理,通过利用实时遥测数据监控、系统利用率、能耗和应用性能来指导其配置选择决策,动态选择最佳的DPU配置。实验评估表明,RL代理在Xilinx Zynq UltraScale+ MPSoC ZCU102上几种CNN模型的最优可实现能耗效率方面平均达到95%的能效。

英文摘要:

Heterogeneous embedded systems, with diverse computing elements and accelerators such as FPGAs, offer a promising platform for fast and flexible ML inference, which is crucial for services such as autonomous driving and augmented reality, where delays can be costly. However, efficiently allocating computational resources for deep learning applications in FPGA-based systems is a challenging task. A Deep Learning Processor Unit (DPU) is a parameterizable FPGA-based accelerator module optimized for ML inference. It supports a wide range of ML models and can be instantiated multiple times within a single FPGA to enable concurrent execution. This paper introduces DPUConfig, a novel runtime management framework, based on a custom Reinforcement Learning (RL) agent, that dynamically selects optimal DPU configurations by leveraging real-time telemetry data monitoring, system utilization, power consumption, and application performance to inform its configuration selection decisions. The experimental evaluation demonstrates that the RL agent achieves energy efficiency 95% (on average) of the optimal attainable energy efficiency for several CNN models on the Xilinx Zynq UltraScale+ MPSoC ZCU102.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑