arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.09007cs.AR
收藏

RED:基于可重构电压摆幅和保留感知调度的eDRAM基PIM能量优化框架

RED: Energy Optimization Framework for eDRAM-based PIM with Reconfigurable Voltage Swing and Retention-aware Scheduling

Jae-Young Kim, Donghyuk Kim, Seungjae Yoo, Sungyeob Yoo, Teokkyu Suh, Joo-Young Kim

AI总结:

本研究针对eDRAM基PIM内存设计被忽视的问题,提出RED框架,通过可重构电压摆幅和保留感知调度优化内存访问能耗,较SRAM基PIM能效提升3.05倍,eDRAM宏能耗降低74.88%。

摘要:

在人工智能(AI)时代,Transformer在各类应用中展现出卓越性能。然而,其海量参数在冯·诺依曼架构中处理时会产生高延迟和能量开销。内存内处理(PIM)通过减少数据移动,在加速数据密集型应用方面显示出潜力。尽管以往研究主要优化PIM的计算部分以提升能效,但作为PIM中功耗占比最大的内存设计的重要性却被忽视。本研究提出RED——一种基于eDRAM的PIM能量优化框架。首先,我们分析了eDRAM中的PIM操作,得到两个关键观察:1)内存访问能耗在PIM中占主导地位;2)读取位线(RBL)电压摆幅、 sense放大器功耗与保留时间存在权衡关系。利用这些观察,我们提出了一种新颖的可重构eDRAM和保留感知调度方法,以最小化eDRAM宏的运行时能耗。该框架通过预先估计所有可能的分块方案和内存操作的能耗来确定最优操作点。然后,可重构eDRAM根据调度在运行时控制RBL电压摆幅,优化内存访问功耗。此外,RED采用刷新跳过和sense放大器电源门控技术,以缓解权衡关系带来的能耗开销。最终,RED框架的能效比现有SRAM基PIM最高提升3.05倍,通过可重构eDRAM和优化方案将eDRAM宏的能耗最高降低74.88%,而调度仅需3.5%的面积和0.77%的能量开销。

英文摘要:

In the era of artificial intelligence (AI), Transformer demonstrates its performance across various applications. The excessive amount of parameters incurs high latency and energy overhead when processed in the von Neumann architecture. Processing-in-memory (PIM) has shown the potential in accelerating data-intensive applications by reducing data movement. While previous works mainly optimize the computational part of PIM to enhance energy efficiency, the importance of memory design, which consumes the most power in PIM, has been rather neglected. In this work, we present RED, an energy optimization framework for eDRAM-based PIM. We first analyze the PIM operations in eDRAM, obtaining two key observations: 1) memory access energy consumption is predominant in PIM, and 2) read bitline (RBL) voltage swing, sense amplifier power, and retention time are in trade-off relations. Leveraging them, we propose a novel reconfigurable eDRAM and retention-aware scheduling that minimizes the runtime energy consumption of the eDRAM macro. The framework pinpoints the optimal operating point by pre-estimating energy consumption across all possible tiling schemes and memory operations. Then, the reconfigurable eDRAM controls the RBL voltage swing at runtime according to the scheduling, optimizing the memory access power. Moreover, RED employs refresh skipping and sense amplifier power gating to mitigate the energy consumption overhead coming from the trade-off relation. Finally, the RED framework achieves up to 3.05x higher energy efficiency than the prior SRAM-based PIM, reducing the energy consumption of eDRAM macro up to 74.88% with reconfigurable eDRAM and optimization schemes, requiring only 3.5% area and 0.77% energy overhead for scheduling.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑