AXLE:计算内存系统中的异步回传协调卸载
AXLE: Coordinated Offloading with Asynchronous Back-Streaming in Computational Memory Systems
AI总结:
针对CXL计算内存系统中不同卸载模型的权衡,提出异步回传协议AXLE,通过协调CXL.io和CXL.mem实现结果回传和异步流水线,显著降低端到端运行时间并减少空闲时间。
摘要:
基于CXL的计算内存(CCM)能够在扩展的远程内存内实现近内存处理,为解决分解内存系统中的数据移动成本并加速整体性能提供了机会。然而,现有的卸载机制并未充分利用基于不同CXL协议的不同卸载模型的权衡。本文首先研究了这些权衡及其对具有不同数据和计算特征的工作负载的端到端性能和系统效率的影响。我们提出了异步回传(Asynchronous Back-Streaming),一种新的卸载协议,它协调CXL.io和CXL.mem以实现结果回传和跨CCM与主机任务的异步流水线。我们进一步设计了AXLE,一个实现该协议的系统,具有轻量级的主机-CCM交互。总体而言,AXLE将端到端运行时间最多减少50.14%,将CCM和主机的空闲时间平均分别减少14.53倍和3.93倍,并将主机核心停顿时间最多减少6倍。
英文摘要:
CXL-based Computational Memory (CCM) enables near-memory processing within expanded remote memory, offering opportunities to address data movement costs in disaggregated memory systems and to accelerate overall performance. However, existing offloading mechanisms do not fully leverage the trade-offs of different offload models based on different CXL protocols. This work first examines these tradeoffs and their impact on end-to-end performance and system efficiency for workloads with diverse data and computation characteristics. We propose Asynchronous Back-Streaming, a new offloading protocol that coordinates CXL.io and CXL.mem to enable result back-streaming and asynchronous pipelining across CCM and host tasks. We further design AXLE, a system that realizes this protocol with lightweight host-CCM interaction. Overall, AXLE reduces end-to-end runtime by up to 50.14%, reduces CCM and host idle times by an average of 14.53x and 3.93x, respectively, and achieves up to 6x reduction in host core stall time.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。