LMB:利用CXL链接的内存缓冲区增强PCIe设备
LMB: Augmenting PCIe Devices with CXL-Linked Memory Buffer
AI总结:
本文提出LMB,一种利用CXL内存扩展器解决PCIe设备板载DRAM短缺的可扩展方案,通过低延迟CXL补充设备内存且对性能影响极小。
摘要:
PCIe设备(如SSD和GPU)在现代数据中心中至关重要,且在AI和大模型兴起的背景下其价值将进一步提升。然而,由于内部空间限制,这些设备面临板载DRAM短缺问题,无法在闪存或GPU处理芯片旁容纳足够的DRAM模块。现有解决方案要么限制设备内部内存使用,要么补充较慢的非DRAM介质,被证明是不充分的或损害性能的。本文提出了链接内存缓冲区(LMB),这是一种可扩展的解决方案,利用CXL内存扩展器来解决设备板载内存不足的问题。CXL的低延迟特性使LMB能够利用新兴的DRAM内存扩展器,以对性能的最小影响高效地补充设备板载DRAM。
英文摘要:
PCIe devices, such as SSDs and GPUs, are pivotal in modern data centers, and their value is set to grow amidst the emergence of AI and large models. However, these devices face onboard DRAM shortage issue due to internal space limitation, preventing accommodation of sufficient DRAM modules alongside flash or GPU processing chips. Current solutions either curb device-internal memory usage or supplement slower non-DRAM mediums, prove inadequate or performance-compromising. This paper introduces the Linked Memory Buffer (LMB), a scalable solution utilizing the CXL memory expander to tackle device onboard memory deficiencies. The low-latency of CXL enables LMB to utilize emerging DRAM memory expander to efficiently supplement device onboard DRAM with minimal impact on performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。