NeoMem:面向CXL原生内存分层的软硬件协同设计
NeoMem: Hardware/Software Co-Design for CXL-Native Memory Tiering
AI总结:
针对现有CXL异构内存分层技术受限于低分辨率高开销访问剖析的问题,提出软硬件协同的NeoMem方案,通过设备端NeoProf硬件单元实现高效访问监控,结合内核改进策略实现热页准确提升,较现有方案几何平均加速比达32%-67%。
摘要:
Compute Express Link(CXL,计算快速链路)互连技术凭借其字节可寻址的SerDes链路,使得将多种类型的内存集成到服务器中成为可能。考虑到不同内存的访问延迟存在差异,要充分发挥基于CXL的异构内存系统的全部潜力,需要高效的内存分层机制。然而,现有研究受限于低分辨率、高开销的内存访问剖析技术,难以取得根本性进展。为解决这一关键挑战,我们提出了一种名为NeoMem的新型内存分层方案,其核心特点是软硬件协同设计。NeoMem将内存剖析功能卸载到CXL设备端控制器中,集成了一个名为NeoProf的专用硬件单元。NeoProf可便捷地监控内存访问,并向操作系统提供关键的页面热度统计数据及其他有用的系统状态信息。在操作系统内核层面,我们设计了改进的内存分层策略,能够基于NeoProf的统计数据实现准确、及时的热页提升。我们在基于FPGA的真实CXL内存平台和Linux内核v6.3上实现了NeoMem。综合评估表明,相较于多种现有内存分层方案,NeoMem的几何平均加速比达到32%至67%。
英文摘要:
The Compute Express Link (CXL) interconnect makes it feasible to integrate diverse types of memory into servers via its byte-addressable SerDes links. Considering the various access latency, harnessing the full potential of CXL-based heterogeneous memory systems requires efficient memory tiering. However, prior work can hardly make a fundamental progress owing to low-resolution and high-overhead memory access profiling techniques. To address this critical challenge, we propose a novel memory tiering solution called NeoMem, which features a hardware/software co-design. NeoMem offloads memory profiling functions to CXL device-side controllers, integrating a dedicated hardware unit called NeoProf. NeoProf readily monitors memory accesses and provides the OS with crucial page hotness statistics and other useful system state information. On the OS kernel side, we design a revamped memory-tiering strategy, enabling accurate and timely hot page promotion based on NeoProf statistics. We implement NeoMem on a real FPGA-based CXL memory platform and Linux kernel v6.3. Comprehensive evaluations demonstrate that NeoMem achieves 32% to 67% geomean speedup over several existing memory tiering solutions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。