均衡:大规模多租户CXL内存分层
Equilibria: Fair Multi-Tenant CXL Memory Tiering At Scale
AI总结:
Equilibria通过多租户支持和灵活的公平策略,解决大规模数据中心中CXL内存分层的公平性和性能问题,提升性能达52%。
摘要:
内存是数据中心系统成本和功耗的主要因素。通过计算表达链接(CXL)扩展内存是一种低成本低功耗的方式,但其有效利用需要软件层面的分层支持。现有分层解决方案,包括当前Linux支持,面临生产部署中的根本限制。首先,它们缺乏多租户支持,无法处理堆叠的同质或异质工作负载。其次,有限的控制平面灵活性导致公平性违规和性能波动。最后,不足的可观测性阻止操作员在大规模上诊断性能问题。我们提出了Equilibria,一个操作系统框架,使大规模数据中心中公平、多租户CXL分层成为可能。Equilibria为每个容器提供内存公平份额分配的控制,并提供细粒度的分层内存使用和操作的可观测性。它进一步通过受控提升和降级强制执行灵活的用户指定公平策略,并通过抑制thrashing减轻噪声邻居干扰。在大规模超大规模集群中使用生产工作负载和基准测试评估,Equilibria帮助工作负载满足服务级别目标(SLOs)的同时避免性能干扰。它在生产工作负载上比最先进的Linux解决方案TPP提高了多达52%的性能,在基准测试上提高了1.7倍。所有Equilibria补丁均已发布到Linux社区。
英文摘要:
Memory dominates datacenter system cost and power. Memory expansion via Compute Express Link (CXL) is an effective way to provide additional memory at lower cost and power, but its effective use requires software-level tiering for hyperscaler workloads. Existing tiering solutions, including current Linux support, face fundamental limitations in production deployments. First, they lack multi-tenancy support, failing to handle stacked homogeneous or heterogeneous workloads. Second, limited control-plane flexibility leads to fairness violations and performance variability. Finally, insufficient observability prevents operators from diagnosing performance pathologies at scale. We present Equilibria, an OS framework enabling fair, multi-tenant CXL tiering at datacenter scale. Equilibria provides per-container controls for memory fair-share allocation and fine-grained observability of tiered-memory usage and operations. It further enforces flexible, user-specified fairness policies through regulated promotion and demotion, and mitigates noisy-neighbor interference by suppressing thrashing. Evaluated in a large hyperscaler fleet using production workloads and benchmarks, Equilibria helps workloads meet service level objectives (SLOs) while avoiding performance interference. It improves performance over the state-of-the-art Linux solution, TPP, by up to 52% for production workloads and 1.7x for benchmarks. All Equilibria patches have been released to the Linux community.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。