arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.13327cs.DCcs.OS
收藏

面向云计算的灵活交换

Flexible Swapping for the Cloud

Milan Pandurov, Lukas Humbel, Dmitry Sepp, Adamos Ttofari, Leon Thomm, Do Le Quoc, Siddharth Chandrasekaran, Sharan Santhanam, Chuan Ye, Shai Bergman, Wei Wang,… 展开作者

Milan Pandurov, Lukas Humbel, Dmitry Sepp, Adamos Ttofari, Leon Thomm, Do Le Quoc, Siddharth Chandrasekaran, Sharan Santhanam, Chuan Ye, Shai Bergman, Wei Wang, Sven Lundgren, Konstantinos Sagonas, Alberto Ros

AI总结:

本文提出一个面向云数据中心虚拟机的用户空间内存管理框架,通过灵活交换策略实现内存超分配,在微基准和云负载下性能较Linux基线提升最高25%,并额外节省10%内存。

摘要:

内存已成为云数据中心的主要成本驱动因素。然而,公有云中分配给虚拟机的内存中有很大一部分仍然未被使用。为了优化这一资源,可以从虚拟机回收“冷”内存,并将其存储在较慢的存储设备上或进行压缩,从而实现内存超分配。当前的内存超分配系统依赖于通用操作系统交换机制,这些机制并未针对虚拟化工作负载进行优化,导致错失内存节省机会,并且无法有效利用预取器等优化手段。本文介绍了一个面向虚拟机的用户空间内存管理框架。该框架通过简单的用户空间API,支持自定义策略,使这些策略能够完全控制虚拟机的内存;支持基于大页面的交换以满足虚拟机性能要求;利用Linux/KVM易于部署;并支持共享虚拟机内存的零拷贝I/O虚拟化。我们的评估表明,基于该框架的内存超分配系统在微基准测试和常见云工作负载上均优于现有最先进的解决方案。具体而言,我们的实现比Linux内核基线实现性能提升最高达25%,同时节省了相似数量的内存。我们还通过实现特定于工作负载的回收器和预取器,展示了自定义策略的优势,这些策略额外节省了10%的内存,在内存受限场景下性能比Linux基线提升30%,并且从硬限制释放中恢复得更快。

英文摘要:

Memory has become the primary cost driver in cloud data centers. Yet, a significant portion of memory allocated to VMs in public clouds remains unused. To optimize this resource, "cold" memory can be reclaimed from VMs and stored on slower storage or compressed, enabling memory overcommit. Current overcommit systems rely on general-purpose OS swap mechanisms, which are not optimized for virtualized workloads, leading to missed memory-saving opportunities and ineffective use of optimizations like prefetchers. This paper introduces a userspace memory management framework designed for VMs. It enables custom policies that have full control over the virtual machines' memory using a simple userspace API, supports huge page-based swapping to satisfy VM performance requirements, is easy to deploy by leveraging Linux/KVM, and supports zero-copy I/O virtualization with shared VM memory. Our evaluation demonstrates that an overcommit system based on our framework outperforms the state-of-the-art solutions on both micro-benchmarks and commonly used cloud workloads. Specifically our implementation outperforms the Linux Kernel baseline implementation by up to 25% while saving a similar amount of memory. We also demonstrate the benefits of custom policies by implementing workload-specific reclaimers and prefetchers that save $10\%$ additional memory, improve performance in a limited memory scenario by 30% over the Linux baseline, and recover faster from hard limit releases.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑