arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.10483cs.DC
收藏

InfiniCache:利用短暂的无服务器函数构建经济高效的内存缓存

InfiniCache: Exploiting Ephemeral Serverless Functions to Build a Cost-Effective Memory Cache

Ao Wang, Jingyuan Zhang, Xiaolong Ma, Ali Anwar, Lukas Rupprecht, Dimitrios Skourtis, Vasily Tarasov, Feng Yan, Yue Cheng

摘要:

互联网规模的Web应用程序变得越来越存储密集型,并且严重依赖内存中的对象缓存来获得所需的I/O性能。我们认为,新兴的无服务器计算范式提供了一个非常适合的,具有成本效益的平台对象缓存。我们提出了InfiniCache,这是一个首个内存中对象缓存系统,完全构建和部署在短暂的无服务器功能之上。InfiniCache利用和编排无服务器函数的内存资源,以启用弹性按使用付费缓存。InfiniCache的设计结合了擦除编码、智能计费持续时间控制和高效的数据备份机制,可最大限度地提高数据可用性和成本效益,同时平衡丢失缓存状态和性能的风险。我们在AWS Lambda上实现了InfiniCache,并表明它:(1)与AWS ElastiCache相比,在仅大型对象的生产工作负载中实现了31 - 96倍的租户端成本节约,(2)可以有效地为每个一小时的窗口提供95.4%的数据可用性,(3)实现了典型内存缓存中的比较性能。

英文摘要:

Internet-scale web applications are becoming increasingly storage-intensive and rely heavily on in-memory object caching to attain required I/O performance. We argue that the emerging serverless computing paradigm provides a well-suited, cost-effective platform for object caching. We present InfiniCache, a first-of-its-kind in-memory object caching system that is completely built and deployed atop ephemeral serverless functions. InfiniCache exploits and orchestrates serverless functions' memory resources to enable elastic pay-per-use caching. InfiniCache's design combines erasure coding, intelligent billed duration control, and an efficient data backup mechanism to maximize data availability and cost-effectiveness while balancing the risk of losing cached state and performance. We implement InfiniCache on AWS Lambda and show that it: (1) achieves 31 -- 96X tenant-side cost savings compared to AWS ElastiCache for a large-object-only production workload, (2) can effectively provide 95.4% data availability for each one hour window, and (3) enables comparative performance seen in a typical in-memory cache.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑