StashCache:开放科学网格的分布式缓存联盟
StashCache: A Distributed Caching Federation for the Open Science Grid
摘要:
机会主义用户的数据分发具有挑战性,因为他们既不拥有正在使用的计算资源,也不拥有附近的任何存储。用户有动力使用机会计算来扩展其数据处理能力,但他们需要存储和快速网络来将数据分发给该处理。由于它需要大量的管理开销,因此资源提供者很少允许对存储进行机会性访问。此外,为了在多个分布式站点上使用机会存储,用户需要承担维护其数据的责任。在本文中,我们提出了StashCache,分布式缓存联邦,使机会主义用户利用附近的机会主义存储。StashCache由四个组件组成:数据源、重定向器、缓存和客户端。StashCache已经在开放科学网格中部署了几年,并已被许多项目使用。缓存部署在美国和欧洲的地理分布位置。我们将介绍StashCache的架构,以及基础设施的利用率信息。我们还将比较分布式HTTP代理与StashCache的性能分析。
英文摘要:
Data distribution for opportunistic users is challenging as they neither own the computing resources they are using or any nearby storage. Users are motivated to use opportunistic computing to expand their data processing capacity, but they require storage and fast networking to distribute data to that processing. Since it requires significant management overhead, it is rare for resource providers to allow opportunistic access to storage. Additionally, in order to use opportunistic storage at several distributed sites, users assume the responsibility to maintain their data. In this paper we present StashCache, a distributed caching federation that enables opportunistic users to utilize nearby opportunistic storage. StashCache is comprised of four components: data origins, redirectors, caches, and clients. StashCache has been deployed in the Open Science Grid for several years and has been used by many projects. Caches are deployed in geographically distributed locations across the U.S. and Europe. We will present the architecture of StashCache, as well as utilization information of the infrastructure. We will also present performance analysis comparing distributed HTTP Proxies vs StashCache.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。