arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0706.3546cs.DC
收藏

stdchk:一个桌面网格计算的检查点存储系统

stdchk: A Checkpoint Storage System for Desktop Grid Computing

Samer Al Kiswany, Matei Ripeanu, Sudharshan S. Vazhkudai, Abdullah Gharaibeh

摘要:

检查点是一种不可或缺的技术,可以为长时间运行的高吞吐量应用程序(如在桌面网格上运行的应用程序)提供容错。本文认为,一个专用的检查点存储系统,优化运行在这些环境中,可以提供多个好处:减少传统的文件系统上的负载,通过专业化提供高性能,最后,优化数据管理,考虑到检查点应用程序语义。这样的存储系统可以呈现对检查点操作的统一抽象,同时隐藏没有专用资源来存储检查点数据的事实。我们原型stdchk,一个检查点存储系统,使用从参与桌面清理的磁盘空间来构建一个低成本的存储系统,提供一个传统的文件系统接口,便于与应用程序集成。本文介绍了stdchk的体系结构、关键性能优化、对增量检查点的支持以及提高的数据可用性。我们的评估证实,stdchk的方法是可行的,在桌面网格设置,并提供了一个低成本的存储系统与理想的性能特点:高写吞吐量和减少存储空间和网络的努力,以节省检查点图像。

英文摘要:

Checkpointing is an indispensable technique to provide fault tolerance for long-running high-throughput applications like those running on desktop grids. This paper argues that a dedicated checkpoint storage system, optimized to operate in these environments, can offer multiple benefits: reduce the load on a traditional file system, offer high-performance through specialization, and, finally, optimize data management by taking into account checkpoint application semantics. Such a storage system can present a unifying abstraction to checkpoint operations, while hiding the fact that there are no dedicated resources to store the checkpoint data. We prototype stdchk, a checkpoint storage system that uses scavenged disk space from participating desktops to build a low-cost storage system, offering a traditional file system interface for easy integration with applications. This paper presents the stdchk architecture, key performance optimizations, support for incremental checkpointing, and increased data availability. Our evaluation confirms that the stdchk approach is viable in a desktop grid setting and offers a low cost storage system with desirable performance characteristics: high write throughput and reduced storage space and network effort to save checkpoint images.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑