arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1406.5977cs.DC
收藏

Floe:一个面向动态云应用的连续数据流框架

Floe: A Continuous Dataflow Framework for Dynamic Cloud Applications

Yogesh Simmhan, Alok Kumbhare

摘要:

信息物理系统中的应用越来越多地与在线仪器相结合,以执行长时间运行的连续数据处理。这种“永远在线”的Linux应用程序是动态的,它们需要在运行时更改应用程序逻辑和性能,以响应外部操作需求。Floe是一个持续的可扩展框架,旨在适应云基础设施上的动态应用程序。它提供了先进的可重构模式,如BSP和MapReduce,用于流和文件的灵活和整体组合,并支持在运行时动态重组,对执行的影响最小。自适应资源分配策略允许我们的框架有效地使用弹性云资源,以满足不同的数据率。我们通过在私有Eucalyptus Cloud上运行来自Smart Power Grid域的集成管道和推文集群应用程序来说明Floe的设计模式。通过对周期性、突发性和随机工作负载的模拟,验证了我们的资源自适应的响应能力。

英文摘要:

Applications in cyber-physical systems are increasingly coupled with online instruments to perform long running, continuous data processing. Such "always on" dataflow applications are dynamic, where they need to change the applications logic and performance at runtime, in response to external operational needs. Floe is a continuous dataflow framework that is designed to be adaptive for dynamic applications on Cloud infrastructure. It offers advanced dataflow patterns like BSP and MapReduce for flexible and holistic composition of streams and files, and supports dynamic recomposition at runtime with minimal impact on the execution. Adaptive resource allocation strategies allow our framework to effectively use elastic Cloud resources to meet varying data rates. We illustrate the design patterns of Floe by running an integration pipeline and a tweet clustering application from the Smart Power Grids domain on a private Eucalyptus Cloud. The responsiveness of our resource adaptation is validated through simulations for periodic, bursty and random workloads.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑