COSTREAM: 边缘云环境中算子放置的学习成本模型
COSTREAM: Learned Cost Models for Operator Placement in Edge-Cloud Environments
AI总结:
该研究提出COSTREAM这一新型学习成本模型,用于分布式流处理系统中边缘云环境的算子放置,能准确预测执行成本并泛化到未知场景,优化后算子放置较基线实现约21倍中位数加速。
摘要:
在这项工作中,我们提出COSTREAM,一种用于分布式流处理系统的新型学习成本模型,可准确预测边缘云环境中流查询的执行成本。该成本模型可用于在异构硬件上找到算子的初始放置,这在这些环境中尤为重要。在评估中,我们证明COSTREAM可为初始算子放置生成高度准确的成本估计,甚至能泛化到未见过的放置、查询和硬件。使用COSTREAM优化流算子放置时,与基线相比可实现约21倍的中位数加速。
英文摘要:
In this work, we present COSTREAM, a novel learned cost model for Distributed Stream Processing Systems that provides accurate predictions of the execution costs of a streaming query in an edge-cloud environment. The cost model can be used to find an initial placement of operators across heterogeneous hardware, which is particularly important in these environments. In our evaluation, we demonstrate that COSTREAM can produce highly accurate cost estimates for the initial operator placement and even generalize to unseen placements, queries, and hardware. When using COSTREAM to optimize the placements of streaming operators, a median speed-up of around 21x can be achieved compared to baselines.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。