arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2307.12796cs.DCcs.NI
收藏

KheOps:边缘到云实验的高性价比可重复性、可复现性与可复制性

KheOps: Cost-effective Repeatability, Reproducibility, and Replicability of Edge-to-Cloud Experiments

Daniel Rosendo, Kate Keahey, Alexandru Costan, Matthieu Simonin, Patrick Valduriez, Gabriel Antoniu

AI总结:

本文提出 KheOps 协作环境,通过实验仓库、notebook 环境和多平台方法,支持 Edge-to-Cloud 实验低成本地重复、复现与跨基础设施复制。

摘要:

用于计算和分析的分布式基础设施如今正演进为一个互联生态系统,使复杂科学工作流能够在从 IoT Edge 设备到 Cloud、有时还包括超级计算机的混合系统(即 Computing Continuum,计算连续体)上执行。理解部署在如此复杂的 Edge-to-Cloud Continuum 上的大规模工作流的性能权衡颇具挑战性。为实现这一点,人们需要系统性地开展实验,使其具备可复现性,并允许其他研究人员在不同基础设施上复制该研究及所得结论。这可归结为一个繁琐过程:协调众多实验需求和约束与低层基础设施设计选择。为解决 Google Colab、Kaggle 和 Code Ocean 等分布式协作实验主流先进方法的局限,我们提出 KheOps,这是一个专门设计用于以高性价比实现 Edge-to-Cloud 实验可复现性和可复制性的协作环境。KheOps 由三个核心要素组成:(1)实验仓库;(2)notebook 环境;(3)多平台实验方法。我们通过一个真实 Edge-to-Cloud 应用展示 KheOps。评估同时考察论文中所述实验作者(目标是使其实验可复现)的视角及其读者(目标是复制实验)的视角。结果表明,KheOps 如何帮助作者在 Grid5000 + FIT IoT LAB 测试床上系统性地执行可重复且可复现的实验。此外,KheOps 帮助读者在 Chameleon Cloud + CHI@Edge 测试床等不同基础设施上高性价比地复制作者实验,并以高准确率获得相同结论(所有性能指标均 >88%)。

英文摘要:

Distributed infrastructures for computation and analytics are now evolving towards an interconnected ecosystem allowing complex scientific workflows to be executed across hybrid systems spanning from IoT Edge devices to Clouds, and sometimes to supercomputers (the Computing Continuum). Understanding the performance trade-offs of large-scale workflows deployed on such complex Edge-to-Cloud Continuum is challenging. To achieve this, one needs to systematically perform experiments, to enable their reproducibility and allow other researchers to replicate the study and the obtained conclusions on different infrastructures. This breaks down to the tedious process of reconciling the numerous experimental requirements and constraints with low-level infrastructure design choices.To address the limitations of the main state-of-the-art approaches for distributed, collaborative experimentation, such as Google Colab, Kaggle, and Code Ocean, we propose KheOps, a collaborative environment specifically designed to enable cost-effective reproducibility and replicability of Edge-to-Cloud experiments. KheOps is composed of three core elements: (1) an experiment repository; (2) a notebook environment; and (3) a multi-platform experiment methodology.We illustrate KheOps with a real-life Edge-to-Cloud application. The evaluations explore the point of view of the authors of an experiment described in an article (who aim to make their experiments reproducible) and the perspective of their readers (who aim to replicate the experiment). The results show how KheOps helps authors to systematically perform repeatable and reproducible experiments on the Grid5000 + FIT IoT LAB testbeds. Furthermore, KheOps helps readers to cost-effectively replicate authors experiments in different infrastructures such as Chameleon Cloud + CHI@Edge testbeds, and obtain the same conclusions with high accuracies (> 88% for all performance metrics).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑