arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.13138cs.DC
收藏

SCHeMa:在异构机器集群上调度科学容器

SCHeMa: Scheduling Scientific Containers on a Cluster of Heterogeneous Machines

Thanasis Vergoulis, Konstantinos Zagganas, Loukas Kavouras, Martin Reczko, Stelios Sartzetakis, Theodore Dalamagas

摘要:

在数据驱动的科学时代,进行涉及使用异构计算集群分析大型数据集的计算实验是许多科学家日常工作的一部分。此外,为了确保他们的结果的可信度,这些分析很容易被其他研究人员重现是非常重要的。虽然近年来已经引入了各种技术,可以促进科学家在这方面的工作,但仍然缺乏将它们结合起来的开源平台。在这项工作中,我们描述和演示SCheMa,一个开源平台,促进异构集群上的计算分析的执行和再现性,利用容器化,实验包装,工作流管理和机器学习技术。

英文摘要:

In the era of data-driven science, conducting computational experiments that involve analysing large datasets using heterogeneous computational clusters, is part of the everyday routine for many scientists. Moreover, to ensure the credibility of their results, it is very important for these analyses to be easily reproducible by other researchers. Although various technologies, that could facilitate the work of scientists in this direction, have been introduced in the recent years, there is still a lack of open source platforms that combine them to this end. In this work, we describe and demonstrate SCHeMa, an open-source platform that facilitates the execution and reproducibility of computational analysis on heterogeneous clusters, leveraging containerization, experiment packaging, workflow management, and machine learning technologies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑