arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1812.01477astro-ph.IMcs.DC
收藏

JOVIAL:基于笔记本的云中天文数据分析

JOVIAL: Notebook-based Astronomical Data Analysis in the Cloud

Mauricio Araya, Maximiliano Osorio, Matías Díaz, Carlos Ponce, Martín Villanueva, Camilo Valenzuela, Mauricio Solar

摘要:

对于现在产生的非常大的数据集,仅使用个人计算机进行天文数据分析变得不切实际。由于分析不是一项可以完全自动化的任务,因此将处理转移到数据所在地的想法也意味着将整个科学过程转移到档案馆和数据中心。使用Moneyter Notebooks作为远程服务是数据分析的最新趋势,旨在解决这个问题,但利用基础设施为天文学家服务而不增加服务的复杂性是一个挑战。在本文中,我们提出的架构和功能的JOVIAL,云服务,天文学家可以安全地使用在高可用性原则下的高性能处理设计的个人空间的笔记本电脑。我们表明,仅存在于特定软件包中的功能可以适应在笔记本电脑中运行,算法可以适应在数据中心运行,而不必重新设计它们。

英文摘要:

Performing astronomical data analysis using only personal computers is becoming impractical for the very large data sets produced nowadays. As analysis is not a task that can be automatized to its full extent, the idea of moving processing where the data is located means also moving the whole scientific process towards the archives and data centers. Using Jupyter Notebooks as a remote service is a recent trend in data analysis that aims to deal with this problem, but harnessing the infrastructure to serve the astronomer without increasing the complexity of the service is a challenge. In this paper we present the architecture and features of JOVIAL, a Cloud service where astronomers can safely use Jupyter notebooks over a personal space designed for high-performance processing under the high-availability principle. We show that features existing only in specific packages can be adapted to run in the notebooks, and that algorithms can be adapted to run across the data center without necessarily redesigning them.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑