用天文学开创Exascale时代
Pioneering the Exascale era with Astronomy
摘要:
SURF是荷兰教育和研究的协作ICT组织,并协调国家电子基础设施(surf.nl)。为了加速科学发现,SURF为荷兰的研究人员投资、运营和探索高端IT解决方案。在这篇ADASS 2019投稿中,我们介绍了我们在高性能和高吞吐量云计算方面的最新进展。这些发展与天文学特别相关,因为这一科学领域:(i)生成大型(PB大小)数据集,(ii)使用快速发布和部署软件计划,(iii)需要灵活和交互式的测试和分级环境,(iv)需要在不同的数据结构上执行复杂的工作流程。我们强调了我们新的基于OpenStack的云基础架构层,并重点介绍了Spider,这是我们为SURF的高吞吐量数据处理平台新增的功能。
英文摘要:
SURF is the collaborative ICT organisation for Dutch education & research and coordinates the national e-infrastructure (surf.nl). To accelerate scientific discovery, SURF invests in, operates and explores high-end IT solutions for and with researchers in the Netherlands. In this ADASS 2019 contribution we present our latest developments in high performance and high throughput cloud computing. These developments are particularly relevant for Astronomy, as this science domain: (i) generates large (Petabyte sized) data collections, (ii) uses rapid release and deployment schemes for their software, (iii) requires flexible and interactive test and staging environments and (iv) needs to execute complex workflows on diverse data structures. We highlight our new OpenStack-based, cloud infrastructure layer and focus on Spider, our new addition to SURF's high throughput data processing platforms.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。