arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 1801.07548cs.DCastro-ph.IM
收藏

天文计算的混合体系结构

A hybrid architecture for astronomical computing

Changhua Li, Chenzhou Cui, Boliang He, Dongwei Fan, Linying Mi, Shanshan Li, Sisi Yang, Yunfei Xu, Jun Han, Junyi Chen, Hailong Zhang, Ce Yu, Jian Xiao, Chuanju… 展开作者

Changhua Li, Chenzhou Cui, Boliang He, Dongwei Fan, Linying Mi, Shanshan Li, Sisi Yang, Yunfei Xu, Jun Han, Junyi Chen, Hailong Zhang, Ce Yu, Jian Xiao, Chuanjun Wang, Zihuang Cao, Yufeng Fan, Liang Liu, Xiao Chen, Wenming Song, Kangyu Du

摘要:

随着一批大型科学仪器的建设和投入使用,天文学已经进入了大数据时代。大数据处理的新方法和基础设施已经成为许多天文学家的新需求。云计算、Map/Reduce、Hadoop、Spark等许多新技术近年来如雨后春笋般涌现。相对于高性能计算(HPC),数据是这些新技术的核心。因此,一个新的计算架构基础设施是必要的,它可以由HPC和大数据处理共享。本文以中国虚拟天文台天文云项目为背景,对混合计算平台进行了优化设计。其中包括硬件体系结构、集群管理、作业和资源调度。

英文摘要:

With many large science equipment constructing and putting into use, astronomy has stepped into the big data era. The new method and infrastructure of big data processing has become a new requirement of many astronomers. Cloud computing, Map/Reduce, Hadoop, Spark, etc. many new technology has sprung up in recent years. Comparing to the high performance computing(HPC), Data is the center of these new technology. So, a new computing architecture infrastructure is necessary, which can be shared by both HPC and big data processing. Based on Astronomy Cloud project of Chinese Virtual Observatory (China-VO), we have made much efforts to optimize the designation of the hybrid computing platform. which include the hardware architecture, cluster management, Job and Resource scheduling.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑