arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.03990astro-ph.IM
收藏

天文大数据实时处理系统在HERA中的应用

A Real Time Processing System for Big Data in Astronomy: Applications to HERA

Paul La Plante, Peter K. G. Williams, Matthew Kolopanis, Joshua S. Dillon, Adam P. Beardsley, Nicholas S. Kern, Michael Wilensky, Zaki S. Ali, Zara Abdurashidov… 展开作者

Paul La Plante, Peter K. G. Williams, Matthew Kolopanis, Joshua S. Dillon, Adam P. Beardsley, Nicholas S. Kern, Michael Wilensky, Zaki S. Ali, Zara Abdurashidova, James E. Aguirre, Paul Alexander, Yanga Balfour, Gianni Bernardi, Tashalee S. Billings, Judd D. Bowman, Richard F. Bradley, Phil Bull, Jacob Burba, Steve Carey, Chris L. Carilli, Carina Cheng, David R. DeBoer, Matt Dexter, Eloy de Lera Acedo, John Ely, Aaron Ewall-Wice, Nicolas Fagnoni, Randall Fritz, Steven R. Furlanetto, Kingsley Gale-Sides, Brian Glendenning, Deepthi Gorthi, Bradley Greig, Jaspar Grobbelaar, Ziyaad Halday, Bryna J. Hazelton, Jacqueline N. Hewitt, Jack Hickish, Daniel C. Jacobs, Austin Julius, Joshua Kerrigan, Piyanat Kittiwisit, Saul A. Kohn, Adam Lanman, Telalo Lekalake, David Lewis, Adrian Liu, David MacMahon, Lourence Malan, Cresshim Malgas, Matthys Maree, Zachary E. Martinot, Eunice Matsetela, Andrei Mesinger, Mathakane Molewa, Miguel F. Morales, Tshegofalang Mosiane, Steven Murray, Abraham R. Neben, Bojan Nikolic, Aaron R. Parsons, Robert Pascua, Nipanjana Patra, Samantha Pieterse, Jonathan C. Pober, Nima Razavi-Ghods, Jon Ringuette, James Robnett, Kathryn Rosie, Mario G. Santos, Peter Sims, Craig Smith, Angelo Syce, Nithyanandan Thyagarajan, Haoxuan Zheng

摘要:

随着当前和下一代天文仪器的上线,它们将产生前所未有的海量数据。实时分析这些数据带来了独特的概念和计算挑战,而它们的长期存储和存档对于生成可靠的、可重现的结果至关重要。我们在这里提出的实时处理(RTP)系统的氢时代的再电离阵列(HERA),无线电干涉仪努力提供的第一个检测的高度红移的21厘米信号从宇宙黎明和再电离时代的干涉仪。RTP系统由采集后不久对原始数据运行的分析程序组成,例如射频干扰(RFI)事件的校准和检测。RTP与Librarian密切合作,HERA数据存储和传输管理器自动摄取数据并将副本传输到其他集群进行后处理分析。RTP系统和Librarian都是公共和开源软件,允许修改它们以用于其他科学合作。HERA建成后,预计每晚将产生超过50 TB的数据,RTP系统可以成功地对这些数据进行科学分析。

英文摘要:

As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen Epoch of Reionization Array (HERA), a radio interferometer endeavoring to provide the first detection of the highly redshifted 21 cm signal from Cosmic Dawn and the Epoch of Reionization by an interferometer. The RTP system consists of analysis routines run on raw data shortly after they are acquired, such as calibration and detection of radio-frequency interference (RFI) events. RTP works closely with the Librarian, the HERA data storage and transfer manager which automatically ingests data and transfers copies to other clusters for post-processing analysis. Both the RTP system and the Librarian are public and open source software, which allows for them to be modified for use in other scientific collaborations. When fully constructed, HERA is projected to generate over 50 terabytes (TB) of data each night, and the RTP system enables the successful scientific analysis of these data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑