arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 0807.2515astro-phcs.DC
收藏

暗能量测量数据管理系统

The Dark Energy Survey Data Management System

Joseph J. Mohr, Wayne Barkhouse, Cristina Beldica, Emmanuel Bertin, Y. Dora Cai, Luiz da Costa, J. Anthony Darnell, Gregory E. Daues, Michael Jarvis, Michelle G… 展开作者

Joseph J. Mohr, Wayne Barkhouse, Cristina Beldica, Emmanuel Bertin, Y. Dora Cai, Luiz da Costa, J. Anthony Darnell, Gregory E. Daues, Michael Jarvis, Michelle Gower, Huan Lin, leandro Martelli, Eric Neilsen, Chow-Choong Ngeow, Ricardo Ogando, Alex Parga, Erin Sheldon, Douglas Tucker, Nikolay Kuropatkin, Chris Stoughton

摘要:

暗能量调查合作项目将在2011年至2016年的525个夜晚期间在南部天空进行5000度2的griZY调查,研究宇宙加速。DES数据管理系统将用于处理和存档这些数据以及由此产生的科学就绪数据产品。DESDM系统由一个综合档案、一个处理框架、一套天文学代码和一个数据访问框架组成。我们正在开发的DESDM系统的高性能计算(HPC)的环境中运行在NCSA和费米实验室。在HPC环境中操作DESDM系统可提供速度和灵活性。我们将使用它来满足我们定期的夜间处理需求,以及更多的计算密集型任务,如大规模图像共添加活动,从完整的调查数据集中提取弱透镜剪切,以及DES数据的大规模季节性再处理。数据产品将通过一个与虚拟观测站兼容的门户网站提供给协作机制,并随后提供给公众。我们的方法利用了对公开可用HPC系统的投资,大大降低了项目的硬件和维护成本,该项目必须仅部署和维护特定于DESDM的存储、数据库平台以及编排和Web门户节点。在2007年秋季,我们测试了目前的DESDM系统的模拟和真实的调查数据。我们使用Teragrid处理了10个模拟的DES夜晚(3TB的原始数据),将大约2.5亿个对象输入和校准到DES存档数据库中。我们还使用DESDM处理和校准了Mosaic 2相机采集的50多个夜晚的调查数据。与模拟数据的真值表和真实数据的内部交叉表的比较表明,天体测量和光度测量数据的质量是极好的。

英文摘要:

The Dark Energy Survey collaboration will study cosmic acceleration with a 5000 deg2 griZY survey in the southern sky over 525 nights from 2011-2016. The DES data management (DESDM) system will be used to process and archive these data and the resulting science ready data products. The DESDM system consists of an integrated archive, a processing framework, an ensemble of astronomy codes and a data access framework. We are developing the DESDM system for operation in the high performance computing (HPC) environments at NCSA and Fermilab. Operating the DESDM system in an HPC environment offers both speed and flexibility. We will employ it for our regular nightly processing needs, and for more compute-intensive tasks such as large scale image coaddition campaigns, extraction of weak lensing shear from the full survey dataset, and massive seasonal reprocessing of the DES data. Data products will be available to the Collaboration and later to the public through a virtual-observatory compatible web portal. Our approach leverages investments in publicly available HPC systems, greatly reducing hardware and maintenance costs to the project, which must deploy and maintain only the storage, database platforms and orchestration and web portal nodes that are specific to DESDM. In Fall 2007, we tested the current DESDM system on both simulated and real survey data. We used Teragrid to process 10 simulated DES nights (3TB of raw data), ingesting and calibrating approximately 250 million objects into the DES Archive database. We also used DESDM to process and calibrate over 50 nights of survey data acquired with the Mosaic2 camera. Comparison to truth tables in the case of the simulated data and internal crosschecks in the case of the real data indicate that astrometric and photometric data quality is excellent.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑