射电干涉测量数据压缩选项：MHONGOOSE巡天中可见度的有损压缩与uv可见度网格的无损压缩
Options for Compression of radio interferometry data: lossy compression of visibilities and lossless compression of uv-visibility grids for the MHONGOOSE survey
浏览论文内容
中文总结 AI 辅助
本文针对射电望远镜数据存储问题，测试了网格叠加无损压缩和可见度有损压缩两种方法，在MHONGOOSE巡天数据上验证了其高保真度，为数据压缩提供了可行方案。
中文摘要 AI 辅助
下一代射电天文望远镜正在挑战现有的数据处理范式。随着天线数量的增加、带宽的扩大以及有时多个主波束的使用，它们产生的观测数据产品往往超过长期存储的容量。因此，数据存储成为主要的成本驱动因素和处理约束。在本文中，我们测试了解决这一问题的两种方法：网格叠加，一种两阶段无损压缩解决方案；以及在传统处理之前对原始可见度进行有损压缩。为了演示这些解决方案，我们使用了基于ASKAP望远镜软件ASKAPSoft的深度成像流水线，但应用于来自深场MeerKAT HI谱线项目MHONGOOSE的强源（NGC1566）。网格叠加解决方案重现了传统处理的频谱，误差优于0.7%，并且还允许在无需显著计算成本的情况下重建其他加权尺度。相比之下，图像叠加也能重现传统处理的频谱，误差优于3%，但在数据立方体中的图像残差较差。有损压缩，即使文件大小减少近十倍，也能几乎完美地重现频谱（在所有情况下误差优于约0.01%）。因此，两种压缩方法都是有前景的解决方案，我们讨论了它们应用中的考虑因素。
英文摘要
Next generation radio astronomy telescopes are challenging existing data reduction paradigms. With ever more antennas, larger bandwidths, and sometimes multiple primary beams, they often generate more observed data products than can readily be stored long-term. Thus, data storage becomes a major cost driver and processing constraint. In this paper, we test two methods of addressing this problem: grid-stacking, a two-stage lossless compression solution; and the lossy compression of the raw visibilities before traditional processing. To demonstrate these solutions we utilised a deep imaging pipeline based on software for the ASKAP telescope, ASKAPSoft, but applied to a strong source (NGC1566) from the deep MeerKAT HI spectral line project, MHONGOOSE. The grid-stacking solution reproduces the spectrum from traditional processing to within better than 0.7%, and also allows for the reconstruction of other weighting scales without significant computing costs. In comparison, image-stacking also reproduces the spectrum from the traditional processing, to within better than 3% but with worse image residuals in the cube. The lossy compression, even at a near ten-fold reduction in file size, reproduces the spectra almost perfectly (to better than ~0.01% in all cases). Thus both compression methods are promising solutions, and we discuss considerations for their application.
发表机构
- International Centre for Radio Astronomy Research (ICRAR), University of Western Australia（西澳大利亚大学国际射电天文研究中心）
- Australia Telescope National Facility, CSIRO Space & Astronomy（CSIRO空间与天文局澳大利亚望远镜国家设施）
- Netherlands Institute for Radio Astronomy (ASTRON)（荷兰射电天文研究所）
- Dept. of Astronomy, Univ. of Cape Town（开普敦大学天文学系）
- Kapteyn Astronomical Institute, University of Groningen（格罗宁根大学卡普坦天文研究所）
- Australian SKA Regional Centre (AusSRC), University of Western Australia（西澳大利亚大学澳大利亚SKA区域中心）
机构由 AI 辅助整理，请以论文原文为准。
