arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.00271astro-ph.COastro-ph.IMcs.LG
收藏

GalaxiesML:一个用于机器学习的星系图像、测光、红移和结构参数数据集

GalaxiesML: a dataset of galaxy images, photometry, redshifts, and structural parameters for machine learning

Southern Oregon University(南俄勒冈大学)

Tuan Do, Bernie Boscoe, Evan Jones, Yun Qi Li, Kevin Alfaro

AI总结:

GalaxiesML 公开了一个包含 286,401 张星系图像及多波段测光、光谱红移和结构参数的机器学习数据集,并证明图像比仅用测光数据能更准确地估计红移,为 Euclid 和 LSST 等下一代巡天方法开发提供支持。

摘要:

我们提出了一个为机器学习应用构建的数据集,包含星系测光、图像、光谱红移和结构性质。该数据集包含来自 Hyper Suprime-Cam Survey PDR2 的 286,401 张星系图像和五个成像滤光片(g、r、i、z、y)的测光数据,并以光谱确认的红移作为真实标签。这样的数据集对机器学习应用非常重要,因为它均匀、一致且异常值极少,但仍包含符合实际的信噪比范围。我们公开该数据集,以帮助推动面向下一代巡天(如 Euclid 和 LSST)的机器学习方法发展。GalaxiesML 的目标是提供一个稳健的数据集,不仅可用于天体物理学,也可用于机器学习;在机器学习场景中,图像性质无法由人眼验证,而是由物理定律支配。我们描述了从公开档案中整合数据集所面临的挑战,包括异常值剔除、重复数据、建立真实标签以及样本选择。这是同类数据集中规模最大的公开机器学习就绪训练集之一,红移范围从 0.01 到 4。该样本的红移分布在红移 1.5 处达到峰值,并在红移超过 2.5 后迅速下降。我们还给出了该数据集在红移估计中的一个示例应用,证明使用图像进行红移估计比仅使用测光数据能产生更准确的结果。例如,在红移 0.1 到 1.25 之间,使用图像时的红移估计偏差比仅使用测光数据低 10 倍。来自此类数据集的结果将帮助我们了解如何最好地利用下一代星系巡天的数据。

英文摘要:

We present a dataset built for machine learning applications consisting of galaxy photometry, images, spectroscopic redshifts, and structural properties. This dataset comprises 286,401 galaxy images and photometry from the Hyper-Suprime-Cam Survey PDR2 in five imaging filters ($g,r,i,z,y$) with spectroscopically confirmed redshifts as ground truth. Such a dataset is important for machine learning applications because it is uniform, consistent, and has minimal outliers but still contains a realistic range of signal-to-noise ratios. We make this dataset public to help spur development of machine learning methods for the next generation of surveys such as Euclid and LSST. The aim of GalaxiesML is to provide a robust dataset that can be used not only for astrophysics but also for machine learning, where image properties cannot be validated by the human eye and are instead governed by physical laws. We describe the challenges associated with putting together a dataset from publicly available archives, including outlier rejection, duplication, establishing ground truths, and sample selection. This is one of the largest public machine learning-ready training sets of its kind with redshifts ranging from 0.01 to 4. The redshift distribution of this sample peaks at redshift of 1.5 and falls off rapidly beyond redshift 2.5. We also include an example application of this dataset for redshift estimation, demonstrating that using images for redshift estimation produces more accurate results compared to using photometry alone. For example, the bias in redshift estimate is a factor of 10 lower when using images between redshift of 0.1 to 1.25 compared to photometry alone. Results from dataset such as this will help inform us on how to best make use of data from the next generation of galaxy surveys.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑