用对比学习法“在野外”学习射电天文学的有用表示
Learning useful representations for radio astronomy "in the wild" with contrastive learning
摘要:
未标记的天体物理训练数据中的未知类分布先前已被证明会由于训练集和验证集之间的数据集偏移而对模型性能产生负面影响。对于射电星系分类,我们在这项工作中证明,在训练之前从未标记的数据中去除低角范围源,会为对比模型产生质的不同的训练动态。通过将该模型应用于具有未知类平衡和子种群分布的未标记数据集以生成射电星系的表示空间,我们表明,通过适当的切割阈值,我们可以找到FRI/FRII类分离的表示,该表示接近明确训练将射电星系分离为这两个类的监督基线。此外,我们表明,一个过于保守的切割阈值块验证精度的任何增加。然后,我们将学习到的表示用于对罕见混合源执行相似性搜索的下游任务,发现对比模型可以可靠地返回语义相似的样本,并在预处理后找到重复的额外奖励。
英文摘要:
Unknown class distributions in unlabelled astrophysical training data have previously been shown to detrimentally affect model performance due to dataset shift between training and validation sets. For radio galaxy classification, we demonstrate in this work that removing low angular extent sources from the unlabelled data before training produces qualitatively different training dynamics for a contrastive model. By applying the model on an unlabelled data-set with unknown class balance and sub-population distribution to generate a representation space of radio galaxies, we show that with an appropriate cut threshold we can find a representation with FRI/FRII class separation approaching that of a supervised baseline explicitly trained to separate radio galaxies into these two classes. Furthermore we show that an excessively conservative cut threshold blocks any increase in validation accuracy. We then use the learned representation for the downstream task of performing a similarity search on rare hybrid sources, finding that the contrastive model can reliably return semantically similar samples, with the added bonus of finding duplicates which remain after pre-processing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。