ASTROMER:基于变换的光变曲线表示嵌入
ASTROMER: A transformer-based embedding for the representation of light curves
摘要:
从自然语言嵌入中获得灵感,我们提出了ASTROMER,一个基于transformer的模型来创建光曲线的表示。ASTROMER以自我监督的方式进行预训练,不需要人工标记的数据。我们使用了数百万个R波段光序列来调整ASTROMER的权重。通过对ASTROMER进行新来源的再培训,可以很容易地将学习到的表示方法适用于其他调查。ASTROMER的强大功能包括使用表示来提取光曲线嵌入,可以增强其他模型的训练,例如分类器或回归器。作为一个例子,我们使用ASTROMER嵌入来训练两个基于神经的分类器,这些分类器使用来自ATLAO、OGLE-III和ATLAS的标记变星。在所有实验中,当有限的标记数据可用时,基于ASTROMER的分类器优于直接在光变曲线上训练的基线递归神经网络。此外,使用ASTROMER嵌入减少了所需的计算资源,同时实现了最先进的结果。最后,我们提供了一个Python库,其中包括本工作中使用的所有功能。该库、主代码和预训练权重可在https://github.com/astromer-science上获得
英文摘要:
Taking inspiration from natural language embeddings, we present ASTROMER, a transformer-based model to create representations of light curves. ASTROMER was pre-trained in a self-supervised manner, requiring no human-labeled data. We used millions of R-band light sequences to adjust the ASTROMER weights. The learned representation can be easily adapted to other surveys by re-training ASTROMER on new sources. The power of ASTROMER consists of using the representation to extract light curve embeddings that can enhance the training of other models, such as classifiers or regressors. As an example, we used ASTROMER embeddings to train two neural-based classifiers that use labeled variable stars from MACHO, OGLE-III, and ATLAS. In all experiments, ASTROMER-based classifiers outperformed a baseline recurrent neural network trained on light curves directly when limited labeled data was available. Furthermore, using ASTROMER embeddings decreases computational resources needed while achieving state-of-the-art results. Finally, we provide a Python library that includes all the functionalities employed in this work. The library, main code, and pre-trained weights are available at https://github.com/astromer-science
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。