arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.11202astro-ph.IMastro-ph.GA
收藏

Astronomaly:天文数据中的个性化主动异常检测

Astronomaly: Personalised Active Anomaly Detection in Astronomical Data

Michelle Lochner, Bruce A. Bassett

摘要:

调查望远镜,如维拉C。鲁宾天文台和平方公里阵列将发现数十亿个静态和动态天文源。如果得到适当的挖掘,这些庞大的数据集可能会成为罕见或未知天体物理现象的源泉。面临的挑战是,数据集如此之大,以至于大多数数据永远不会被人眼看到;目前我们拥有的最强大的工具来检测相关异常。机器学习是一个有用的工具,在这种制度的异常检测。然而,它很难区分有趣的异常和不相关的数据,如仪器文物或稀有的天文来源,只是不感兴趣的特定科学家。主动学习将人类大脑的灵活性和直觉与机器学习的原始处理能力相结合。通过战略性地选择特定对象进行专家标签,它最大限度地减少了科学家必须查看的数据量,同时最大限度地提高了潜在的科学回报。在这里,我们介绍Astronomaly:一个通用的异常检测框架,采用一种新的主动学习方法,旨在提供个性化的建议。Astronomaly可以处理大多数类型的天文数据,包括图像、光变曲线和光谱。我们使用Galaxy Zoo数据集来证明Astronomaly的有效性,以及模拟数据来彻底测试我们新的主动学习方法。我们发现,对于这两个数据集,Astronomaly在用户查看的前100个对象中发现的有趣异常数量大约增加了一倍。Astronomaly很容易扩展,包括新的特征提取技术,异常检测算法,甚至不同的主动学习方法。该代码可在https://github.com/MichelleLochner/astronomaly上公开获取。

英文摘要:

Survey telescopes such as the Vera C. Rubin Observatory and the Square Kilometre Array will discover billions of static and dynamic astronomical sources. Properly mined, these enormous datasets will likely be wellsprings of rare or unknown astrophysical phenomena. The challenge is that the datasets are so large that most data will never be seen by human eyes; currently the most robust instrument we have to detect relevant anomalies. Machine learning is a useful tool for anomaly detection in this regime. However, it struggles to distinguish between interesting anomalies and irrelevant data such as instrumental artefacts or rare astronomical sources that are simply not of interest to a particular scientist. Active learning combines the flexibility and intuition of the human brain with the raw processing power of machine learning. By strategically choosing specific objects for expert labelling, it minimises the amount of data that scientists have to look through while maximising potential scientific return. Here we introduce Astronomaly: a general anomaly detection framework with a novel active learning approach designed to provide personalised recommendations. Astronomaly can operate on most types of astronomical data, including images, light curves and spectra. We use the Galaxy Zoo dataset to demonstrate the effectiveness of Astronomaly, as well as simulated data to thoroughly test our new active learning approach. We find that for both datasets, Astronomaly roughly doubles the number of interesting anomalies found in the first 100 objects viewed by the user. Astronomaly is easily extendable to include new feature extraction techniques, anomaly detection algorithms and even different active learning approaches. The code is publicly available at https://github.com/MichelleLochner/astronomaly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑