The paper explores the use of various machine learning methods to search for heterogeneous or atypical structures on astronomical maps. The study was conducted on the maps of the cosmic microwave background radiation from the Planck mission obtained at various frequencies. The algorithm used found a number of atypical anomalous structures in the actual maps of the Planck mission. This paper details the machine learning model used and the algorithm for detecting anomalous structures. A map of the position of such objects has been compiled. The results were compared with known astrophysical processes or objects. Future research involves expanding the dataset and applying various algorithms to improve the detection and classification of outliers.
We present an algorithm capable of detecting diffuse, dim sources of any size in an astronomical image. These sources often defeat traditional methods for source finding, which expand regions around points of high intensity. Extended sources often have no bright points and are only detectable when viewed as a whole, so a more sophisticated approach is required. Our algorithm operates at all scales simultaneously by considering a tree of nested candidate bounding boxes, and inverts a hierarchical Bayesian generative model to obtain the probability of sources existing at given locations and size…
We present a classification-based approach to identify quasi-stellar radio sources (quasars) in the Sloan Digital Sky Survey and evaluate its performance on a manually labeled training set. While reasonable results can already be obtained via approaches working only on photometric data, our experiments indicate that simple but problem-specific features extracted from spectroscopic data can significantly improve the classification performance. Since our approach works orthogonal to existing classification schemes used for building the spectroscopic catalogs, our classification results are well …
We present a new framework to detect various types of variable objects within massive astronomical time-series data. Assuming that the dominant population of objects is non-variable, we find outliers from this population by using a non-parametric Bayesian clustering algorithm based on an infinite GaussianMixtureModel (GMM) and the Dirichlet Process. The algorithm extracts information from a given dataset, which is described by six variability indices. The GMM uses those variability indices to recover clusters that are described by six-dimensional multivariate Gaussian distributions, allowing o…
Technical University of Cluj-Napoca(克卢日-纳波卡技术大学);Isaac Newton Group of Telescopes (ING)(艾萨克·牛顿望远镜组);Instituto de Astrofisica de Canarias (IAC)(加那利天体物理研究所)
The continuing monitoring and surveying of the nearby space to detect Near Earth Objects (NEOs) and Near Earth Asteroids (NEAs) are essential because of the threats that this kind of objects impose on the future of our planet. We need more computational resources and advanced algorithms to deal with the exponential growth of the digital cameras' performances and to be able to process (in near real-time) data coming from large surveys. This paper presents a software platform called NEARBY that supports automated detection of moving sources (asteroids) among stars from astronomical images. The d…
Powellsnakes is a Bayesian algorithm for detecting compact objects embedded in a diffuse background, and was selected and successfully employed by the Planck consortium in the production of its first public deliverable: the Early Release Compact Source Catalogue (ERCSC). We present the critical foundations and main directions of further development of PwS, which extend it in terms of formal correctness and the optimal use of all the available information in a consistent unified framework, where no distinction is made between point sources (unresolved objects), SZ clusters, single or multi-chan…
We present variability analysis of data from the Northern Sky Variability Survey (NSVS). Using the clustering method which defines variable candidates as outliers from large clusters, we cluster 16,189,040 light curves, having data points at more than 15 epochs, as variable and non-variable candidates in 638 NSVS fields. Variable candidates are selected depending on how strongly they are separated from the largest cluster and how rarely they are grouped together in eight dimensional space spanned by variability indices. All NSVS light curves are also cross-correlated to the Infrared Astronomic…
Exoplanets, short for `extra solar planets', are planets outside our solar system. They are objects with masses less than around 15 Jupiter-masses that orbit stars other than the Sun. They are small enough so they can not burn deuterium in their cores, yet large enough that they are not so called `dwarf planets' like Pluto. To discover life elsewhere in the universe, particularly outside our own solar system, a good starting point would be to search for planets orbiting nearby Sun-like stars, since the only example of life we know of thrives on a planet we call Earth that orbits a G-type dwarf…
The next generation of telescopes will acquire terabytes of image data on a nightly basis. Collectively, these large images will contain billions of interesting objects, which astronomers call sources. The astronomers' task is to construct a catalog detailing the coordinates and other properties of the sources. The source catalog is the primary data product for most telescopes and is an important input for testing new astrophysical theories, but to construct the catalog one must first detect the sources. Existing algorithms for catalog creation are effective at detecting sources, but do not ha…
Stacking analysis is a means of detecting faint sources using a priori position information to estimate an aggregate signal from individually undetected objects. Confusion severely limits the effectiveness of stacking in deep surveys with limited angular resolution, particularly at far infrared to submillimeter wavelengths, and causes a bias in stacking results. Deblending corrects measured fluxes for confusion from adjacent sources; however, we find that standard deblending methods only reduce the bias by roughly a factor of two while tripling the variance. We present an improved algorithm fo…
Istituto di Radio Astronomia, INAF(意大利国家天体物理研究所射电天文研究所);Hamburger Sternwarte(汉堡天文台);Universitá di Bologna(博洛尼亚大学)
We apply a Machine Learning technique known as Convolutional Denoising Autoencoder to denoise synthetic images of state-of-the-art radio telescopes, with the goal of detecting the faint, diffused radio sources predicted to characterise the radio cosmic web. In our application, denoising is intended to address both the reduction of random instrumental noise and the minimisation of additional spurious artefacts like the sidelobes, resulting from the aperture synthesis technique. The effectiveness and the accuracy of the method are analysed for different kinds of corrupted input images, together …
In this work, we propose two convolutional neural network classifiers for detecting contaminants in astronomical images. Once trained, our classifiers are able to identify various contaminants, such as cosmic rays, hot and bad pixels, persistence effects, satellite or plane trails, residual fringe patterns, nebulous features, saturated pixels, diffraction spikes, and tracking errors in images. They encompass a broad range of ambient conditions, such as seeing, image sampling, detector type, optics, and stellar density. The first classifier, MaxiM ask , performs semantic segmentation and genera…
Nanjing University of Posts and Telecommunications(南京邮电大学);National Astronomical Observatories, Chinese Academy of Sciences(中国科学院国家天文台);University of Chinese Academy of Sciences(中国科学院大学)
Astronomical outliers, such as unusual, rare or unknown types of astronomical objects or phenomena, constantly lead to the discovery of genuinely unforeseen knowledge in astronomy. More unpredictable outliers will be uncovered in principle with the increment of the coverage and quality of upcoming survey data. However, it is a severe challenge to mine rare and unexpected targets from enormous data with human inspection due to a significant workload. Supervised learning is also unsuitable for this purpose since designing proper training sets for unanticipated signals is unworkable. Motivated by…
Source finding is one of the most challenging tasks in upcoming radio continuum surveys with SKA precursors, such as the Evolutionary Map of the Universe (EMU) survey of the Australian SKA Pathfinder (ASKAP) telescope. The resolution, sensitivity, and sky coverage of such surveys is unprecedented, requiring new features and improvements to be made in existing source finders. Among them, reducing the false detection rate, particularly in the Galactic plane, and the ability to associate multiple disjoint islands into physical objects. To bridge this gap, we developed a new source finder, based o…
This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time suppressing the inevitable corrupting observational errors. We present a simple nonparametric modeling technique and an algorithm implementing it - an improved and generalized version of Bayesian Blocks (Scargle 1998) - that finds the optimal segmentation of the data in the observation interval. The structure of the algorithm allows it to be used in either a real-time…
Unexpected structure in images of astronomical sources often presents itself upon visual inspection of the image, but such apparent structure may either correspond to true features in the source or be due to noise in the data. This paper presents a method for testing whether inferred structure in an image with Poisson noise represents a significant departure from a baseline (null) model of the image. To infer image structure, we conduct a Bayesian analysis of a full model that uses a multiscale component to allow flexible departures from the posited null model. As a test statistic, we use a ta…
Exploring the Universe with SNAD: Anomaly Detection in Astronomy
Space Research Institute of the Russian Academy of Sciences(俄罗斯科学院空间研究所);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Center for AstroPhysical Surveys(天体物理巡天中心);National Center for Supercomputing Applications(国家超级计算应用中心);Lomonosov Moscow State University(罗蒙诺索夫莫斯科国立大学);Université Clermont Auvergne(克莱蒙奥弗涅大学);CNRS/IN2P3(法国国家科学研究中心/核物理与粒子物理研究所);Sternberg Astronomical Institute(斯特恩伯格天文研究所);National Research University Higher School of Economics(国立研究型大学高等经济学院)
本文综述国际项目 SNAD 如何结合主动学习等机器学习方法,在大规模天文巡天中检测异常,推动天文现象发现分类及机器学习在天体物理中的应用。