Radio source analysis services for the SKA and precursors
Simone Riggi, Cristobal Bordiu, Daniel Magro, Renato Sortino, Carmelo Pino, Eva Sciacca, Filomena Bufano, Thomas Cecconello, Giuseppe Vizzari, Fabio Vitello, Giuseppe Tudisco
备注：
4 pages, 3 figures, proceedings of ADASS XXXI conference, to be published in ASP Conference Series
New developments in data processing and visualization are being made in preparation for upcoming radioastronomical surveys planned with the Square Kilometre Array (SKA) and its precursors. A major goal is enabling extraction of science information from the data in a mostly automated way, possibly exploiting the capabilities offered by modern computing infrastructures and technologies. In this context, the integration of source analysis algorithms into data visualization tools is expected to significantly improve and speed up the cataloguing process of large area surveys. To this aim, the CIRASA (Collaborative and Integrated platform for Radio Astronomical Source Analysis) project was recently started to develop and integrate a set of services for source extraction, classification and analysis into the ViaLactea visual analytic platform and knowledge base archive. In this contribution, we will present the project objectives and tools that have been developed, interfaced and deployed so far on the prototype European Open Science Cloud (EOSC) infrastructure provided by the H2020 NEANIAS project.
In the era of the SKA precursors, telescopes are producing deeper, larger images of the sky on increasingly small time-scales. The greater size and volume of images place an increased demand on the software that we use to create catalogues, and so our source finding algorithms need to evolve accordingly. In this paper we discuss some of the logistical and technical challenges that result from the increased size and volume of images that are to be analysed, and demonstrate how the Aegean source finding package has evolved to address these challenges. In particular we address the issues of sourc…
We describe the design and performance of the Engineering Development Array (EDA), which is a low frequency radio telescope comprising 256 dual-polarisation dipole antennas working as a phased-array. The EDA was conceived of, developed, and deployed in just 18 months via re-use of Square Kilometre Array (SKA) precursor technology and expertise, specifically from the Murchison Widefield Array (MWA) radio telescope. Using drift scans and a model for the sky brightness temperature at low frequencies, we have derived the EDA's receiver temperature as a function of frequency. The EDA is shown to be…
Accurate instrumental bandpass corrections are essential for the reliable interpretation of spectral lines from targeted and survey-mode observations with radio interferometers. Bandpass correction is typically performed by comparing measurements of a strong calibrator source to an assumed model, typically an isolated point source. The wide field-of-view and high sensitivity of modern interferometers means that additional sources are often detected in observations of calibrators. This can introduce errors into bandpass corrections and subsequently the target data if not properly accounted for.…
Magnetic field couples the solar interior to the solar atmosphere, known as the corona. The coronal magnetic field is one of the crucial parameters which determines the coronal structures and regulates the space weather phenomena like flares, coronal mass ejections, energetic particle events, and solar winds. Measuring the magnetic field at middle and higher coronal heights are extremely difficult problem and to date there is no single measurement technique available to measure the higher coronal magnetic fields routinely. polarization measurements of the low-frequency radio emissions are an i…
The Widefield ASKAP L-band Legacy All-sky Blind surveY (WALLABY) is a neutral hydrogen survey (HI) that is running on the Australian SKA Pathfinder (ASKAP), a precursor telescope for the Square Kilometre Array (SKA). The goal of WALLABY is to use ASKAP's powerful wide-field phased array feed technology to observe three quarters of the entire sky at the 21 cm neutral hydrogen line with an angular resolution of 30 arcseconds. Post-processing activities at the Australian SKA Regional Centre (AusSRC), Canadian Initiative for Radio Astronomy Data Analysis (CIRADA) and Spanish SKA Regional Centre pr…
Solar, Heliospheric and Ionospheric Physics: Pathfinders, Precursors and SKAO Perspective
ASTRON - Netherlands Institute for Radio Astronomy（荷兰射电天文研究所）；Indian Institute of Technology, Kanpur（坎普尔印度理工学院）；National Centre for Radio Astrophysics, Tata Institute of Fundamental Research（塔塔基础研究院国家射电天体物理中心）；Dublin Institute for Advanced Studies（都柏林高等研究院）；University of Oslo（奥斯陆大学）；University of Bath（巴斯大学）
Highlights are presented about the science to be done with SKA. as well as state of the art science already done today with its precursors (MeerKAT, ASKAP) and pathfinders (LOFAR, NenuFAR), with accent on the expected breakthroughs.
The Square Kilometre Array Telescope Manager (SKA TM) will be responsible for assisting the SKA Operations and Observation Management, carrying out System diagnosis and collecting Monitoring & Control data from the SKA sub-systems and components. To provide adequate compute resources, scalability, operation continuity and high availability, as well as strict Quality of Service, the TM cyber-infrastructure (embodied in the Local Infrastructure - LINFRA) consists of COTS hardware and infrastructural software (for example: server monitoring software, host operating system, virtualization software…
The Square Kilometre Array (SKA) project consists of delivering two largest radio telescope arrays being built by the SKA Observatory (SKAO), which is an intergovernmental organization bringing together nations from around the world with China being one of the major member countries. The computing resources needed to process, distribute, curate and use the vast amount of data that will be generated by the SKA telescopes are too large for the SKAO to manage on its own. To address this challenge, the SKAO is working with the international community to create a shared, distributed data, computing…
In order to deliver the full science potential of the Square Kilometer Array (SKA) telescope, several SKA Regional Centres (SRCs) will be required to be constructed in different SKA member countries around the world. These SRCs will provide high performance compute and storage for the generation of advanced science data products from the basic data streams generated by the SKA Science Data Handling and Processing system, critically necessary to the success of the key science projects to be carried out by the SKA user community. They will also provide support to astronomers to enable them to ca…
The dynamics and the structure of the solar corona are determined by its magnetic field. Measuring coronal magnetic fields is, however, extremely hard. The polarization of low-frequency radio emissions has long been recognized as one of the few effective observational probes of magnetic fields in the mid and high corona. However, the extreme intrinsic variability of this emission, the limited ability of most of the available existing instrumentation (until recently) to capture it, and the technical challenges involved have all contributed to its use being severely limited. The high dynamic-ran…
Coronal magnetic fields are well known to be one of the crucial parameters defining coronal physics and space weather. However, measuring the global coronal magnetic fields remains challenging. The polarization properties of coronal radio emissions are sensitive to coronal magnetic fields. While they can prove to be useful probes of coronal and heliospheric magnetic fields, their usage has been limited by technical and algorithmic challenges. We present a robust algorithm for precise polarization calibration and imaging of low-radio frequency solar observations and demonstrate it on data from …
Future total-power single-dish HI intensity mapping (HI IM) surveys have the potential to provide unprecedented insight into late time ($z < 1$) cosmology that are competitive with Stage IV dark energy surveys. However, redshifts between $0 < z < 0.2$ lie within the transmission bands of global navigation satellite services (GNSS), and even at higher redshifts out-of-band leakage from GNSS satellites may be problematic. We estimate the impact of GNSS satellites on future single-dish HI IM surveys using realistic estimates of both the total power and spectral structure of GNSS signals convolved…
Accelerating radio astronomy imaging with RICK: a step towards SKA-Mid and SKA-Low
INAF-Osservatorio astronomico di Brera（意大利国家天体物理研究所布雷拉天文台）；ICSC – Centro Nazionale di Ricerca in High Performance Computing, Big Data e Quantum Computing（高性能计算、大数据与量子计算国家研究中心）；Dipartimento di Fisica e Astronomia, Università di Bologna（博洛尼亚大学物理与天文学系）；Istituto di Radioastronomia, INAF（意大利国家天体物理研究所射电天文研究所）；INAF-Osservatorio Astronomico di Trieste（意大利国家天体物理研究所的里雅斯特天文台）
RICK 2.0 利用 HeFFTe 库实现高效分布式快速傅里叶变换，提升射电成像性能，适用于 SKA-Mid 和 SKA-Low 项目。
In this chapter we provide an overview of the science enabled by radio continuum surveys in the SKA era, focusing on galaxy/galaxy cluster physics and evolution studies, and other relevant continuum science in the >2020 scientific framework. We outline a number of 'reference' radio-continuum surveys for SKA1 that can address such topics, and comprehensively discuss the most critical science requirements that we have identified. We highlight what should be achieved by SKA1, to guarantee a major leap forwards with respect to the pre-SKA era, considering the science advances expected in the comin…
We present the results of our investigations into options for the computing platform for the imaging pipeline in the CHILES project, an ultra-deep HI pathfinder for the era of the Square Kilometre Array. CHILES pushes the current computing infrastructure to its limits and understanding how to deliver the images from this project is clarifying the Science Data Processing requirements for the SKA. We have tested three platforms: a moderately sized cluster, a massive High Performance Computing (HPC) system, and the Amazon Web Services (AWS) cloud computing platform. We have used well-established …
The Square Kilometre Array (SKA) will answer fundamental questions about the origin, evolution, properties, and influence of magnetic fields throughout the Universe. Magnetic fields can illuminate and influence phenomena as diverse as star formation, galactic dynamics, fast radio bursts, active galactic nuclei, large-scale structure, and Dark Matter annihilation. Preparations for the SKA are swiftly continuing worldwide, and the community is making tremendous observational progress in the field of cosmic magnetism using data from a powerful international suite of SKA pathfinder and precursor t…
South Africa has played a leading role in radio astronomy in Africa with the Hartebeesthoek Radio Astronomy Observatory (HartRAO). It continues to make strides with the current seven-dish MeerKAT precursor array (KAT-7), leading to the 64-dish MeerKAT and the giant Square Kilometer Array (SKA), which will be used for transformational radio astronomy research. Ghana, an African partner to the SKA, has been mentored by South Africa over the past six years and will soon emerge in the field of radio astronomy. The country will soon have a science-quality 32m dish converted from a redundant satelli…
Strong evidence exists for a highly significant correlation between the radio flux density and gamma-ray energy flux in blazars revealed by Fermi. However, there are central issues that need to be clarified in this field: what are the counterparts of the about 30% of gamma-ray sources that are as yet unidentified? Are they just blazars in disguise or they are something more exotic, possibly associated with dark matter? How would they fit in the radio-gamma ray connection studied so far? With their superb sensitivity, SKA1-MID and SKA1-SUR will help to resolve all of these questions. Even more,…
YOLO-CIANNA: Galaxy detection with deep learning in radio data: II. Winning the SKA SDC2 using a generalized 3D-YOLO network
LUX, Observatoire de Paris, Université PSL, Sorbonne Université, CNRS（巴黎天文台卢克斯实验室，巴黎文理研究大学，索邦大学，法国国家科学研究中心）；Canadian Institute for Theoretical Astrophysics, University of Toronto（加拿大理论天体物理研究所，多伦多大学）；Research School of Astronomy & Astrophysics, Australian National University（澳大利亚国立大学天文与天体物理研究学院）；Université de Strasbourg, CNRS UMR 7550, Observatoire astronomique de Strasbourg（斯特拉斯堡大学，法国国家科学研究中心UMR 7550，斯特拉斯堡天文台）；DIO, Observatoire de Paris, CNRS, PSL（巴黎天文台数据与信息办公室，法国国家科学研究中心，巴黎文理研究大学）；IDRIS, CNRS（法国国家科学研究中心集成系统研究所）；Collège de France（法兰西公学院）；Department of Physics & Electronics, Rhodes University（罗兹大学物理与电子系）
Imaging the low-frequency radio Sun is an intrinsically challenging problem. Meter-wavelength solar emission spans angular scales from a few arcminutes to a few degrees. These emissions show temporal and spectral variability on a sub-second and sub-MHz scales. The brightness temperature of these emissions also varies by many orders of magnitude, which requires high-dynamic-range spectroscopic snapshot imaging. With the unique array configuration of the Murchison Widefield Array (MWA), and the robust calibration and imaging pipeline, Automated Imaging Routine for the Compact Arrays for the Radi…
With SKA precursor and pathfinder operations in full swing, radio and (sub-)mm astronomy is entering the era of super big data. The big questions is how to make (sub-)mm and radio data available to the astronomical community, preferably using FAIR (findable, accessible, interoperable and re-useable; Wilkinson et al. 2016) principles. There are already a lot of efforts going on around the globe: facilities such as ALMA, LOFAR, MWA, NRAO and ASKAP are already publishing much of their imaging data in the form of "science ready" products, SKA regional centres are being formed and a radio astronomy…
Source finding is one of the most challenging tasks in upcoming radio continuum surveys with SKA precursors, such as the Evolutionary Map of the Universe (EMU) survey of the Australian SKA Pathfinder (ASKAP) telescope. The resolution, sensitivity, and sky coverage of such surveys is unprecedented, requiring new features and improvements to be made in existing source finders. Among them, reducing the false detection rate, particularly in the Galactic plane, and the ability to associate multiple disjoint islands into physical objects. To bridge this gap, we developed a new source finder, based o…
In this work, we explore the potential of multi-domain multi-branch convolutional neural networks (CNNs) for identifying comparatively rare giant radio galaxies from large volumes of survey data, such as those expected for new-generation radio telescopes like the SKA and its precursors. The approach presented here allows models to learn jointly from multiple survey inputs, in this case NVSS and FIRST, as well as incorporating numerical redshift information. We find that the inclusion of multi-resolution survey data results in correction of 39% of the misclassifications seen from equivalent sin…
Innovative developments in data processing, archiving, analysis, and visualization are nowadays unavoidable to deal with the data deluge expected in next-generation facilities for radio astronomy, such as the Square Kilometre Array (SKA) and its precursors. In this context, the integration of source extraction and analysis algorithms into data visualization tools could significantly improve and speed up the cataloguing process of large area surveys, boosting astronomer productivity and shortening publication time. To this aim, we are developing a visual analytic platform (CIRASA) for advanced …
STORMY : A Real-time Triggering Framework using Yamagawa Solar Spectrograph for Active Solar Emission Observations with the MWA
National Centre for Radio Astrophysics, Tata Institute of Fundamental Research（国家射电天文中心，塔塔基础研究所）；University Corporation for Atmospheric Research（大气研究大学联盟）；National Institute of Information and Communications Technology（信息通信技术研究机构）；Curtin University（科廷大学）；International Centre for Radio Astronomy Research（国际射电天文研究中心）
The LOw-Frequency ARray is a low-frequency radio interferometer composed by observational stations spread across Europe and it is the largest precursor of SKA in terms of effective area and generated data rates. In 2018, the Italian community officially joined LOFAR project, and it deployed a distributed computing and storage infrastructure dedicated to LOFAR data analysis. The infrastructure is based on 4 nodes distributed in different Italian locations and it offers services for pipelines execution, storage of final and intermediate results and support for the use of the software and infrast…
SKA precursors are capable of detecting hundreds of galaxies in HI in a single 12 hours pointing. In deeper surveys one will probe more easily faint HI structures, typically located in the vicinity of galaxies, such as tails, filaments, and extraplanar gas. The importance of interactive visualization has proven to be fundamental for the exploration of such data as it helps users to receive immediate feedback when manipulating the data. We have developed SlicerAstro, a 3-D interactive viewer with new analysis capabilities, based on traditional 2-D input/output hardware. These capabilities enhan…
Enhancing interoperable data access to radio data has become a science priority within the International Virtual Observatory Alliance (IVOA). This lead to the foundation of the IVOA Radio astronomy Interest Group. Several radio astronomers and project scientists enrolled in various projects (NRAO, ASKAP, LOFAR, JIVE, ALMA, SKA, INAF, NenuFAR, etc.) have joined. Together they are paving the way to a better integration of their services in the virtual observatory (VO) infrastructure and propose extension of IVOA standards to help achieving this goal. Calibrated radio datasets such as cubes, imag…
Automated source extraction and parameterization represents a crucial challenge for the next-generation radio interferometer surveys, such as those performed with the Square Kilometre Array (SKA) and its precursors. In this paper we present a new algorithm, dubbed CAESAR (Compact And Extended Source Automated Recognition), to detect and parametrize extended sources in radio interferometric maps. It is based on a pre-filtering stage, allowing image denoising, compact source suppression and enhancement of diffuse emission, followed by an adaptive superpixel clustering stage for final source segm…
(arXiv abridged abstract) The current years are seeing huge developments of radio telescopes and a tremendous increase of their capabilities. Such systems make mandatory the design of more sophisticated techniques not only for transporting, storing and processing this new generation of radio interferometric data, but also for restoring the astrophysical information contained in such data. In this paper we present a new radio deconvolution algorithm named MORESANE and its application to fully realistic simulated data of MeerKAT, one of the SKA precursors. This method has been designed for the d…
The Spitzer Data Fusion - A Far-Ultraviolet to Far-Infrared Multi-Wavelength Database in Spitzer Extragalactic Survey Fields
Inter-University Institute for Data Intensive Astronomy (IDIA), Department of Astronomy, University of Cape Town（开普敦大学数据密集型天文学校际研究所）；University of the Western Cape（西开普大学）；INAF - Istituto di Radioastronomia（意大利国家天体物理研究所射电天文台）
Classification of compact radio sources in the Galactic plane with supervised machine learning
INAF - Osservatorio Astrofisico di Catania（意大利国家天体物理研究所卡塔尼亚天体观测台）；Department of Physics, University of Wisconsin-Madison（威斯康星大学麦迪逊分校物理系）；Western Sydney University（西悉尼大学）；CSIRO Space & Astronomy（澳大利亚联邦科学与工业研究组织空间与天文分部）；Thüringer Landessternwarte Tautenburg (TLS)（图林根州陶滕堡天文台）
Radio astronomy and Space Infrastructures in the Azores have a great scientific and industrial interest because they benefit from a unique geographical location in the middle of the North Atlantic allowing a vast improvement in the sky coverage. This fact obviously has a very high added value for: i) the establishment of space tracking and communications networks for the emergent global small satellite fleets ii) it is invaluable to connect the radio astronomy infrastructure networks in Africa, Europe and America continents using Very Large Baseline Interferometry (VLBI) techniques, iii) it al…
