Software Data-Processing Pipeline for Transient Detection
Jayanth Chennamangalam, Yogesh Maan, Avinash A. Deshpande
备注：
4 pages, 2 figures, The Low-Frequency Radio Universe, Proceedings of a conference held at NCRA-TIFR, Pune, 8-12 December 2008, ASP Conference Series, Vol. 407, 2009, Eds: D. J. Saikia, D. A. Green, Y. Gupta and T. Venturi
Although several existing and upcoming telescopes have imaging as their primary mode, they also have a sensitive phased-array mode with a multiple-beam forming capability enabling high time resolution studies of several types of objects, including pulsars. For example, the potentially wide coverage in frequency, combined with its collecting area, makes the MWA-LFD a unique instrument for low-frequency detection and studies of pulsars and transients. A software data-processing pipeline is being developed by the Raman Research Institute for this purpose. We describe the various issues relevant to the detection strategies, illustrated with real data at low radio frequencies.
A GPU-Accelerated Transient Detection Pipeline for DECam Time-Domain Surveys
Carnegie Mellon University（卡内基梅隆大学）；University of Pennsylvania（宾夕法尼亚大学）；Texas A. & M. University（德克萨斯农工大学）；University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校）
We present VOLKS2, the second release of "VLBI Observation for transient Localization Keen Searcher". The pipeline aims at transient search in regular VLBI observations as well as detection of single pulses from known sources in dedicated VLBI observations. The underlying method takes the idea of geodetic VLBI data processing, including fringe fitting to maximize the signal power and geodetic VLBI solving for localization. By filtering the candidate signals with multiple windows within a baseline and by cross matching with multiple baselines, RFIs are eliminated effectively. Unlike the station…
The Australian Square Kilometre Array Pathfinder (ASKAP) collects images of the sky at radio wavelengths with an unprecedented field of view, combined with a high angular resolution and sub-millijansky sensitivities. The large quantity of data produced is used by the ASKAP Variables and Slow Transients (VAST) survey science project to study the dynamic radio sky. Efficient pipelines are vital in such research, where searches often form a `needle in a haystack' type of problem to solve. However, the existing pipelines developed among the radio-transient community are not suitable for the scale …
AST3-3 is the third robotic facility of the Antarctic Survey Telescopes (AST3) for transient surveys to be deployed at Dome A, Antarctica. Due to the current pandemic, the telescope has been currently deployed at the Yaoan Observation Station in China, starting the commissioning observation and a transient survey. This paper presents a fully automatic data processing system for AST3-3 observations. The transient detection pipeline uses state-of-the-art image subtraction techniques optimised for GPU devices. Image reduction and transient photometry are accelerated by concurrent task methods. Ou…
FIP-TOI: Fast Imaging Pipeline for Pulsar Localisation with a Transient-Oriented Radio Astronomical Imager
University of Oxford（牛津大学）；Silesian University in Opava（奥帕瓦西里西亚大学）；Mila - Québec Artificial Intelligence Institute（米拉-魁北克人工智能研究所）；University of Cambridge（剑桥大学）；Special Astrophysical Observatory of the Russian Academy of Sciences（俄罗斯科学院特别天体物理观测站）
With the arrival of a number of wide-field snapshot image-plane radio transient surveys, there will be a huge influx of images in the coming years making it impossible to manually analyse the datasets. Automated pipelines to process the information stored in the images are being developed, such as the LOFAR Transients Pipeline, outputting light curves and various transient parameters. These pipelines have a number of tuneable parameters that require training to meet the survey requirements. This paper utilises both observed and simulated datasets to demonstrate different machine learning strat…
We present the Spectroscopic Classification of Astronomical Transients (SCAT) survey, which is dedicated to spectrophotometric observations of transient objects such as supernovae and tidal disruption events. SCAT uses the SuperNova Integral-Field Spectrograph (SNIFS) on the University of Hawai'i 2.2-meter (UH2.2m) telescope. SNIFS was designed specifically for accurate transient spectrophotometry, including absolute flux calibration and host-galaxy removal. We describe the data reduction and calibration pipeline including spectral extraction, telluric correction, atmospheric characterization,…
The best of all worlds: gravitational-wave transient detection with multiple pipelines
Aristotle University of Thessaloniki（塞萨洛尼基亚里士多德大学）；Institute for Accelerated AI Algorithms for Data-Driven Discovery (A3D3), MIT（麻省理工学院数据驱动发现加速AI算法研究所）；University of Thessaly（色萨利大学）
Software products nova.astrometry.net, SExtractor and Aladin are shown to be used for searching for transient phenomena in series of photometric images. An algorithm for taking into account atmospheric distortions introduced into images during observations is pro-posed. The algorithm is based on the correlation analysis of the series of photometric estimates of the brightness of objects in the image field. The possibility of searching for transient phenomena is shown to be on time intervals smaller or longer than the observation time.
The scientific interest in studying high-energy transient phenomena in the Universe has largely grown for the last decade. Now, multiple ground-based survey projects have emerged to continuously monitor the optical (and multi-messenger) transient sky at higher image cadences and cover always larger portions of the sky every night. These novel approaches lead to a huge increase of the global alert rates which need to be handled with care especially by keeping the false alarms as low as possible. Therefore, the standard transient detection pipelines previously designed for narrow field of view i…
The Simons Observatory: Development of a Pipeline to Detect Rapid Transients in Time-Ordered Data
The University of Melbourne（墨尔本大学）；The International School for Advanced Studies (SISSA)（国际高等研究院）；The National Institute for Nuclear Physics (INFN)（意大利国家核物理研究所）；The National Institute for Astrophysics (INAF)（意大利国家天体物理研究所）；The Institute for Fundamental Physics of the Universe (IFPU)（宇宙基础物理研究所）；University of Pennsylvania（宾夕法尼亚大学）；University of Milano-Bicocca（米兰比可卡大学）；Princeton University（普林斯顿大学）；University of Toronto（多伦多大学）；Pontificia Universidad Católica de Chile（智利天主教 Pontificia 大学）；Specola Vaticana (Vatican Observatory)（梵蒂冈天文台）
Despite the prevalence of transient-searching facilities operating across most wavelengths, the ultraviolet (UV) transient sky remains to be systematically studied. We have recently initiated the Transient Ultraviolet Objects (TUVO) project, with which we search for serendipitous UV transients in data from currently available UV instruments, with a focus on the UV/Optical (UVOT) telescope aboard the Neil Gehrels Swift Observatory (an overview of the TUVO project is described in a companion paper). Here we describe TUVOpipe, the pipeline we constructed in order to find such transients in the UV…
Upcoming large scale telescope projects such as the Square Kilometre Array (SKA) will see high data rates and large data volumes; requiring tools that can analyse telescope event data quickly and accurately. In modern radio telescopes, analysis software forms a core part of the data read out, and long-term software stability and maintainability are essential. AstroAccelerate is a many core accelerated software package that uses NVIDIA(R) GPUs to perform realtime analysis of radio telescope data, and it has been shown to be substantially faster than realtime at processing simulated SKA-like dat…
Since its launch, TESS has provided high cadence observations for objects across the sky. Although high cadence TESS observations provide a unique possibility to study the rapid time evolution of numerous objects, artifacts in the data make it particularly challenging to use in studying transients. Furthermore, the broadband red filter of TESS, makes calibrating it to physical flux units, or magnitudes, challenging. Here we present TESSreduce an open-source, and user-friendly Python package which is built to lower the barrier to entry for transient science with TESS. In a few commands users ca…
We present a methodology for automated real-time analysis of a radio image data stream with the goal to find transient sources. Contrary to previous works, the transients we are interested in occur on a time-scale where dispersion starts to play a role, so we must search a higher-dimensional data space and yet work fast enough to keep up with the data stream in real time. The approach consists of five main steps: quality control, source detection, association, flux measurement, and physical parameter inference. We present parallelized methods based on convolutions and filters that can be accel…
In the multi-messenger era, space and ground-based observatories usually develop real-time analysis (RTA) pipelines to rapidly detect transient events and promptly share information with the scientific community to enable follow-up observations. These pipelines can also react to science alerts shared by other observatories through networks such as the Gamma-Ray Coordinates Network (GCN) and the Astronomer's Telegram (ATels). AGILE is a space mission launched in 2007 to study X-ray and gamma-ray phenomena. This contribution presents the technologies used to develop two types of AGILE pipelines …
We present an overview of the SkyMapper optical follow-up program for gravitational-wave event triggers from the LIGO/Virgo observatories, which aims at identifying early GW170817-like kilonovae out to $\sim 200$ Mpc distance. We describe our robotic facility for rapid transient follow-up, which can target most of the sky at $δ<+10°$ to a depth of $i_\mathrm{AB}\approx 20$ mag. We have implemented a new software pipeline to receive LIGO/Virgo alerts, schedule observations and examine the incoming real-time data stream for transient candidates. We adopt a real-bogus classifier using ensemble-ba…
KMTNet Synoptic Survey of Southern Sky II: Data Reduction and Real-Time Transient Detection Pipeline
Seoul National University（首尔大学）；Daegu National Science Museum（大邱国立科学博物馆）；Korea Astronomy and Space Science Institute（韩国天文学与空间科学研究院）；University of Hawaii（夏威夷大学）
本文介绍KMTNet南天全景巡天数据释放1的图像处理流水线，涵盖数据质量保证、天体测量、光度零点校准等核心方法，实现亚像素精度的天体测量和22-23 AB mag的5西格玛深度。
As the sensitivity and observing time of gravitational-wave detectors increase, a more diverse range of signals is expected to be observed from a variety of sources. Especially, long-lived gravitational-wave transients have received interest in the last decade. Because most of long-duration signals are poorly modeled, detection must rely on generic search algorithms, which make few or no assumption on the nature of the signal. However, the computational cost of those searches remains a limiting factor, which leads to sub-optimal sensitivity. Several detection algorithms have been developed to …
Modern soft X-ray observatories can yield unique insights into time domain astrophysics, and a huge amount of information is stored - and largely unexploited - in data archives. Like a treasure-hunt, the EXTraS project harvested the hitherto unexplored temporal domain information buried in the serendipitous data collected by the European Photon Imaging Camera instrument onboard the ESA XMM-Newton, in 16 years of observations. All results have been released to the scientific community, together with new software analysis tools. This paper presents the architecture of the EXTraS science gateway,…
Current time domain facilities are discovering hundreds of new galactic and extra-galactic transients every week. Classifying the ever-increasing number of transients is challenging, yet crucial to further our understanding of their nature, discover new classes, or ensuring sample purity, for instance, for Supernova Ia cosmology. The Zwicky Transient Facility is one example of such a survey. In addition, it has a dedicated very-low resolution spectrograph, the SEDMachine, operating on the Palomar 60-inch telescope. This spectrograph's primary aim is object classification. In practice most, if …
In the multi-messenger era, astronomical projects share information about transients phenomena issuing science alerts to the Scientific Community through different communications networks. This coordination is mandatory to understand the nature of these physical phenomena. For this reason, astrophysical projects rely on real-time analysis software pipelines to identify as soon as possible transients (e.g. GRBs), and to speed up external alerts' reaction time. These pipelines can share and receive the science alerts through the Gamma-ray Coordinates Network. This work presents a framework desig…
Excess transient noise events, or glitches, impact the data quality of ground-based ravitational-wave (GW) detectors and impair the detection of signals produced by astrophysical sources. Identification of the causes of these glitches is a crucial starting point for the improvement of GW signal detectability. However, glitches are the product of linear and non-linear couplings among the interrelated detector-control systems that include mitigation of ground motion and regulation of optic motion, which generally makes it difficult to find their origin. We present a new software called PyChChoo …
The large majority of high energy sources detected with Fermi-LAT are blazars, which are known to be very variable sources. High cadence long-term monitoring simultaneously at different wavelengths being prohibitive, the study of their transient activities can help shedding light on our understanding of these objects. The early detection of such potentially fast transient events is the key for triggering follow-up observations at other wavelengths. A Python tool, FLaapLUC, built on top of the Science Tools provided by the Fermi Science Support Center and the Fermi-LAT collaboration, has been d…
Modern astronomical data processing requires complex software pipelines to process ever growing datasets. For radio astronomy, these pipelines have become so large that they need to be distributed across a computational cluster. This makes it difficult to monitor the performance of each pipeline step. To gain insight into the performance of each step, a performance monitoring utility needs to be integrated with the pipeline execution. In this work we have developed such a utility and integrated it with the calibration pipeline of the Low Frequency Array, LOFAR, a leading radio telescope. We te…
The HIFI data processing pipeline was developed to systematically process diagnostic, calibration and astronomical observations taken with the HIFI science instrumentas part of the Herschel mission. The HIFI pipeline processed data from all HIFI observing modes within the Herschel automated processing environment, as well as, within an interactive environment. A common software framework was developed to best support the use cases required by the instrument teams and by the general astronomers. The HIFI pipeline was built on top of that and was designed with a high degree of modularity. This m…
M-EPDet: Real-Time Real-Bogus Classification and Transient Candidate Judgement for the EP-WXT Pipeline via Multi-Modal Data
National Astronomical Observatories, Chinese Academy of Sciences（中国科学院国家天文台）；University of Chinese Academy of Sciences（中国科学院大学）；National Astronomical Data Center（国家天文数据中心）
The Omicron software is a tool developed to perform a multi-resolution time-frequency analysis of data from gravitational-wave detectors: the LIGO, Virgo, and KAGRA detectors. Omicron generates spectrograms from whitened data streams, offering a visual representation of transient detector noises and gravitational-wave events. In addition, these events can be parameterized with an optimized resolution. They can be written to disk to conduct offline noise characterization and gravitational-wave event validation studies. Omicron is optimized to process, in parallel, thousands of data streams reco…
