Community Challenges in the Era of Petabyte-Scale Sky Surveys
Michael S. P. Kelley, Henry H. Hsieh, Colin Orion Chandler, Siegfried Eggl, Timothy R. Holt, Lynne Jones, Mario Juric, Timothy A. Lister, Joachim Moeyens, Willi… 展开作者
Michael S. P. Kelley, Henry H. Hsieh, Colin Orion Chandler, Siegfried Eggl, Timothy R. Holt, Lynne Jones, Mario Juric, Timothy A. Lister, Joachim Moeyens, William J. Oldroyd, Darin Ragozzine, David E. Trilling
备注:
7 pages, 1 figure, submitted to the Planetary Science and Astrobiology Decadal Survey 2023-2032 call for white papers
We outline the challenges faced by the planetary science community in the era of next-generation large-scale astronomical surveys, and highlight needs that must be addressed in order for the community to maximize the quality and quantity of scientific output from archival, existing, and future surveys, while satisfying NASA's and NSF's goals.
Fermi National Accelerator Laboratory(费米国家加速器实验室);Kavli Institute of Cosmological Physics, University of Chicago(芝加哥大学卡弗里宇宙物理研究所);University of Chicago(芝加哥大学);University of Washington(华盛顿大学);Google, Inc.(谷歌公司);Space Telescope Science Institute(空间望远镜科学研究所);The Johns Hopkins University(约翰斯·霍普金斯大学);Carnegie Mellon University(卡内基梅隆大学);Enrico Fermi Institute, The University of Chicago(芝加哥大学恩里科·费米研究所);Center for Astrostatistics, Penn State University(宾夕法尼亚州立大学天体统计学中心);Penn State University(宾夕法尼亚州立大学);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Center for Astrophysics, Harvard & Smithsonian(哈佛-史密森尼天体物理中心);SETI Institute(搜寻地外文明研究所)
The field of astronomy has arrived at a turning point in terms of size and complexity of both datasets and scientific collaboration. Commensurately, algorithms and statistical models have begun to adapt --- e.g., via the onset of artificial intelligence --- which itself presents new challenges and opportunities for growth. This white paper aims to offer guidance and ideas for how we can evolve our technical and collaborative frameworks to promote efficient algorithmic development and take advantage of opportunities for scientific discovery in the petabyte era. We discuss challenges for discove…
The Vera C. Rubin Observatory Wide-Fast Deep (WFD) sky survey will reach unprecedented surface brightness depths over tens of thousands of square degrees. Surface brightness photometry has traditionally been a challenge. Current algorithms which combine object detection with sky estimation systematically over-subtract the sky, biasing surface brightness measurements at the faint end and destroying or severely compromising low surface brightness light. While it has recently been shown that properly accounting for undetected faint galaxies and the wings of brighter objects can in principle recov…
SCUBA-2 is the largest submillimetre wide-field bolometric camera ever built. This 43 square arc-minute field-of-view instrument operates at two wavelengths (850 and 450 microns) and has been installed on the James Clerk Maxwell Telescope on Mauna Kea, Hawaii. SCUBA-2 has been successfully commissioned and operational for general science since October 2011. This paper presents an overview of the on-sky performance of the instrument during and since commissioning in mid-2011. The on-sky noise characteristics and NEPs of the 450 and 850 micron arrays, with average yields of approximately 3400 bo…
In the era of the SKA precursors, telescopes are producing deeper, larger images of the sky on increasingly small time-scales. The greater size and volume of images place an increased demand on the software that we use to create catalogues, and so our source finding algorithms need to evolve accordingly. In this paper we discuss some of the logistical and technical challenges that result from the increased size and volume of images that are to be analysed, and demonstrate how the Aegean source finding package has evolved to address these challenges. In particular we address the issues of sourc…
We develop a new analysis approach towards identifying related radio components and their corresponding infrared host galaxy based on unsupervised machine learning methods. By exploiting PINK, a self-organising map algorithm, we are able to associate radio and infrared sources without the a priori requirement of training labels. We present an example of this method using $894,415$ images from the FIRST and WISE surveys centred towards positions described by the FIRST catalogue. We produce a set of catalogues that complement FIRST and describe 802,646 objects, including their radio components a…
Astronomy has always been at the forefront of information technology, moving from the era of photographic plates, to digital snapshots and now to digital movies of the sky. This has brought about a data explosion with multi- terabyte surveys already happening and upcoming petabyte scale surveys. By scanning the sky repeatedly and automatically, astronomers find rapidly changing phenomena - transients - of a great variety. Surveys like the Catalina Real-time Transient Survey (CRTS) publish details on the transients right away since many of these fade in a matter of minutes and it is important t…
The next decade will feature a growing number of massive ground-based photometric, spectroscopic, and time-domain surveys, including those produced by DECam, DESI, and LSST. The NOAO Data Lab was launched in 2017 to enable efficient exploration and analysis of large surveys, with particular focus on the petabyte-scale holdings of the NOAO Archive and their associated catalogs. The Data Lab mission and future development align well with two of the NSF's Big Ideas, namely Harnessing Data for 21st Century Science and Engineering and as part of a network to contribute to Windows on the Universe: T…
Millennium Institute of Astrophysics(千禧天体物理研究所);Universidad de Chile(智利大学);Harvard University(哈佛大学);University of Florida(佛罗里达大学);Universidad de los Andes(智利洛斯安第斯大学)
Time-domain astronomy (TDA) is facing a paradigm shift caused by the exponential growth of the sample size, data complexity and data generation rates of new astronomical sky surveys. For example, the Large Synoptic Survey Telescope (LSST), which will begin operations in northern Chile in 2022, will generate a nearly 150 Petabyte imaging dataset of the southern hemisphere sky. The LSST will stream data at rates of 2 Terabytes per hour, effectively capturing an unprecedented movie of the sky. The LSST is expected not only to improve our understanding of time-varying astrophysical objects, but al…
Young stellar objects in their pre-main sequence phase are characterized by irregular changes in brightness, generally attributed to an increase of the mass accretion rate due to various kind of instabilities occurring in the circumstellar disk. In the era of large surveys aimed to monitor the sky, we present a pipeline to detect irregular bursts, in particular EXors-like ( EX Lupi type eruptive variables), in the light curves. The procedure follows a heuristic approach and is tested against the light curves already collected for a few objects presently recognized as bona fide or candidate EXo…
Upcoming surveys such as the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) will detect up to 10 million time-varying sources in the sky every night for ten years. This information will be transmitted in a continuous stream to brokers that will select the most promising events for a variety of science cases using machine learning algorithms. We study the benefits and challenges of Bayesian Neural Networks (BNNs) for this type of classification tasks. BNNs are found to be accurate classifiers which also provide additional information: they quantify the classification uncertain…
Data volumes from multiple sky surveys have grown from gigabytes into terabytes during the past decade, and will grow from terabytes into tens (or hundreds) of petabytes in the next decade. This exponential growth of new data both enables and challenges effective astronomical research, requiring new approaches. Thus far, astronomy has tended to address these challenges in an informal and ad hoc manner, with the necessary special expertise being assigned to e-Science or survey science. However, we see an even wider scope and therefore promote a broader vision of this data-driven revolution in a…
The Karl G. Jansky Very Large Array (VLA) is currently the world's most powerful cm-wavelength telescope. However, within a few years this blanket statement will no longer be entirely true, due to the emergence of a new breed of pre-SKA radio telescopes with improved surveying capabilities. This white paper explores a region of sensitivity-area parameter space where an investment of a few thousand hours through a VLA Sky Survey (VLASS) will yield a unique dataset with extensive scientific utility and legacy value well into the SKA era: a deep full-polarization L-band survey covering a few squa…
The Gamma-Ray Integrated Detectors (GRID) is a space mission concept dedicated to monitoring the transient gamma-ray sky in the energy range from 10 keV to 2 MeV using scintillation detectors onboard CubeSats in low Earth orbits. The primary targets of GRID are the gamma-ray bursts (GRBs) in the local universe. The scientific goal of GRID is, in synergy with ground-based gravitational wave (GW) detectors such as LIGO and VIRGO, to accumulate a sample of GRBs associated with the merger of two compact stars and study jets and related physics of those objects. It also involves observing and study…
Gaia, the European Space Agency spacecraft successfully launched on 19 December 2013, entered into nominal science operations on 18 July 2014 after a few months of commissioning, and has been scanning the sky to a faint limit of G = 20.7 mag since then. Gaia is expected to observe more than a hundred thousand RR Lyrae stars in the Galactic halo and bulge (most of which will be new discoveries), and to provide parallax measurements with about 10 μas uncertainty for those brighter than <V>$\sim$ 12-13 mag. Status and activities of the spacecraft since launch are briefly reviewed with emphasis on…
Spec-S5: A Next-Generation All-Sky Spectroscopic Facility Enabling Large-Scale Surveys for Cosmology and Astrophysics
UC Berkeley Space Sciences Lab(加州大学伯克利分校空间科学实验室);Lawrence Berkeley National Lab(劳伦斯伯克利国家实验室);NSF NOIRLab(美国国家光学红外天文研究实验室);The Ohio State University(俄亥俄州立大学);Fermi National Accelerator Laboratory(费米国家加速器实验室);Department of Astronomy & Astrophysics, Chicago(芝加哥大学天文学与天体物理学系);Kavli Institute of Cosmological Physics, Chicago(芝加哥大学卡弗里宇宙学物理研究所);Wyant College of Optical Sciences, The University of Arizona(亚利桑那大学怀恩特光学科学学院);Cerro Tololo Inter-American Observatory, NSF NOIRLab, Chile(智利托洛洛山美洲际天文台)
We describe the parameters of a low-frequency all-sky survey of compact radio sources using Interplanetary Scintillation (IPS), undertaken with the Murchison Widefield Array (MWA). While this survey gives important complementary information to low-resolution survey such as the MWA GLEAM survey, providing information on the subarsecond structure of every source, a survey of this kind has not been attempted in the era of low-frequency imaging arrays such as the MWA and LOFAR. Here we set out the capabilities of such a survey, describing the limitations imposed by the heliocentric observing geome…
This white paper is a summarising report of the Forum on monitoring the transient X-ray Universe in the multi-messenger era organized by the International Space Science Institute in Beijing (ISSI-BJ) on May 6-7, 2014. Time-domain astronomy will enter a golden era towards the end of this decade with the advent of major facilities across the electromagnetic spectrum and in the multi-messenger realms of gravitational wave and neutrino. In the soft X-ray regime, the novel micro-pore lobster-eye optics provides a promising technology to realise, for the first time, focusing X-ray optics for wide-an…
The rate of image acquisition in modern synoptic imaging surveys has already begun to outpace the feasibility of keeping astronomers in the real-time discovery and classification loop. Here we present the inner workings of a framework, based on machine-learning algorithms, that captures expert training and ground-truth knowledge about the variable and transient sky to automate 1) the process of discovery on image differences and, 2) the generation of preliminary science-type classifications of discovered sources. Since follow-up resources for extracting novel science from fast-changing transie…