Data volumes from multiple sky surveys have grown from gigabytes into terabytes during the past decade, and will grow from terabytes into tens (or hundreds) of petabytes in the next decade. This exponential growth of new data both enables and challenges effective astronomical research, requiring new approaches. Thus far, astronomy has tended to address these challenges in an informal and ad hoc manner, with the necessary special expertise being assigned to e-Science or survey science. However, we see an even wider scope and therefore promote a broader vision of this data-driven revolution in astronomical research. For astronomy to effectively cope with and reap the maximum scientific return from existing and future large sky surveys, facilities, and data-producing projects, we need our own information science specialists. We therefore recommend the formal creation, recognition, and support of a major new discipline, which we call Astroinformatics. Astroinformatics includes a set of naturally-related specialties including data organization, data description, astronomical classification taxonomies, astronomical concept ontologies, data mining, machine learning, visualization, and astrostatistics. By virtue of its new stature, we propose that astronomy now needs to integrate Astroinformatics as a formal sub-discipline within agency funding plans, university departments, research programs, graduate training, and undergraduate education. Now is the time for the recognition of Astroinformatics as an essential methodology of astronomical research. The future of astronomy depends on it.
We describe the application of data mining algorithms to research problems in astronomy. We posit that data mining has always been fundamental to astronomical research, since data mining is the basis of evidence-based discovery, including classification, clustering, and novelty discovery. These algorithms represent a major set of computational tools for discovery in large databases, which will be increasingly essential in the era of data-intensive astronomy. Historical examples of data mining in astronomy are reviewed, followed by a discussion of one of the largest data-producing projects anti…
This Astro2020 State of the Profession Consideration White Paper highlights the growth of astrostatistics and astroinformatics in astronomy, identifies key issues hampering the maturation of these new subfields, and makes recommendations for structural improvements at different levels that, if acted upon, will make significant positive impacts across astronomy.
The tens of millions of radio sources to be detected with next-generation surveys pose new challenges, quite apart from the obvious ones of processing speed and data volumes. For example, existing algorithms are inadequate for source extraction or cross-matching radio and optical/IR sources, and a new generation of algorithms are needed using machine learning and other techniques. The large numbers of sources enable new ways of testing astrophysical models, using a variety of "large-n astronomy" techniques such as statistical redshifts. Furthermore, while unexpected discoveries account for som…
Astronomy, as many other scientific disciplines, is facing a true data deluge which is bound to change both the praxis and the methodology of every day research work. The emerging field of astroinformatics, while on the one end appears crucial to face the technological challenges, on the other is opening new exciting perspectives for new astronomical discoveries through the implementation of advanced data mining procedures. The complexity of astronomical data and the variety of scientific problems, however, call for innovative algorithms and methods as well as for an extreme usage of ICT techn…
Over the past century, major advances in astronomy and astrophysics have been largely driven by improvements in instrumentation and data collection. With the amassing of high quality data from new telescopes, and especially with the advent of deep and large astronomical surveys, it is becoming clear that future advances will also rely heavily on how those data are analyzed and interpreted. New methodologies derived from advances in statistics, computer science, and machine learning are beginning to be employed in sophisticated investigations that are not only bringing forth new discoveries, bu…
In the last years, Astroinformatics has become a well defined paradigm for many fields of Astronomy. In this work we demonstrate the potential of a multidisciplinary approach to identify globular clusters (GCs) in the Fornax cluster of galaxies taking advantage of multi-band photometry produced by the VLT Survey Telescope using automatic self-adaptive methodologies. The data analyzed in this work consist of deep, multi-band, partially overlapping images centered on the core of the Fornax cluster. In this work we use a Neural-Gas model, a pure clustering machine learning methodology, to approac…
This project outlines the complete development of a variable star classification algorithm methodology. With the advent of Big-Data in astronomy, professional astronomers are left with the problem of how to manage large amounts of data, and how this deluge of information can be studied in order to improve our understanding of the universe. While our focus will be on the development of machine learning methodologies for the identification of variable star type based on light curve data and associated information, one of the goals of this work is the acknowledgment that the development of a true…
We describe here the parallels in astronomy and earth science datasets, their analyses, and the opportunities for methodology transfer from astroinformatics to geoinformatics. Using example of hydrology, we emphasize how meta-data and ontologies are crucial in such an undertaking. Using the infrastructure being designed for EarthCube - the Virtual Observatory for the earth sciences - we discuss essential steps for better transfer of tools and techniques in the future e.g. domain adaptation. Finally we point out that it is never a one-way process and there is enough for astroinformatics to lear…
The Next Generation Virgo Cluster Survey is a 104 square degree survey of the Virgo Cluster, carried out using the MegaPrime camera of the Canada-France-Hawaii telescope, from semesters 2009A-2012A. The survey will provide coverage of this nearby dense environment in the universe to unprecedented depth, providing profound insights into galaxy formation and evolution, including definitive measurements of the properties of galaxies in a dense environment in the local universe, such as the luminosity function. The limiting magnitude of the survey is g_AB = 25.7 (10 sigma point source), and the 2 …
The exponential growth of astronomical data collected by both ground based and space borne instruments has fostered the growth of Astroinformatics: a new discipline laying at the intersection between astronomy, applied computer science, and information and computation (ICT) technologies. At the very heart of Astroinformatics is a complex set of methodologies usually called Data Mining (DM) or Knowledge Discovery in Data Bases (KDD). In the astronomical domain, DM/KDD are still in a very early usage stage, even though new methods and tools are being continuously deployed in order to cope with t…
In the distant past, astronomy was often intertwined with religion into a unified cosmos. As science became a distinct cultural enterprise, astronomy has witnessed a variety of rich interactions with other fields. Mathematical statistics was stimulated in the 19th century by astronomical problems, and today astrostatistics is a small but growing cross-disciplinary field advancing methodology to address challenges in astronomical data analysis. Throughout the 20th century, astronomy became closely allied with physics such that astronomy and astrophysics are now profoundly intertwined. Physical …
In the last decade a new generation of telescopes and sensors has allowed the production of a very large amount of data and astronomy has become, a data-rich science; this transition is often labeled as: "data revolution" and "data tsunami". The first locution puts emphasis on the expectations of the astronomers while the second stresses, instead, the dramatic problem arising from this large amount of data: which is no longer computable with traditional approaches to data storage, data reduction and data analysis. In a new, age new instruments are necessary, as it happened in the Bronze age wh…
The historical development of ground based astronomical telescopes leads us to expect that space-based astronomical telescopes will need to be operational for many decades. The exchange of scientific instruments in space will be a prerequisite for the long lasting scientific success of such missions. Operationally, the possibility to repair or replace key spacecraft components in space will be mandatory. We argue that these requirements can be fulfilled with robotic missions and see the development of the required engineering as the main challenge. Ground based operations, scientifically and t…
Gerbert of Aurillac was the most prominent personality of the tenth century: astronomer, organ builder and music theoretician, mathematician, philosopher, and finally pope with the name of Silvester II (999-1003). Gerbert introduced firstly the arabic numbers in Europe, invented an abacus for speeding the calculations and found a rational approximation for the equilateral triangle area, in the letter to Adelbold here discussed. Gerbert described a semi-sphere to Constantine of Fleury with built-in sighting tubes, used for astronomical observations. The procedure to identify the star nearest to…
As the oldest science common to all human cultures, astronomy has a unique connection to indigenous knowledge (IK) and the long history of indigenous scientific contributions. Many STEM disciplines, agencies and institutions have begun to do the work of recruiting and retaining underrepresented minorities, including indigenous, Native American and Native Hawaiian professionals. However, with the expansion of telescope facilities on sacred tribal or indigenous lands in recent decades, and the current urgency of global crises related to climate, food/water sovereignty and the future of humanity,…
PESIT South Campus（PESIT南校区）；Jain University（贾因大学）
Astroinformatics is a new impact area in the world of astronomy, occasionally called the final frontier, where several astrophysicists, statisticians and computer scientists work together to tackle various data intensive astronomical problems. Exponential growth in the data volume and increased complexity of the data augments difficult questions to the existing challenges. Classical problems in Astronomy are compounded by accumulation of astronomical volume of complex data, rendering the task of classification and interpretation incredibly laborious. The presence of noise in the data makes ana…
Perhaps more than other physical sciences, astronomy is frequently statistical in nature. The objects under study are inaccessible to direct manipulation in the laboratory, so the astronomer is restricted to observing a few external characteristics and inferring underlying properties and physics. Astronomy played a profound role in the historical development of statistics from the ancient Greeks through the 19th century. But the fields drifted apart in the 20th century as astronomy turned towards astrophysics and statistics towards human affairs. Today we see a resurgence in astrostatistical a…
This paper is based on the 100 most cited papers in astronomy for each year from 2000 to 2009 and from 1995 and 1990. The main findings are: The total number of authors of the top 100 articles per year has more than tripled. This is seen most strongly in papers with more than 6 authors. The yearly number of papers with 5 or fewer authors has declined over the same time period. The most highly cited papers tend to have the largest number of authors and visa versa. The distribution of normalized citation counts versus ranking is constant from year to year except for the top ranked half dozen or …
Astronomical observations already produce vast amounts of data through a new generation of telescopes that cannot be analyzed manually. Next-generation telescopes such as the Large Synoptic Survey Telescope and the Square Kilometer Array are planned to become operational in this decade and the next, and will increase the data volume by many orders of magnitude. The increased spatial, temporal and spectral resolution afford a powerful magnifying lens on the physical processes that underlie the data but, at the same time, generate unprecedented complexity hard to exploit for knowledge extraction…
The Atacama Large Millimeter/submillimeter Array with the planned electronic upgrades will deliver an unprecedented amount of deep and high resolution observations. Wider fields of view are possible with the consequential cost of image reconstruction. Alternatives to commonly used applications in image processing have to be sought and tested. Advanced image reconstruction methods are critical to meet the data requirements needed for operational purposes. Astrostatistics and astroinformatics techniques are employed. Evidence is given that these interdisciplinary fields of study applied to synth…
National Research Council Herzberg Institute of Astrophysics（加拿大国家研究委员会赫兹伯格天体物理研究所）
Astronomy is increasingly encountering two fundamental truths: (1) The field is faced with the task of extracting useful information from extremely large, complex, and high dimensional datasets; (2) The techniques of astroinformatics and astrostatistics are the only way to make this tractable, and bring the required level of sophistication to the analysis. Thus, an approach which provides these tools in a way that scales to these datasets is not just desirable, it is vital. The expertise required spans not just astronomy, but also computer science, statistics, and informatics. As a computer sc…
Radio astronomy commenced in earnest after World War II, with Australia keenly engaged through the Council for Scientific and Industrial Research. At this juncture, Australia's Commonwealth Solar Observatory expanded its portfolio from primarily studying solar phenomena to conducting stellar and extragalactic research. Subsequently, in the 1950s and 1960s, astronomy gradually became taught and researched in Australian universities. However, most scientific publications from this era of growth and discovery have no country of affiliation in their header information, making it hard to find the A…
The large-scale surveys such as PTF, CRTS and Pan-STARRS-1 that have emerged within the past 5 years or so employ digital databases and modern analysis tools to accentuate research into Time Domain Astronomy (TDA). Preparations are underway for LSST which, in another 6 years, will usher in the second decade of modern TDA. By that time the Digital Access to a Sky Century @ Harvard (DASCH) project will have made available to the community the full sky Historical TDA database and digitized images for a century (1890--1990) of coverage. We describe the current DASCH development and some initial re…
Why study astronomy, why teach astronomy? We give answers to these fundamental questions based on our experience with the Astronomical Camp "Beli Brezi" (White Aspens; Kardzhali, Bulgaria). It has been a place for teaching astronomy to high schools kids for nearly half a century. We describe shortly the history of the camp and draw some conclusions based on nearly five decades of experience. Major among them is that the camp has gone further than just distributing astronomical knowledge - while this is an important and worthy task, the main achievement has been the cultivation of critical thin…
Millennium Institute of Astrophysics（千禧天体物理研究所）；Universidad de Chile（智利大学）；Harvard University（哈佛大学）；University of Florida（佛罗里达大学）；Universidad de los Andes（智利洛斯安第斯大学）
Time-domain astronomy (TDA) is facing a paradigm shift caused by the exponential growth of the sample size, data complexity and data generation rates of new astronomical sky surveys. For example, the Large Synoptic Survey Telescope (LSST), which will begin operations in northern Chile in 2022, will generate a nearly 150 Petabyte imaging dataset of the southern hemisphere sky. The LSST will stream data at rates of 2 Terabytes per hour, effectively capturing an unprecedented movie of the sky. The LSST is expected not only to improve our understanding of time-varying astrophysical objects, but al…
We describe the development of a system for an automated, iterative, real-time classification of transient events discovered in synoptic sky surveys. The system under development incorporates a number of Machine Learning techniques, mostly using Bayesian approaches, due to the sparse nature, heterogeneity, and variable incompleteness of the available data. The classifications are improved iteratively as the new measurements are obtained. One novel feature is the development of an automated follow-up recommendation engine, that suggest those measurements that would be the most advantageous in t…
As our capacity to study ever-expanding domains of our science has increased (including the time domain, non-electromagnetic phenomena, magnetized plasmas, and numerous sky surveys in multiple wavebands with broad spatial coverage and unprecedented depths), so have the horizons of our understanding of the Universe been similarly expanding. This expansion is coupled to the exponential data deluge from multiple sky surveys, which have grown from gigabytes into terabytes during the past decade, and will grow from terabytes into Petabytes (even hundreds of Petabytes) in the next decade. With this …
Satanandacharya the astronomer and mathematician of 11th century was born in 1068 C.E. at Purusottamdham Puri of Odisha wrote the scripture Bhasvati in 1099 C.E.. The scripture has significant contribution to world of Astronomy and Mathematics. Satananda has adopted centisimal system for the calculation of position and motion of heavenly bodies, which is similar to present day decimal system. The treaties got the recognition of a scripture of Karana grantha. Commentaries of this work has been made by defferent persons during different time of history. Though it is found to be remade in almost …
Sky surveys represent a fundamental data basis for astronomy. We use them to map in a systematic way the universe and its constituents, and to discover new types of objects or phenomena. We review the subject, with an emphasis on the wide-field imaging surveys, placing them in a broader scientific and historical context. Surveys are the largest data generators in astronomy, propelled by the advances in information and computation technology, and have transformed the ways in which astronomy is done. We describe the variety and the general properties of surveys, the ways in which they may be qua…
Space Telescope Science Institute（空间望远镜科学研究所）；Oxford University（牛津大学）；University of Minnesota（明尼苏达大学）；University of Nottingham（诺丁汉大学）
The contributions of everyday individuals to significant research has grown dramatically beyond the early days of classical birdwatching and endeavors of amateurs of the 19th century. Now people who are casually interested in science can participate directly in research covering diverse scientific fields. Regarding astronomy, volunteers, either as individuals or as networks of people, are involved in a variety of types of studies. Citizen Science is intuitive, engaging, yet necessarily robust in its adoption of sci-entific principles and methods. Herein, we discuss Citizen Science, focusing on…
For centuries, the rich nocturnal environment of the starry sky could be modelled only by analogue tools such as paper planispheres, atlases, globes and numerical tables. The immersive sky simulator of the twentieth century, the optomechanical planetarium, provided new ways for representing and teaching about the sky, but the high construction and running costs meant that they have not become common. However, in recent decades, "desktop planetarium programs" running on personal computers have gained wide attention. Modern incarnations are immensely versatile tools, mostly targeted towards the …
High-volume feature-rich data sets are becoming the bread-and-butter of 21st century astronomy but present significant challenges to scientific discovery. In particular, identifying scientifically significant relationships between sets of parameters is non-trivial. Similar problems in biological and geosciences have led to the development of systems which can explore large parameter spaces and identify potentially interesting sets of associations. In this paper, we describe the application of automated discovery systems of relationships to astronomical data sets, focussing on an evolutionary p…
Modern astronomy has been rapidly increasing our ability to see deeper into the universe, acquiring enormous samples of cosmic populations. Gaining astrophysical insights from these datasets requires a wide range of sophisticated statistical and machine learning methods. Long-standing problems in cosmology include characterization of galaxy clustering and estimation of galaxy distances from photometric colors. Bayesian inference, central to linking astronomical data to nonlinear astrophysical models, addresses problems in solar physics, properties of star clusters, and exoplanet systems. Likel…
Expanding upon Pimbblet's informative 2011 analysis of career h-indices for members of the Astronomical Society of Australia, we provide additional citation metrics which are geared to a) quantifying the current performance of b) all professional astronomers in Australia. We have trawled the staff web-pages of Australian Universities, Observatories and Research Organisations hosting professional astronomers, and identified 383 PhD-qualified, research-active, astronomers in the nation - 131 of these are not members of the Astronomical Society of Australia. Using the SAO/NASA Astrophysics Data S…
Ground-based optical astronomy necessarily involves sensing the light of astronomical objects along with the contributions of many natural sources ranging from the Earth's atmosphere to cosmological light. In addition, astronomers have long contended with artificial light pollution that further adds to the 'background' against which astronomical objects are seen. Understanding the brightness of the night sky is therefore fundamental to astronomy. The last comprehensive review of this subject was nearly a half-century ago, and we have learned much about both the natural and artificial night sky…
The professional literature provides one means to review the evolution and geographic distribution of the scientific communities engaged in solar and heliospheric physics. With help of the Astrophysics Data System (NASA/ADS), I trace the growth of the research community over the past century from a few dozen researchers early in the 20-th Century to over 4,000 names with over refereed 2,000 publications in recent years, with 90% originating from 20 countries, being published in 90 distinct journals. Overall, the lead authors of these publications have their affiliations for 45% in Europe, 29% …
The last half-century has seen dramatic developments in gamma-ray telescopes, from their initial conception and development through to their blossoming into full maturity as a potent research tool in astronomy. Gamma-ray telescopes are leading research in diverse areas such as gamma-ray bursts, blazars, Galactic transients, and the Galactic distribution of aluminum-26.
About one fifth of Ph.D's across all STEM disciplines secure a tenure track position in academia. It is also the case that science and engineering have evolved significantly and so has the nature of the labor market and the increasingly multidisciplinary nature of the greatest scientific challenges. These realities, however, have not altered the main objective of graduate STEM education: the training of unidisciplinary academic researchers. There is therefore a gap between what the students and society need and what graduate STEM education offers. At root of the problem is not only the lack of…
Astronomy of the 21st century increasingly finds itself with extreme quantities of data. This growth in data is ripe for modern technologies such as deep image processing, which has the potential to allow astronomers to automatically identify, classify, segment and deblend various astronomical objects. In this paper, we explore the use of chained generative adversarial networks (GANs), a class of generative models that learn mappings from latent spaces to data distributions by modelling the joint distribution of the data, to produce physically realistic galaxy images as one use case of such mo…
To flourish in the new data-intensive environment of 21st century science, we need to evolve new skills. These can be expressed in terms of the systemized framework that formed the basis of mediaeval education - the trivium (logic, grammar, and rhetoric) and quadrivium (arithmetic, geometry, music, and astronomy). However, rather than focusing on number, data is the new keystone. We need to understand what rules it obeys, how it is symbolized and communicated and what its relationship to physical space and time is. In this paper, we will review this understanding in terms of the technologies a…
The Surviving Fragment of the Zij-i Malikshahi: A Preliminary Edition, Translation, and Study of the 100-Star Catalogue in BnF Arabe 5968
S. U. Umarov Physical-Technical Institute, National Academy of Sciences of Tajikistan（塔吉克斯坦科学院 S.U. 乌马罗夫物理技术研究所）；Institute of Astrophysics, National Academy of Sciences of Tajikistan（塔吉克斯坦科学院天体物理研究所）
