David R. Young, Marco Landoni, Stephen J. Smartt, Sergio Campana, Riccardo Claudi, Pietro Schipani, Matteo Aliverti, Andrea Baruffolo, Sagi Ben-Ami, Federico Bi… 展开作者
David R. Young, Marco Landoni, Stephen J. Smartt, Sergio Campana, Riccardo Claudi, Pietro Schipani, Matteo Aliverti, Andrea Baruffolo, Sagi Ben-Ami, Federico Biondi, Giulio Capasso, Rosario Cosentino, Francesco D'Alessio, Paolo D'Avanzo, Ofir Hershko, Hanindyo Kuncarayakti, Matteo Munari, Giuliano Pignata, Adam Rubin, Salvatore Scuderi, Fabrizio Vitali, Jani Achrén, José Antonio Araiza-Duran, Iair Arcavi, Anna Brucalassi, Rachel Bruch, Enrico Cappellaro, Mirko Colapietro, Massimo Della Valle, Marco De Pascale, Rosario Di Benedetto, Sergio D'Orsi, Avishay Gal-Yam, Matteo Genoni, Marcos Hernandez, Jari Kotilainen, Gianluca Li Causi, Seppo Mattila, Michael Rappaport, Kalyan Radhakrishnan, Davide Ricci, Marco Riva, Bernardo Salasnich, Ricardo Zanmar Sanchez, Maximilian Stritzinger, Hector Ventura
The SOXS is a dual-arm spectrograph (UV-VIS & NIR) and AC due to mounted on the ESO 3.6m NTT in La Silla. Designed to simultaneously cover the optical and NIR wavelength range from 350-2050 nm, the instrument will be dedicated to the study of transient and variable events with many Target of Opportunity requests expected.
The goal of the SOXS Data Reduction pipeline is to use calibration data to remove all instrument signatures from the SOXS scientific data frames for each of the supported instrument modes, convert this data into physical units and deliver them with their associated error bars to the ESO SAF as Phase 3 compliant science data products, all within 30 minutes. The primary reduced product will be a detrended, wavelength and flux calibrated, telluric corrected 1D spectrum with UV-VIS + NIR arms stitched together. The pipeline will also generate QC metrics to monitor telescope, instrument and detector health.
The pipeline is written in Python 3 and has been built with an agile development philosophy that includes adaptive planning and evolutionary development. The pipeline is to be used by the SOXS consortium and the general user community that may want to perform tailored processing of SOXS data. Test driven development has been used throughout the build using `extreme' mock data. We aim for the pipeline to be easy to install and extensively and clearly documented.
We present the development of the End-to-End simulator for the SOXS instrument at the ESO-NTT 3.5-m telescope. SOXS will be a spectroscopic facility, made by two arms high efficiency spectrographs, able to cover the spectral range 350-2000 nm with resolving power R=4500. The E2E model allows to simulate the propagation of photons starting from the scientific target of interest up to the detectors. The outputs of the simulator are synthetic frames, which will be mainly exploited for optimizing the pipeline development and possibly assisting for proper alignment and integration phases in laborat…
The Son-Of-XShooter (SOXS) is a single object spectrograph (UV-VIS & NIR) and acquisition camera scheduled to be mounted on the ESO 3.58-m New Technology Telescope at the La Silla Observatory. Although the underlying data reduction processes to convert raw detector data to fully-reduced science ready data are complex and multi-stepped, we have designed the SOXS Data Reduction pipeline with the core aims of providing end-users with a simple-to-use, well-documented command-line interface while also allowing the pipeline to be run in a fully automated state; streaming reduced data into the ESO Sc…
We present the progresses of the simulation tools, the Exposure Time Calculator (ETC) and End-to-End simulator (E2E), for the Son Of X-Shooter (SOXS) instrument at the ESO-NTT 3.58-meter telescope. The SOXS will be a single object spectroscopic facility, made by a two-arms high-efficiency spectrograph, able to cover the spectral range 350-2000 nanometer with a mean resolving power R$\approx$4500. While the purpose of the ETC is the estimate, to the best possible accuracy, of the Signal-to-Noise ratio (SNR), the E2E model allows us to simulate the propagation of photons, starting from the scien…
A fully autonomous data reduction pipeline has been developed for FRODOSpec, an optical fibre-fed integral field spectrograph currently in use at the Liverpool Telescope. This paper details the process required for the reduction of data taken using an integral field spectrograph and presents an overview of the computational methods implemented to create the pipeline. Analysis of errors and possible future enhancements are also discussed.
ORAC-DR is a general purpose data reduction pipeline system designed to be instrument and observatory agnostic. The pipeline works with instruments as varied as infrared integral field units, imaging arrays and spectrographs, and sub-millimeter heterodyne arrays & continuum cameras. This paper describes the architecture of the pipeline system and the implementation of the core infrastructure. We finish by discussing the lessons learned since the initial deployment of the pipeline system in the late 1990s.
We describe the new spectroscopic data reduction pipeline for the multi-object MMT/Magellan Infrared Spectrograph. The pipeline is implemented in idl as a stand-alone package and is publicly available in both stable and development versions. We describe novel algorithms for sky subtraction and correction for telluric absorption. We demonstrate that our sky subtraction technique reaches the Poisson limit set by the photon statistics. Our telluric correction uses a hybrid approach by first computing a correction function from an observed stellar spectrum, and then differentially correcting it us…
We developed a high-speed image reduction pipeline using Graphics Processing Units (GPUs) as hardware accelerators. Astronomers desire detecting EM counterpart of gravitational-wave sources as soon as possible for sharing positional information to organize systematic follow-up observations. Therefore, high-speed image processing is important. We developed a new image reduction pipeline for our robotic telescope system, which uses a GPU via a Python package CuPy to achieve high-speed image processing. As a result, the processing speed was increased by more than a factor of forty to that of the …
We describe principal components of the new spectroscopic data pipeline for the multi-object MMT/Magellan Infrared Spectrograph (MMIRS). The pipeline is implemented in IDL and C++. The performance of the data processing algorithms is sufficient to reduce a single dataset in 2--3 min on a modern PC workstation so that one can use the pipeline as a quick-look tool during observations. We provide an example of the spectral data processed by our pipeline and demonstrate that the sky subtraction quality gets close to the limits set by the Poisson photon statistics.
The Colorado Ultraviolet Transit Experiment (CUTE) is a 6U NASA CubeSat carrying a low-resolution (R ~3000), near-ultraviolet (255 - 330nm) spectrograph fed by a rectangular primary Cassegrain. CUTE, is planned for launch in spring 2020 and it will monitor transiting extra-solar planets to study atmospheric escape. We present here the CUTE data simulator, which is a versatile tool easily adaptable to any other mission performing single-slit spectroscopy and carrying on-board a CCD detector. We complemented the data simulator with a data reduction pipeline capable of performing a rough reductio…
We present a newly, fully automated, data pipeline: Solvepol, designed to reduce and analyze polarimetric data. It has been optimized for imaging data from the Instituto de Astronomia, Geofisica e Ciencias Atmosfericas (IAG) of the University of Sao Paulo (USP), calcite Savart prism plate-based IAGPOL polarimeter. Solvepol is also the basis of a reduction pipeline for the wide-field optical polarimeter that will execute SOUTH POL, a survey of the polarized Southern sky. Solvepol was written using the interactive data language (IDL) and is based on the image reduction and analysis facility (IRA…
We present PyWiFeS, a new Python-based data reduction pipeline for the Wide Field Spectrograph (WiFeS). PyWiFeS consists of a series of core data processing routines built on standard scientific Python packages commonly used in astronomical applications. Included in PyWiFeS is an implementation of a new global optical model of the spectrograph which provides wavelengths solutions accurate to $\sim$0.05 Å (RMS) across the entire detector. The core PyWiFeS package is designed to be scriptable to enable batch processing of large quantities of data, and we present a default format for handling of …
We introduce a data reduction package written in Interactive Data Language (IDL) for the Magellan Echellete Spectrograph (MAGE). MAGE is a medium-resolution (R ~4100), cross-dispersed, optical spectrograph, with coverage from ~3000-10000 Angstroms. The MAGE Spectral Extractor (MASE) incorporates the entire image reduction and calibration process, including bias subtraction, flat fielding, wavelength calibration, sky subtraction, object extraction and flux calibration of point sources. We include examples of the user interface and reduced spectra. We show that the wavelength calibration is suff…
The recently released Reflex scientific workflow environment supports the interactive execution of ESO VLT data reduction pipelines. Reflex is based upon the Kepler workflow engine, and provides components for organising the data, executing pipeline recipes based on the ESO Common Pipeline Library, invoking Python scripts, and constructing interaction loops. Reflex will greatly enhance the quick validation and reduction of the scientific data. In this paper we summarize the main features of Reflex, and demonstrate as an example its application to the reduction of echelle UVES data.
The Combined Array for Millimeter-wave Astronomy (CARMA) data reduction pipeline (CADRE) has been developed to give investigators a first look at a fully reduced set of their data. It runs automatically on all data produced by the telescope as they arrive in the CARMA data archive. CADRE is written in Python and uses Python wrappers for MIRIAD subroutines for direct access to the data. It goes through the typical reduction procedures for radio telescope array data and produces a set of continuum and spectral line maps in both MIRIAD and FITS format. CADRE has been in production for nearly two …
Users of the Atacama Large Millimeter/submillimeter Array (ALMA) are provided with calibration and imaging products in addition to raw data. In Cycle 0 and Cycle 1, these products are produced by a team of data reduction experts spread across Chile, East Asia, Europe, and North America. This article discusses the lines of communication between the data reducers and ALMA users that enable this model of distributed data reduction. This article also discusses the calibration and imaging scripts that have been provided to ALMA users in Cycles 0 and 1, and what will be different in future Cycles.
The Galactic O-Star Spectroscopic Survey (GOSSS) is an ambitious project that is observing all known Galactic O stars with B < 13 in the blue-violet part of the spectrum with R-2500. It is based on version 2 of the most complete catalog to date of Galactic O stars with accurate spectral types (v1, Maíz Apellániz et al. 2004 ;v2, Sota et al. 2008). Given the large amount of data that we are getting (more than 150 nights of observations at three different observatories in the last 4 years) we have developed an automatic spectroscopic reduction pipeline. This pipeline has been programmed in IDL a…
PypeIt is a Python package for semi-automated reduction of astronomical, spectroscopic data. Its algorithms build on decades-long development of previous data reduction pipelines by the developers (Bernstein, Burles, & Prochaska, 2015; Bochanski et al., 2009). The reduction procedure -- including a complete list of the input parameters and available functionality -- is provided as online documentation hosted by Read the Docs, which is regularly updated. (https://pypeit.readthedocs.io/en/latest/). Release v1.0.3 serves the following spectrographs: Gemini/GNIRS, Gemini/GMOS, Gemini/FLAMINGOS 2, …
MeerKATHI is the current development name for a radio-interferometric data reduction pipeline, assembled by an international collaboration. We create a publicly available end-to-end continuum- and line imaging pipeline for MeerKAT and other radio telescopes. We implement advanced techniques that are suitable for producing high-dynamic-range continuum images and spectroscopic data cubes. Using containerization, our pipeline is platform-independent. Furthermore, we are applying a standardized approach for using a number of different of advanced software suites, partly developed within our group.…
The Multi Unit Spectroscopic Explorer (MUSE) is an integral-field spectrograph operating in the visible wavelength range, and installed at the Very Large Telescope (VLT). The official MUSE pipeline is available from ESO. However, for the data reduction of the Deep Fields program (Bacon et al., in prep.), we have built a more sophisticated reduction pipeline, with additional reduction tasks, to extend the official pipeline and produce cubes with fewer instrumental residuals.
Written in Python and utilising ParselTongue to interface with the Astronomical Image Processing System (AIPS), the e-MERLIN data reduction pipeline is intended to automate the procedures required in processing and calibrating radio astronomy data from the e-MERLIN correlator. Driven by a plain text file of input parameters, the pipeline is modular and can be run in stages by the user, depending on requirements. The software includes options to load raw data, average in time and/or frequency, flag known sources of interference, flag more comprehensively with SERPent, carry out some or all of t…
The Colorado Ultraviolet Transit Experiment (CUTE) is a 6U NASA CubeSat carrying on-board a low-resolution, near-ultraviolet (2479-3306 A) spectrograph. It has a Cassegrain telescope with a rectangular primary to maximize the collecting area, given the shape of the satellite bus, and an aberration correcting grating to improve the image quality, and thus spectral resolution. CUTE, launched on the 27th of September 2021 to a Low Earth Orbit, is designed to monitor transiting extra-solar planets orbiting bright, nearby stars to improve our understanding of planet atmospheric escape and star-plan…
MUSE, a giant integral field spectrograph, is about to become the newest facility instrument at the VLT. It will see first light in February 2014. Here, we summarize the properties of the instrument as built and outline functionality of the data reduction system, that transforms the raw data that gets recorded separately in 24 IFUs by 4k CCDs, into a fully calibrated, scientifically usable data cube. We then describe recent work regarding geometrical calibration of the instrument and testing of the processing pipeline, before concluding with results of the Preliminary Acceptance in Europe and …
Optimizing one's observing strategy while at the telescope relies on knowing the current observing conditions and the obtained data quality. In particular the latter is not straight forward with current wide-field imagers, such as the WIYN One Degree Imager (ODI), currently consisting of 13 detectors, each of them read out in 64 independent cells. Here we present a fast data reduction software for ODI, optimized for a first data inspection during acquisition at the the telescope, but capable enough for science-quality data reductions. The pipeline is coded in pure python with minimal additiona…
iLocater is a near-infrared (NIR) radial velocity (RV) spectrograph that is being developed for the Large Binocular Telescope in Arizona. Unlike seeing limited designs, iLocater uses adaptive optics to inject starlight directly into a single mode fiber. This feature offers high spectral resolution while simultaneously maintaining a compact optical design. Although this approach shows promise to generate extremely precise RV measurements, it differs from conventional Doppler spectrographs, and therefore carries additional risk. To aid with the design of the instrument, we have developed a compr…
We present the data reduction procedures being used by the GALAH survey, carried out with the HERMES fibre-fed, multi-object spectrograph on the 3.9~m Anglo-Australian Telescope. GALAH is a unique survey, targeting 1 million stars brighter than magnitude V=14 at a resolution of 28,000 with a goal to measure the abundances of 29 elements. Such a large number of high resolution spectra necessitates the development of a reduction pipeline optimized for speed, accuracy, and consistency. We outline the design and structure of the Iraf-based reduction pipeline that we developed, specifically for GAL…
DHARA: Data Handling and Automated Reduction pipeline for AIMPOL
Foundation for Research and Technology - Hellas(希腊研究与技术基金会);Physical Research Laboratory(物理研究实验室);Aryabhatta Research Institute of Observational Sciences(阿亚帕塔观测科学研究所);University of Crete(克里特大学);Maulana Azad National Institute of Technology(莫拉纳·阿扎德国立理工学院)
We present flame, a pipeline for reducing spectroscopic observations obtained with multi-slit near-infrared and optical instruments. Because of its flexible design, flame can be easily applied to data obtained with a wide variety of spectrographs. The flexibility is due to a modular architecture, which allows changes and customizations to the pipeline, and relegates the instrument-specific parts to a single module. At the core of the data reduction is the transformation from observed pixel coordinates (x, y) to rectified coordinates (lambda, gamma). This transformation consists in the polynomi…
FRIDA (inFRared Imager and Dissector for the Adaptative optics system of the GTC) will be a NIR (1-2.5microns) imager and Integral Field Unit spectrograph to operate with the Adaptative Optics system of the 10.4m GTC telescope. FRIDA will offer broad and narrow band diffraction-limited imaging and integral field spectroscopy at low, intermediate and high spectral resolution. The Extragalactic Astrophysics and Astronomical Instrumentation group of the Universidad Complutense de Madrid (GUAIX) is developing the Data Reduction Pipeline for FRIDA. Specific tools for converting output, reduced data…
BlueMUSE is an integral field spectrograph in an early development stage for the ESO VLT. For our design of the data reduction software for this instrument, we are first reviewing capabilities and issues of the pipeline of the existing MUSE instrument. MUSE has been in operation at the VLT since 2014 and led to discoveries published in more than 600 refereed scientific papers. While BlueMUSE and MUSE have many common properties we briefly point out a few key differences between both instruments. We outline a first version of the flowchart for the science reduction, and discuss the necessary ch…
The Array Camera for Optical to Near-IR Spectrophotometry, or ARCONS, is a camera based on Microwave Kinetic Inductance Detectors (MKIDs), a new technology that has the potential for broad application in astronomy. Using an array of MKIDs, the instrument is able to produce time-resolved imaging and low-resolution spectroscopy constructed from detections of individual photons. The arrival time and energy of each photon are recorded in a manner similar to X-ray calorimetry, but at higher photon fluxes. The technique works over a very large wavelength range, is free from fundamental read noise an…
We present the data reduction pipeline, MEAD, for Arizona Lenslets for Exoplanet Spectroscopy (ALES), the first thermal infrared integral field spectrograph designed for high-contrast imaging. ALES is an upgrade of LMIRCam, the $1-5\,μ$m imaging camera for the Large Binocular Telescope, capable of observing astronomical objects in the thermal infrared ($3-5\,μ$m) to produce simultaneous spatial and spectral data cubes. The pipeline is currently designed to perform $L$-band ($2.8-4.2\,μ$m) data cube reconstruction, relying on methods used extensively by current near-infrared integral field spec…
We aim to provide a suite of publicly available spectral data reduction software to facilitate rapid scientific outcomes from time-domain observations. For time resolved observations, an automated pipeline frees astronomers from performance of the routine data analysis tasks to concentrate on interpretation, planning future observations and communication with international collaborators. The project consists of two parts: data processing (ASPIRED) and a graphical user interface (gASPIRED).ASPIREDis written in python 3, and was intentionally developed as a self-consistent reduction pipeline wit…
SOFIA presents a number of interesting challenges for the development of a data reduction environment which, at its initial phase, will have to incorporate pipelines from seven different instruments. Therefore, the SOFIA data reduction software must run code which has been developed in a variety of dissimilar environments which will only increase in future generations of instrumentation. We investigated three distinctly different situations for performing pipelined data reduction in SOFIA: automated data reduction after data archival at the end of a mission, re-pipelining of science data with …
The 4m International Liquid Mirror Telescope (ILMT) installation activities have recently been completed at the Devasthal observatory (Uttarakhand, India). The ILMT will perform continuous observation of a narrow strip of the sky ($\sim$27$'$) passing over the zenith in the SDSS $g'$, $r'$ and $i'$ bands. In combination with a highly efficient 4k $\times$ 4k CCD camera and an optical corrector, the images will be secured at the prime focus of the telescope using the Time Delayed Integration technique. The ILMT will reach $\sim$22.5 mag ($g'$-band) in a single scan and this limiting magnitude c…
OSIRIS is a near-infrared (1.0--2.4 $μ$m) integral field spectrograph operating behind the adaptive optics system at Keck Observatory, and is one of the first lenslet-based integral field spectrographs. Since its commissioning in 2005, it has been a productive instrument, producing nearly half the laser guide star adaptive optics (LGS AO) papers on Keck. The complexity of its raw data format necessitated a custom data reduction pipeline (DRP) delivered with the instrument in order to iteratively assign flux in overlapping spectra to the proper spatial and spectral locations in a data cube. Oth…
Quality Assessment of Spectroscopic Data Reduction Pipelines Using Artificial Intelligence: Scrutinizing Data Release 2 from the DESI Survey
Universidad de los Andes(安第斯大学);Tecnológico de Monterrey, Escuela de Ingeniería y Ciencias(蒙特雷理工学院,工程与科学学院);Lawrence Berkeley National Laboratory(劳伦斯伯克利国家实验室);University of Toronto(多伦多大学);University of Pittsburgh(匹兹堡大学)
We present our implementation of an automated VLBI data reduction pipeline dedicated to interferometric data imaging and analysis. The pipeline can handle massive VLBI data efficiently which makes it an appropriate tool to investigate multi-epoch multiband VLBI data. Compared to traditional manual data reduction, our pipeline provides more objective results since less human interference is involved. Source extraction is done in the image plane, while deconvolution and model fitting are done in both the image plane and the uv plane for parallel comparison. The output from the pipeline includes …
We present The MKID Pipeline, a general use science data pipeline for the reduction and analysis of ultraviolet, optical and infrared (UVOIR) Microwave Kinetic Inductance Detector (MKID) data sets. This paper provides an introduction to the nature of MKID data sets, an overview of the calibration steps included in the pipeline, and an introduction to the implementation of the software.
We describe the data reduction pipeline and control system for the RoboPol project. The RoboPol project is monitoring the optical $R$-band magnitude and linear polarization of a large sample of active galactic nuclei that is dominated by blazars. The pipeline calibrates and reduces each exposure frame, producing a measurement of the magnitude and linear polarization of every source in the $13'\times 13'$ field of view. The control system combines a dynamic scheduler, real-time data reduction, and telescope automation to allow high-efficiency unassisted observations.
This manuscript describes the design, usage, and data-reduction pipeline developed for the Magellan Inamori Kyocera Echelle (MIKE) spectrometer used with the Magellan telescope at the Las Campanas Observatory. We summarize the basic characteristics of the instrument and discuss observational procedures recommended for calibrating the standard data products. We detail the design and implementation of an IDL based data-reduction pipeline for MIKE data (since generalized to other echelle spectrometers, e.g. Keck/HIRES, VLT/UVES). This includes novel techniques for flat-fielding, wavelength calibr…
We present GRAPHIC, a new angular differential imaging (ADI) reduction pipeline where all geometric image operations are based on Fourier transforms. To achieve this goal the entire pipeline is parallelised making it possible to reduce large amounts of observation data without the need to bin the data. The specific rotation and shift algorithms based on Fourier transforms are described and performance comparison with conventional interpolation algorithm are given. Tests using fake companions injected in real science frames demonstrate the significant gain obtained by using geometric operations…
In this paper we review THELI (Erben & Schrimer, 2005), an image processing pipeline developed to reduce multi-pointing optical images taken by mosaic CCD cameras. This pipeline works on raw images by removing several instrumental contaminations, implementing photometric calibration and astrometric alignment, and constructing a deep co-added mosaic image complemented by a weight map. We demonstrate the procedure of reducing NGC3923 images from raw data to the final results. We also demonstrate the quality of our data reduction strategy using mag-count and mag-error in mag plots. Emphasis is ma…
Data reduction pipeline for the SuMAC millimeter-wave spectrometer at the LMT
Boston University(波士顿大学);Cardiff University(卡迪夫大学);California Institute of Technology(加州理工学院);Jet Propulsion Laboratory(喷气推进实验室);Instituto Nacional de Astrofísica, Óptica y Electrónica(国家天文学、光学和电子学研究所);The University of Chicago(芝加哥大学);University of California Santa Barbara(加州大学圣塔芭芭拉分校);Dalhousie University(达尔豪斯大学)
KMTNet Synoptic Survey of Southern Sky II: Data Reduction and Real-Time Transient Detection Pipeline
Seoul National University(首尔大学);Daegu National Science Museum(大邱国立科学博物馆);Korea Astronomy and Space Science Institute(韩国天文学与空间科学研究院);University of Hawaii(夏威夷大学)
本文介绍KMTNet南天全景巡天数据释放1的图像处理流水线,涵盖数据质量保证、天体测量、光度零点校准等核心方法,实现亚像素精度的天体测量和22-23 AB mag的5西格玛深度。
Echelle spectrographs with their high resolution plays important role in determination of characteristics of stellar lines. Wide field of applications is focused mainly on the measurements of precise radial velocity applied in exoplanetary research. In my diploma thesis I am concentrated on the calibration of the Ondřejov Echelle Spectrograph at Astronomical Institute of the Czech Academy of Sciences. My role was to investigate the wide field of opportunities how to process the data with the best possible results. Successful reduction was performed by both Image Reduction and Analysis Facility…
We present the data reduction pipeline for the Hi-GAL survey. Hi-GAL is a key project of the Herschel satellite which is mapping the inner part of the Galactic plane (|l| <= 70\cdot and |b| <= 1\cdot), using 2 PACS and 3 SPIRE frequency bands, from 70μm to 500μm. Our pipeline relies only partially on the Herschel Interactive Standard Environment (HIPE) and features several newly developed routines to perform data reduction, including accurate data culling, noise estimation and minimum variance map-making, the latter performed with the ROMAGAL algorithm, a deep modification of the ROMA code alr…
I present and summarize a software package ("LPipe") for completely automated, end-to-end reduction of both bright and faint sources with the Low-Resolution Imaging Spectrometer (LRIS) at Keck Observatory. It supports all gratings, grisms, and dichroics, and also reduces imaging observations, although it does not include multislit or polarimetric reduction capabilities at present. It is suitable for on-the-fly quicklook reductions at the telescope, for large-scale reductions of archival data-sets, and (in many cases) for science-quality post-run reductions of PI data. To demonstrate its capabi…
SIPGI is a spectroscopic pipeline for the data reduction of optical/near-infrared data acquired by slit-based spectrographs. SIPGI is a complete spectroscopic data reduction environment retaining the high level of flexibility and accuracy typical of the standard "by-hand" reduction methods but with a significantly higher level of efficiency. This is obtained exploiting three main concepts: 1) a built-in data organiser to classify the data, together with a graphical interface; 2) the instrument model (analytic description of the main calibration relations); 3) the design and flexibility of the …
phoptic -- a Python package for reducing astronomical images
School of Physics and Astronomy University of Southampton(南安普顿大学物理与天文学学院);Department of Physics University of Warwick(华威大学物理系);Fluid and Complex Systems Centre Coventry University(考文垂大学流体与复杂系统中心);Instituto de Astronomía Universidad Nacional Autónoma de México(墨西哥国立自治大学天文研究所);Universidad Nacional de Córdoba Observatorio Astronómico de Córdoba(科尔多瓦国立大学科尔多瓦天文台);Consejo Nacional de Investigaciones Científicas y Téchnicas (CONICET)(国家科学研究委员会);ComplyAdvantage;SUPA Physics and Astronomy University of St Andrews(圣安德鲁斯大学物理学与天文学)
This paper describes the software DRAGraces (Data Reduction and Analysis for GRACES), which is a pipeline reducing spectra from GRACES (Gemini Remote Access to the CFHT ESPaDOnS Spectrograph) at the Gemini North Telescope. The code is written in the IDL language. It is designed to find all the GRACES frames in a given directory, automatically determine the list of bias, flat, arc and science frames, and perform the whole reduction and extraction within a few minutes. We compare the output from DRAGraces with that of OPERA, a pipeline developed at CFHT that also can extract GRACES spectra. Both…
A fast-turnaround pipeline for realtime data reduction plays an essential role in discovering and permitting follow-up observations to young supernovae and fast-evolving transients in modern time-domain surveys. In this paper, we present the realtime image subtraction pipeline in the intermediate Palomar Transient Factory. By using high-performance computing, efficient database, and machine learning algorithms, this pipeline manages to reliably deliver transient candidates within ten minutes of images being taken. Our experience in using high performance computing resources to process big data…