The Euclid satellite is an ESA mission scheduled for launch in September 2023. To optimally perform critical stages of the data reduction, such as object detection and morphology determination, a new and modern software package was required. We have developed SourceXtractor++ as open source software for detecting and measuring sources in astronomical images. It is a complete redesign of the original SExtractor, written mainly in C++. The package follows a modular approach and facilitates the analysis of multiple overlapping sources over many images with different pixel grids. SourceXtractor++ is already operational in many areas of the Euclid processing, and we demonstrate here the capabilities of the current version v0.19 on the basis of a set of typical use cases, which are available for download
The FIBRE-pac (FMOS image-based reduction package) is an IRAF-based reduction tool for the fiber multiple-object spectrograph (FMOS) of the Subaru telescope. To reduce FMOS images, a number of special techniques are necessary because each image contains about 200 separate spectra with airglow emission lines variable in spatial and time domains, and with complicated throughput patterns for the airglow masks. In spite of these features, almost all of the reduction processes except for a few steps are carried out automatically by scripts in text format making it easy to check the commands step by…
The venerable NOD2 data reduction software package for single-dish radio continuum observations, developed for use at the 100-m Effelsberg radio telescope, has been successfully applied over many decades. Modern computing facilities call for a new design. We aim to develop an interactive software tool with a graphical user interface (GUI) for the reduction of single-dish radio continuum maps. Special effort is given on the reduction of distortions along the scanning direction (scanning effects) by combining maps scanned in orthogonal directions or dual- or multiple-horn observations that need …
KMOS is a multi-object near-infrared integral field spectrometer with 24 deployable cryogenic pick-off arms. Inevitably, data processing is a complex task that requires careful calibration and quality control. In this paper we describe all the steps involved in producing science-quality data products from the raw observations. In particular, we focus on the following issues: (i) the calibration scheme which produces maps of the spatial and spectral locations of all illuminated pixels on the detectors; (ii) our concept of minimising the number of interpolations, to the limiting case of a single…
DBSP_DRP is a python package that provides fully automated data reduction of data taken by the Double Spectrograph (DBSP) at the 200-inch Hale Telescope at Palomar Observatory (Oke & Gunn, 1982). The underlying data reduction functionality to extract 1D spectra, perform flux calibration and correction for atmospheric absorption, and coadd spectra together is provided by PypeIt (Prochaska et al., 2020). The new functionality that DBSP_DRP brings is in orchestrating the complex data reduction process by making smart decisions so that no user input is required after verifying the correctness of t…
The Herschel Common Science System (HCSS) (Ott et al. 2006) (Ott & Science Ground Segment Consortium 2010) is a substantial Java software package, accompanying the development of the Herschel Mission (Pilbratt et al. 2010), supporting all of its phases. In particular the reduction of data from the scientific instruments for instrument checkout, calibration, and astronomical analysis is one of its major applications. The data reduction software is split up in modules, called "tasks". Agreed-upon sequences of tasks form pipelines that deliver well defined standard products for storage in a web-a…
We present PyWiFeS, a new Python-based data reduction pipeline for the Wide Field Spectrograph (WiFeS). PyWiFeS consists of a series of core data processing routines built on standard scientific Python packages commonly used in astronomical applications. Included in PyWiFeS is an implementation of a new global optical model of the spectrograph which provides wavelengths solutions accurate to $\sim$0.05 Å (RMS) across the entire detector. The core PyWiFeS package is designed to be scriptable to enable batch processing of large quantities of data, and we present a default format for handling of …
phoptic -- a Python package for reducing astronomical images
School of Physics and Astronomy University of Southampton（南安普顿大学物理与天文学学院）；Department of Physics University of Warwick（华威大学物理系）；Fluid and Complex Systems Centre Coventry University（考文垂大学流体与复杂系统中心）；Instituto de Astronomía Universidad Nacional Autónoma de México（墨西哥国立自治大学天文研究所）；Universidad Nacional de Córdoba Observatorio Astronómico de Córdoba（科尔多瓦国立大学科尔多瓦天文台）；Consejo Nacional de Investigaciones Científicas y Téchnicas (CONICET)（国家科学研究委员会）；ComplyAdvantage；SUPA Physics and Astronomy University of St Andrews（圣安德鲁斯大学物理学与天文学）
ZE3RA is the software package responsible for processing the raw data from the ZEPLIN-III dark matter experiment and its reduction into a set of parameters used in all subsequent analyses. The detector is a liquid xenon time projection chamber with scintillation and electroluminescence signals read out by an array of 31 photomultipliers. The dual range 62-channel data stream is optimised for the detection of scintillation pulses down to a single photoelectron and of ionisation signals as small as those produced by single electrons. We discuss in particular several strategies related to data fi…
We describe a flexible data reduction package for high resolution cross-dispersed echelle data. This open-source package is developed in Python and includes optional GUIs for most of the steps. It does not require any pre-knowledge about the form or position of the echelle-orders. It has been tested on cross-dispersed echelle spectrographs between 13k and 115k resolution (bifurcated fiber-fed spectrogaph ESO-HARPS and single fiber-fed spectrograph TNT-MRES). HiFLEx can be used to determine radial velocities and is designed to use the TERRA package but can also control the radial velocity packa…
Together with the development of the Large APEX Bolometer Camera (LABOCA) for the Atacama Pathfinder Experiment (APEX), a new data reduction package has been written. This software naturally interfaces with the telescope control system, and provides all functionalities for the reduction, analysis and visualization of bolometer data. It is used at APEX for real time processing of observations performed with LABOCA and other bolometer arrays, providing feedback to the observer. Written in an easy-to-script language, BoA is also used offline to reduce APEX continuum data. In this paper, the gener…
We developed a high-speed image reduction pipeline using Graphics Processing Units (GPUs) as hardware accelerators. Astronomers desire detecting EM counterpart of gravitational-wave sources as soon as possible for sharing positional information to organize systematic follow-up observations. Therefore, high-speed image processing is important. We developed a new image reduction pipeline for our robotic telescope system, which uses a GPU via a Python package CuPy to achieve high-speed image processing. As a result, the processing speed was increased by more than a factor of forty to that of the …
New and upgraded radio interferometers produce data at massive rates and will require significant improvements in analysis techniques to reach their promised levels of performance in a routine manner. Until these techniques are fully developed, productivity and accessibility in scientific programming environments will be key bottlenecks in the pipeline leading from data-taking to research results. We present an open-source software package, miriad-python, that allows access to the MIRIAD interferometric reduction system in the Python programming language. The modular design of MIRIAD and the h…
This manuscript describes the design, usage, and data-reduction pipeline developed for the Magellan Inamori Kyocera Echelle (MIKE) spectrometer used with the Magellan telescope at the Las Campanas Observatory. We summarize the basic characteristics of the instrument and discuss observational procedures recommended for calibrating the standard data products. We detail the design and implementation of an IDL based data-reduction pipeline for MIKE data (since generalized to other echelle spectrometers, e.g. Keck/HIRES, VLT/UVES). This includes novel techniques for flat-fielding, wavelength calibr…
We describe the new spectroscopic data reduction pipeline for the multi-object MMT/Magellan Infrared Spectrograph. The pipeline is implemented in idl as a stand-alone package and is publicly available in both stable and development versions. We describe novel algorithms for sky subtraction and correction for telluric absorption. We demonstrate that our sky subtraction technique reaches the Poisson limit set by the photon statistics. Our telluric correction uses a hybrid approach by first computing a correction function from an observed stellar spectrum, and then differentially correcting it us…
Since its launch, TESS has provided high cadence observations for objects across the sky. Although high cadence TESS observations provide a unique possibility to study the rapid time evolution of numerous objects, artifacts in the data make it particularly challenging to use in studying transients. Furthermore, the broadband red filter of TESS, makes calibrating it to physical flux units, or magnitudes, challenging. Here we present TESSreduce an open-source, and user-friendly Python package which is built to lower the barrier to entry for transient science with TESS. In a few commands users ca…
We introduce a data reduction package written in Interactive Data Language (IDL) for the Magellan Echellete Spectrograph (MAGE). MAGE is a medium-resolution (R ~4100), cross-dispersed, optical spectrograph, with coverage from ~3000-10000 Angstroms. The MAGE Spectral Extractor (MASE) incorporates the entire image reduction and calibration process, including bias subtraction, flat fielding, wavelength calibration, sky subtraction, object extraction and flux calibration of point sources. We include examples of the user interface and reduced spectra. We show that the wavelength calibration is suff…
PypeIt is a Python package for semi-automated reduction of astronomical, spectroscopic data. Its algorithms build on decades-long development of previous data reduction pipelines by the developers (Bernstein, Burles, & Prochaska, 2015; Bochanski et al., 2009). The reduction procedure -- including a complete list of the input parameters and available functionality -- is provided as online documentation hosted by Read the Docs, which is regularly updated. (https://pypeit.readthedocs.io/en/latest/). Release v1.0.3 serves the following spectrographs: Gemini/GNIRS, Gemini/GMOS, Gemini/FLAMINGOS 2, …
I present and summarize a software package ("LPipe") for completely automated, end-to-end reduction of both bright and faint sources with the Low-Resolution Imaging Spectrometer (LRIS) at Keck Observatory. It supports all gratings, grisms, and dichroics, and also reduces imaging observations, although it does not include multislit or polarimetric reduction capabilities at present. It is suitable for on-the-fly quicklook reductions at the telescope, for large-scale reductions of archival data-sets, and (in many cases) for science-quality post-run reductions of PI data. To demonstrate its capabi…
The US National Park Service (NPS) assesses the night sky quality over parks by capturing a series of overlapping images to obtain a mosaic view of the entire night sky. The NPS Night Skies Program has integrated a sequence of scripts and software packages (a "pipeline") to process and create the hemispherical mosaic images. This processing pipeline is being improved to reduce dependence on commercial software packages, improve management of revisions, and ease distribution of the latest version. The upgraded pipeline is designed for processing the images in three stages: (I) performing data r…
With the advent of modern multi-detector heterodyne instruments that can result in observations generating thousands of spectra per minute it is no longer feasible to reduce these data as individual spectra. We describe the automated data reduction procedure used to generate baselined data cubes from heterodyne data obtained at the James Clerk Maxwell Telescope. The system can automatically detect baseline regions in spectra and automatically determine regridding parameters, all without input from a user. Additionally it can detect and remove spectra suffering from transient interference effec…
Modelling the broadband emission of jetted active galactic nuclei (AGN) constitutes one of the main research topics of extragalactic astrophysics in the multi-wavelength and multi-messenger domain. We present agnpy, an open-source python package modelling the radiative processes of relativistic particles accelerated in the jets of active galactic nuclei. The package includes classes describing the galaxy components responsible for line and thermal emission and calculates the absorption due to $γγ$ pair production on several photon fields. agnpy aims at extending the effort of modelling and int…
SpectraPy is an Astropy affiliated package for spectroscopic data reduction. It collects algorithms and methods for data reduction of astronomical spectra obtained by through-slits spectrographs. It has been created to fill the gap in Astropy between the already existing data handling libraries and those for spectra analysis. SpectraPy combines Astropy facilities with SAOImageDS9 features, providing a set of tools for spectra calibration and 2D extraction. It starts from raw frames, and using configuration files which describe the optical setup of the instrument, it automatically locates and e…
The direct detection and characterization of planetary and substellar companions at small angular separations is a rapidly advancing field. Dedicated high-contrast imaging instruments deliver unprecedented sensitivity, enabling detailed insights into the atmospheres of young low-mass companions. In addition, improvements in data reduction and PSF subtraction algorithms are equally relevant for maximizing the scientific yield, both from new and archival data sets. We aim at developing a generic and modular data reduction pipeline for processing and analysis of high-contrast imaging data obtaine…
The Tartu Observatory Fiber-fed Echelle Spectrograph (TOFES) Data Reduction Pipeline
Tartu Observatory, University of Tartu（塔尔图大学塔尔图天文台）；Space Research Institute, Austrian Academy of Sciences（奥地利科学院空间研究所）；Institute for Theoretical and Computation Physics, Graz University of Technology（格拉茨工业大学理论与计算物理研究所）；Department of Physics and Astronomy, Uppsala University（乌普萨拉大学物理与天文学系）；Department of Physics and Astronomy, University College London（伦敦大学学院物理与天文学系）；European Southern Observatory（欧洲南方天文台）
pyTANSPEC v1.0 and HxRGproc: Updated packages to Clean and Reduce TANSPEC data
Tata Institute of Fundamental Research（塔塔基础研究所）；University of Hertfordshire（赫特福德大学）；Aryabhatta Research Institute of Observational Sciences（阿耶波多观测科学研究所）
The Palomar Cosmic Web Imager (PCWI) and Keck Cosmic Web Imager (KCWI) are integral-field spectrographs on the Hale 5m telescope at Palomar Observatory and the Keck-2 10m telescope at W. M. Keck Observatory, respectively. In recent years, these instruments have been increasingly used to conduct survey work; in particular focused on the circumgalactic and intergalactic media at high redshift. Extracting faint signals from three-dimensional IFU data is a complex task which can become prohibitively difficult for large samples without the proper tools. We present CWITools, a package written in Pyt…
