Data Reduction Pipeline for the CHARIS Integral-Field Spectrograph I: Detector Readout Calibration and Data Cube Extraction
Timothy D. Brandt, Maxime Rizzo, Tyler Groff, Jeffrey Chilcote, Johnny P. Greco, N. Jeremy Kasdin, Mary Anne Limbach, Michael Galvin, Craig Loomis, Gillian Knap… 展开作者
Timothy D. Brandt, Maxime Rizzo, Tyler Groff, Jeffrey Chilcote, Johnny P. Greco, N. Jeremy Kasdin, Mary Anne Limbach, Michael Galvin, Craig Loomis, Gillian Knapp, Michael W. McElwain, Nemanja Jovanovic, Thayne Currie, Kyle Mede, Motohide Tamura, Naruhisa Takato, Masahiko Hayashi
We present the data reduction pipeline for CHARIS, a high-contrast integral-field spectrograph for the Subaru Telescope. The pipeline constructs a ramp from the raw reads using the measured nonlinear pixel response, and reconstructs the data cube using one of three extraction algorithms: aperture photometry, optimal extraction, or $χ^2$ fitting. We measure and apply both a detector flatfield and a lenslet flatfield and reconstruct the wavelength- and position-dependent lenslet point-spread function (PSF) from images taken with a tunable laser. We use these measured PSFs to implement a $χ^2$-based extraction of the data cube, with typical residuals of ~5% due to imperfect models of the undersampled lenslet PSFs. The full two-dimensional residual of the $χ^2$ extraction allows us to model and remove correlated read noise, dramatically improving CHARIS' performance. The $χ^2$ extraction produces a data cube that has been deconvolved with the line-spread function, and never performs any interpolations of either the data or the individual lenslet spectra. The extracted data cube also includes uncertainties for each spatial and spectral measurement. CHARIS' software is parallelized, written in Python and Cython, and freely available on github with a separate documentation page. Astrometric and spectrophotometric calibrations of the data cubes and PSF subtraction will be treated in a forthcoming paper.
We present an analysis of instrument performance using new observations taken with the Coronagraphic High Angular Resolution Imaging Spectrograph (CHARIS) instrument and the Subaru Coronagraphic Extreme Adaptive Optics (SCExAO) system. In a correlation analysis of our datasets (which use the broadband mode covering J through K band in a single spectrum), we find that chromaticity in the SCExAO/CHARIS system is generally worse than temporal stability. We also develop a point spread function (PSF) subtraction pipeline optimized for the CHARIS broadband mode, including a forward modelling-based e…
We describe a new high-contrast imaging capability well suited for studying planet-forming disks: near-infrared (NIR) high-contrast spectropolarimetric imaging with the Subaru Coronagraphic Extreme Adaptive Optics (SCExAO) system coupled with the Coronagraphic High Angular Resolution Imaging Spectrograph (CHARIS) integral field spectrograph (IFS). The advent of extreme adaptive optics (AO) systems, like SCExAO, has enabled recovery of planet-mass companions at the expected locations of gas-giant formation in young disks alongside disk structures (such as gaps or spirals) that may indicate prot…
CHARIS is an IFS designed for imaging and spectroscopy of disks and sub-stellar companions. To improve ease of use and efficiency of science production, we present progress on a fully-automated backend for CHARIS. This Automated Data Extraction, Processing, and Tracking System (ADEPTS) will log data files from CHARIS in a searchable database and perform all calibration and data extraction, yielding science-grade data cubes. The extracted data will also be run through a preset array of post-processing routines. With significant parallelization of data processing, ADEPTS will dramatically reduce…
SCExAO at the Subaru telescope is a visible and near-infrared high-contrast imaging instrument employing extreme adaptive optics and coronagraphy. The instrument feeds the near-infrared light (JHK) to the integral field spectrograph CHARIS. Recently, a Wollaston prism was added to CHARIS' optical path, giving CHARIS a spectropolarimetric capability that is unique among high-contrast imaging instruments. We present a detailed Mueller matrix model describing the instrumental polarization effects of the complete optical path, thus the telescope and instrument. The 22 wavelength bins of CHARIS pro…
We present new, near-infrared (1.1--2.4 $μm$) high-contrast imaging of the bright debris disk surrounding HIP 79977 with the Subaru Coronagraphic Extreme Adaptive Optics system (SCExAO) coupled with the CHARIS integral field spectrograph. SCExAO/CHARIS resolves the disk down to smaller angular separations of (0.11"; $r \sim 14$ au) and at a higher significance than previously achieved at the same wavelengths. The disk exhibits a marginally significant east-west brightness asymmetry in $H$ band that requires confirmation. Geometrical modeling suggests a nearly edge-on disk viewed at a position …
CUBES is the Cassegrain U-Band Efficient Spectrograph, a high-efficiency instrument operating in the UV spectral range between 300nm and 400nm with a resolution not less than 20000. CUBES is to be installed at a Cassegrain focus of the Very Large Telescope of the European Southern Observatory. The paper briefly reviews various types of devices used as dispersing elements in astronomical spectrographs to achieve high resolution, before identifying binary transmission gratings produced by microlithography as the best candidate technology for the CUBES instrument. We describe the lithographic fab…
CUBES: optical design and analysis of the VLT's high-resolution UV spectrograph past final design review
STFC - United Kingdom Astronomy Technology Centre (UK ATC)（英国科学技术设施委员会-英国天文学技术中心）；Durham University - Centre for Advanced Instrumentation - Department of Physics（杜伦大学-先进仪器中心-物理系）；INAF-Osservatorio Astronomico di Brera（意大利国家天体物理研究所-布拉拉天文台）；Optical Lab Baader Planetarium GmbH（巴德尔天文馆有限公司光学实验室）；INAF-Osservatorio Astronomico di Trieste（意大利国家天体物理研究所-的里雅斯特天文台）
We present a new open-source data-reduction pipeline to reconstruct spectral data cubes from raw SPHERE integral-field spectrograph (IFS) data. The pipeline is written in Python and based on the pipeline that was developed for the CHARIS IFS. It introduces several improvements to SPHERE data analysis that ultimately produce significant improvements in postprocessing sensitivity. We first used new data to measure SPHERE lenslet point spread functions (PSFs) at the four laser calibration wavelengths. These lenslet PSFs enabled us to forward-model SPHERE data, to extract spectra using a least-squ…
CUBES (Cassegrain U-Band Efficient Spectrograph) is the recently approved high-efficiency VLT spectrograph aimed to observe the sky in the UV ground-based region (305-400 nm) with a high-resolution mode (~20K) and a low-resolution mode (~5K). In this paper we will briefly describe the requirements and the design of the several software packages involved in the project, namely the instrument control software, the exposure time calculator, the end-to-end simulator, and the data reduction software suite. We will discuss how the above mentioned blocks cooperate to build up a "software ecosystem" f…
A primary goal of direct imaging techniques is to spectrally characterize the atmospheres of planets around other stars at extremely high contrast levels. To achieve this goal, coronagraphic instruments have favored integral field spectrographs (IFS) as the science cameras to disperse the entire search area at once and obtain spectra at each location, since the planet position is not known a priori. These spectrographs are useful against confusion from speckles and background objects, and can also help in the speckle subtraction and wavefront control stages of the coronagraphic observation. We…
The use of integral field spectroscopy is becoming increasingly popular, hovewer data reduction is still a difficult process. Here I present a step-by-step guide to the reduction of integral field data acquired with the Gemini Multi-Object Spectrograph (GMOS) on GEMINI. The reduction process, separately applied to a standard star and to the science data, includes bias and sky subtraction, flat-fielding, trimming, wavelength and flux calibration, creation of the cubes for each exposure and final combination into a single cube. Typical problems encoutered during the reduction process are discuss…
We present the data reduction pipeline, MEAD, for Arizona Lenslets for Exoplanet Spectroscopy (ALES), the first thermal infrared integral field spectrograph designed for high-contrast imaging. ALES is an upgrade of LMIRCam, the $1-5\,μ$m imaging camera for the Large Binocular Telescope, capable of observing astronomical objects in the thermal infrared ($3-5\,μ$m) to produce simultaneous spatial and spectral data cubes. The pipeline is currently designed to perform $L$-band ($2.8-4.2\,μ$m) data cube reconstruction, relying on methods used extensively by current near-infrared integral field spec…
We present the baseline conceptual design of the Cassegrain U-Band Efficient Spectrograph (CUBES) for the Very Large Telescope. CUBES will provide unprecedented sensitivity for spectroscopy on a 8 - 10 m class telescope in the ground ultraviolet (UV), spanning a bandwidth of > 100 nm that starts at 300 nm, the shortest wavelength accessible from the ground. The design has been optimized for end-to-end efficiency and provides a spectral resolving power of R > 20000, that will unlock a broad range of new topics across solar system, Galactic and extraglactic astronomy. The design also features a …
SIMLA: The Spitzer Infrared Spectrograph Mapping Legacy Archive
University of Toledo（托莱多大学）；University of California, San Diego（加州大学圣地亚哥分校）；University of Texas at Arlington（德克萨斯大学阿灵顿分校）；Jet Propulsion Laboratory, California Institute of Technology（加州理工学院喷气推进实验室）
In spite of the advent of extremely large telescopes in the UV/optical/NIR range, the current generation of 8-10m facilities is likely to remain competitive at ground-UV wavelengths for the foreseeable future. The Cassegrain U-Band Efficient Spectrograph (CUBES) has been designed to provide high-efficiency (>40%) observations in the near UV (305-400 nm requirement, 300-420 nm goal) at a spectral resolving power of R>20,000, although a lower-resolution, sky-limited mode of R ~ 7,000 is also planned. CUBES will offer new possibilities in many fields of astrophysics, providing access to key lines…
We present HSIM: a dedicated pipeline for simulating observations with the HARMONI integral field spectrograph on the European Extremely Large Telescope. HSIM takes high spectral and spatial resolution input data-cubes, encoding physical descriptions of astrophysical sources, and generates mock observed data-cubes. The simulations incorporate detailed models of the sky, telescope and instrument to produce realistic mock data. Further, we employ a new method of incorporating the strongly wavelength dependent adaptive optics point spread functions. HSIM provides a step beyond traditional exposur…
We present simulated observations of gas kinematics in galaxies formed in 10 pc resolution cosmological simulations with the hydrodynamical + N-body code RAMSES, using the new RAMSES2HSIM pipeline with the simulated observing pipeline (HSIM) for the ELT HARMONI IFU spectrograph. We post-process the galaxy's gas kinematics and Hα line emission for each simulation cell, and integrate the emission to produce an extinction-corrected input cube. We then simulate observations of the input cube with HARMONI, for a range of exposure times, spatial sampling, and spectral resolution. We analyze the mock…
OSIRIS is a near-infrared (1.0--2.4 $μ$m) integral field spectrograph operating behind the adaptive optics system at Keck Observatory, and is one of the first lenslet-based integral field spectrographs. Since its commissioning in 2005, it has been a productive instrument, producing nearly half the laser guide star adaptive optics (LGS AO) papers on Keck. The complexity of its raw data format necessitated a custom data reduction pipeline (DRP) delivered with the instrument in order to iteratively assign flux in overlapping spectra to the proper spatial and spectral locations in a data cube. Oth…
In the era of Extremely Large Telescopes, the current generation of 8-10m facilities are likely to remain competitive at ground-UV wavelengths for the foreseeable future. The Cassegrain U-Band Efficient Spectrograph (CUBES) has been designed to provide high-efficiency (>40%) observations in the near UV (305-400 nm requirement, 300-420 nm goal) at a spectral resolving power of R>20,000 (with a lower-resolution, sky-limited mode of R ~ 7,000). With the design focusing on maximizing the instrument throughput (ensuring a Signal to Noise Ratio (SNR) ~20 per high-resolution element at 313 nm for U ~…
Mock Observations for the CSST Mission: Integral Field Spectrograph--GEHONG: A Package for Generating Ideal Datacubes
Hebei Normal University（河北师范大学）；Guoshoujing Institute of Astronomy, Hebei Normal University（河北师范大学郭守敬天文研究所）；Shanghai Astronomical Observatory, Chinese Academy of Sciences（中国科学院上海天文台）；National Astronomical Observatories, Chinese Academy of Sciences（中国科学院国家天文台）
We introduce the scientific motivations for the development of the Cassegrain U-Band Efficient Spectrograph (CUBES) that is now in construction for the Very Large Telescope. The assembled cases span a broad range of contemporary topics across Solar System, Galactic and extragalactic astronomy, where observations are limited by the performance of current ground-based spectrographs shortwards of 400nm. A brief background to each case is presented and specific technical requirements on the instrument design that flow-down from each case are identified. These were used as inputs to the CUBES desig…
The recovery of an exoplanet's atmospheric parameters from its spectrum requires accurate knowledge of the spectral errors and covariances. Unfortunately, the complex image processing used in high-contrast integral-field spectrograph (IFS) observations generally produces spectral covariances that are poorly understood and often ignored. In this work, we show how to measure the spectral errors and covariances and include them self-consistently in parameter retrievals. By combining model exoplanet spectra with a realistic noise model generated from GPI early science data, we show that ignoring s…
The James Webb Space Telescope (JWST) was launched on December 25, 2021. This document presents a simulation of the Near Infrared Spectrograph (NIRSpec) observations of the Orion Bar which will be performed as part of the Early Release Sciences (ERS) program "PDRs4all". The methodology to produce this data relies on the use of a direct forward model of the instrument applied to a synthetic scene of the Orion Bar, coupled to format matching in order to deliver data in JWST-pipeline data format. The resulting 3D cube for one order is provided publicly, and is compatible with tools developed by t…
Capabilities of a 24 -channel slicer for imaging spectroscopy with the Multichannel Subtractive Double Pass (MSDP) on 8-meter class solar spectrographs
In this second paper of a series, we present a treatment procedure for data cubes obtained with the Spectrograph for Integral Field Observations in the Near Infrared of the Very Large Telescope. We verified that the treatment procedure improves significantly the quality of the images of the data cubes, allowing a more detailed analysis. The images of the Br$γ$ and H$_2 λ21218$ emission lines from the treated data cube of the nuclear region of NGC 5643 reveal the existence of ionized and molecular-gas clouds around the nucleus, which cannot be seen clearly in the images from the non-treated dat…
Grating-based spectrographs suffer from smile and keystone distortion, which are problematic for hyperspectral data applications. Due to this, spectral lines will appear curved and roughly parabola-shaped. Smile and keystone need to be measured and corrected for accurate spectral and spatial calibration. In this paper, we present a novel method to accurately identify and correct curved spectral lines in an image of a spectrum, using a clustering algorithm we developed specifically for grating spectrographs, inspired by K-means clustering. Our algorithm will be used for calibrating a multi-obje…
The Colorado Ultraviolet Transit Experiment (CUTE) is a 6U NASA CubeSat carrying on-board a low-resolution (R~2000--3000), near-ultraviolet (2500--3300 Å) spectrograph. It has a rectangular primary Cassegrain telescope to maximize the collecting area. CUTE, which is planned for launch in Spring 2020, is designed to monitor transiting extra-solar planets orbiting bright, nearby stars aiming at improving our understanding of planet atmospheric escape and star-planet interaction processes. We present here the CUTE data simulator, which we complemented with a basic data reduction pipeline. This pi…
The Near-Infrared Spectrograph (NIRSpec) on the James Webb Space Telescope (JWST) offers the first opportunity to use integral-field spectroscopy from space at near-infrared wavelengths. More specifically, NIRSpec's integral-field unit can obtain spectra covering the wavelength range $0.6 - 5.3~μ$m for a contiguous 3.1 arcsec $\times$ 3.2 arcsec sky area at spectral resolutions of $R \approx 100$, 1000, and 2700. In this paper we describe the optical and mechanical design of the NIRSpec integral-field spectroscopy mode, together with its expected performance. We also discuss a few recommended …
Integral Field Spectroscopy (IFS) is a technique that gives simultaneously the spectrum of each spatial sampling element in a given object field. It is a powerful tool which rearranges the data cube (x, y, lambda) represented by two spatial dimensions defining the field and the spectral decomposition in a detector plane. In IFS, the spatial unit reorganizes the field and the spectral unit is being composed of a classical spectrograph.The development of a Collimating Slicer aims at proposing a new type of integral field spectrograph which should be more compact. The main idea is to combine the …
The Multi Unit Spectroscopic Explorer (MUSE) is an integral-field spectrograph operating in the visible wavelength range, and installed at the Very Large Telescope (VLT). The official MUSE pipeline is available from ESO. However, for the data reduction of the Deep Fields program (Bacon et al., in prep.), we have built a more sophisticated reduction pipeline, with additional reduction tasks, to extend the official pipeline and produce cubes with fewer instrumental residuals.
The Colorado Ultraviolet Transit Experiment (CUTE) is a 6U NASA CubeSat carrying on-board a low-resolution, near-ultraviolet (2479-3306 A) spectrograph. It has a Cassegrain telescope with a rectangular primary to maximize the collecting area, given the shape of the satellite bus, and an aberration correcting grating to improve the image quality, and thus spectral resolution. CUTE, launched on the 27th of September 2021 to a Low Earth Orbit, is designed to monitor transiting extra-solar planets orbiting bright, nearby stars to improve our understanding of planet atmospheric escape and star-plan…
MUSE, a giant integral field spectrograph, is about to become the newest facility instrument at the VLT. It will see first light in February 2014. Here, we summarize the properties of the instrument as built and outline functionality of the data reduction system, that transforms the raw data that gets recorded separately in 24 IFUs by 4k CCDs, into a fully calibrated, scientifically usable data cube. We then describe recent work regarding geometrical calibration of the instrument and testing of the processing pipeline, before concluding with results of the Preliminary Acceptance in Europe and …
The Colorado Ultraviolet Transit Experiment (CUTE) is a 6U NASA CubeSat carrying a low-resolution (R ~3000), near-ultraviolet (255 - 330nm) spectrograph fed by a rectangular primary Cassegrain. CUTE, is planned for launch in spring 2020 and it will monitor transiting extra-solar planets to study atmospheric escape. We present here the CUTE data simulator, which is a versatile tool easily adaptable to any other mission performing single-slit spectroscopy and carrying on-board a CCD detector. We complemented the data simulator with a data reduction pipeline capable of performing a rough reductio…
ESO-VLT BlueMUSE instrument - Conceptual Design for Phase A
Universite Claude Bernard Lyon 1, CRAL UMR5574, ENS de Lyon, CNRS（里昂第一大学克劳德·贝尔纳，CRAL UMR5574，巴黎高等师范学校里昂分校，法国国家科学研究中心）；Leibniz-Institut für Astrophysik Potsdam (AIP)（波茨坦莱布尼茨天体物理研究所）；Instituto de Astrofísica e Ciências do Espaço, U. Lisboa（里斯本大学空间科学与天体物理研究所）；Ecole Polytechnique Federale de Lausanne (EPFL)（洛桑联邦理工学院）；Australian Astronomical Optics, Macquarie Univ.（澳大利亚天文光学中心，麦考瑞大学）；Centre for Advanced Instrumentation, Department of Physics, Durham University（杜伦大学物理系先进仪器中心）；Dpt d'Astronomie, Univ. de Geneve（日内瓦大学天文学系）；Universite Paris-Saclay, CEA, IRFU（巴黎萨克雷大学，法国原子能和替代能源委员会，核物理研究创新实验室）；Stockholm University（斯德哥尔摩大学）；Instituto de Astrofísica e Ciências do Espaço, U.Porto（波尔图大学空间科学与天体物理研究所）
We observed the Hubble Deep Field South with the new panoramic integral field spectrograph MUSE that we built and just commissioned at the VLT. The data cube resulting from 27 hours of integration covers one arcmin^2 field of view at an unprecedented depth with a 1 sigma emission line surface brightness limit of 1x$10^{-19}$ erg/s/cm$^2$/arcsec$^2$ and contains ~90,000 spectra. We present the combined and calibrated data cube, and we perform a first-pass analysis of the sources detected in the HDF-S imaging. We measured the redshifts of 189 sources up to a magnitude F814W = 29.5, increasing by…
The Apache Point Observatory Galactic Evolution Experiment (APOGEE), part of the Sloan Digital Sky Survey III, explores the stellar populations of the Milky Way using the Sloan 2.5-m telescope linked to a high resolution (R~22,500), near-infrared (1.51-1.70 microns) spectrograph with 300 optical fibers. For over 150,000 predominantly red giant branch stars that APOGEE targeted across the Galactic bulge, disks and halo, the collected high S/N (>100 per half-resolution element) spectra provide accurate (~0.1 km/s) radial velocities, stellar atmospheric parameters, and precise (~0.1 dex) chemical…
