In order to meet the theoretically achievable imaging performance, calibration of modern radio interferometers is a mandatory challenge, especially at low frequencies. In this perspective, we propose a novel parallel iterative multi-wavelength calibration algorithm. The proposed algorithm estimates the apparent directions of the calibration sources, the directional and undirectional complex gains of the array elements and their noise powers, with a reasonable computational complexity. Furthermore, the algorithm takes into account the specific variation of the aforementioned parameter values across wavelength. Realistic numerical simulations reveal that the proposed scheme outperforms the mono-wavelength calibration scheme and approaches the derived constrained Cramér-Rao bound even with the presence of non-calibration sources at unknown directions, in a computationally efficient manner.
The calibration of modern radio interferometers is a significant challenge, specifically at low frequencies. In this perspective, we propose a novel iterative calibration algorithm, which employs the popular sparse representation framework, in the regime where the propagation conditions shift dissimilarly the directions of the sources. More precisely, our algorithm is designed to estimate the apparent directions of the calibration sources, their powers, the directional and undirectional complex gains of the array elements and their noise powers, with a reasonable computational complexity. Nume…
High precison calibration is essential for a new generation of radio interferometers looking for Epoch of Reionization and Baryon Acoustic Oscillation signatures in neutral hydrogen. These arrays have so far been calibrated by redundant calibration, which usually assumes baselines intended to be identical are perfectly so. We present a new calibration scheme that relaxes the assumption of explicit redundancy by calculating the expected covariance of baselines. The technique also allows one to take advantage of partial knowledge of the sky, such as point sources with known positions but unknown…
In this paper, we investigate the calibration of radio interferometers in which Jones matrices are considered to model the interaction between the incident electromagnetic field and the antennas of each station. Specifically, perturbation effects are introduced along the signal path, leading to the conversion of the plane wave into an electric voltage by the receptor. In order to design a robust estimator, the noise is assumed to follow a spherically invariant random process (SIRP). The derived algorithm is based on an iterative relaxed concentrated maximum likelihood estimator (MLE), for whic…
Having an accurate calibration method is crucial for any scientific research done by a radio telescope. The next generation radio telescopes such as the Square Kilometre Array (SKA) will have a large number of receivers which will produce exabytes of data per day. In this paper we propose new direction-dependent and independent calibration algorithms that, while requiring much less storage during calibration, converge very fast. The calibration problem can be formulated as a non-linear least square optimization problem. We show that combining a block-LDU decomposition with Gauss-Newton iterati…
Radio interferometers can measure the full polarization state of incoming waves by cross--correlating all combinations of two orthogonal polarizations at each antenna. The independent sets of electronics used to detect the two polarization states will introduce a differential instrumental delay between the two data streams. The usual technique of separate calibration of the parallel--hand sets of visibilities still allows for an arbitrary offset in group delay and phase between the two parallel systems. In order to use the cross--polarized visibilities, this instrumental offset must be determi…
We present a fiber sensor based on an active integrated component which could be effectively used to measure the longitudinal vibration modes of telescope mirrors in an interferometric array. We demonstrate the possibility to measure vibrations with frequencies up to $\simeq 100$ Hz with a precision better than 10 nm.
Radio interferometer arrays with non-homogeneous element patterns are more difficult to calibrate compared to the more common homogeneous array. In particular, the non-homogeneity of the patterns has significant implications on the computational tractability of evaluating the calibration solutions. We apply the A-stacking technique to this problem and explore the trade-off to be made between the calibration accuracy and computational complexity. Through simulations, we show that this technique can be favourably applied in the context of an SKA-Low station. We show that the minimum accuracy req…
Paper I of the series re-derived the radio interferometry measurement equation (RIME) from first principles, and extended the Jones formalism to the full-sky case, incorporating direction-dependent effects (DDEs). This paper aims to describe both classical radio interferometric calibration (selfcal and related methods), and the recent developments in the treatment of DDEs, using the RIME-based mathematical framework developed in Paper I. It also aims to demonstrate the ease with which the various effects can be described and understood. The first section of this paper uses the RIME formalism t…
In radio astronomy, accurate calibration is of crucial importance for the new generation of radio interferometers. More specifically, because of the potential presence of outliers which affect the measured data, robustness needs to be ensured. On the other hand, calibration is improved by taking advantage of these new instruments and exploiting the known structure of parameters of interest across frequency. Therefore, we propose in this paper an iterative robust multi-frequency calibration algorithm based on a distributed and consensus optimization scheme which aims to estimate the complex gai…
Global 21-cm experiments require exquisitely precise calibration of the measurement systems in order to separate the weak 21-cm signal from Galactic and extragalactic foregrounds as well as instrumental systematics. Hitherto, experiments aiming to make this measurement have concentrated on measuring this signal using the single element approach. However, an alternative approach based on interferometers with short baselines is expected to alleviate some of the difficulties associated with a single element approach such as precision modelling of the receiver noise spectrum. Short spacing Interfe…
This manual is intended to help ALMA and other interferometer users improve images by recognising limitations and how to overcome them and deciding when and how to use self-calibration. The images provided by the ALMA Science Archive are calibrated using standard observing and data processing routines, including a quality assurance process to make sure that the observations meet the proposer's science requirements. This may not represent the full potential of the data, since any interferometry observation can be imaged with a range of resolutions and surface brightness sensitivity. The separat…
Growing interest in 21 cm tomography has led to the design and construction of broadband radio interferometers with low noise, moderate angular resolution, high spectral resolution, and wide fields of view. With characteristics somewhat different from traditional radio instruments, these interferometers may require new calibration techniques in order to reach their design sensitivities. Self-calibration or redundant calibration techniques that allow an instrument to be calibrated off complicated sky emission structures are ideal. In particular, the large number of redundant baselines possessed…
Interferometry with phased-array feeds (PAFs) presents new calibration challenges in comparison with single-pixel feeds. In particular, temporal instability of the compound beam patterns due to element gain drifts (EGDs) can produce calibration artefacts in interferometric images. To translate imaging dynamic range requirements into PAF hardware and calibration requirements, we must learn to relate EGD levels to imaging artefact levels. We present a MeqTrees-based simulations framework that addresses this problem, and apply it to the APERTIF prototype currently in development for the WSRT.
We present a filtering technique that can be applied to individual baselines of wide-bandwidth, wide-field interferometric data to geometrically select regions on the celestial sphere that contain primary calibration sources. The technique relies on the Fourier transformation of wide-band frequency spectra from a given baseline to obtain one-dimensional "delay images", and then the transformation of a time-series of delay images to obtain two-dimensional "delay/delay-rate images." Source selection is possible in these images given appropriate combinations of baseline, bandwidth, integration ti…
We describe techniques concerning wavelength calibration and sky subtraction to maximise the scientific utility of data from tunable filter instruments. While we specifically address data from the Optical System for Imaging and low Resolution Integrated Spectroscopy instrument (OSIRIS) on the 10.4~m Gran Telescopio Canarias telescope, our discussion is generalisable to data from other tunable filter instruments. A key aspect of our methodology is a coordinate transformation to polar coordinates, which simplifies matters when the tunable filter data is circularly symmetric around the optical ce…
We study the impact of sky-based calibration errors from source mismodeling on 21\,cm power spectrum measurements with an interferometer and propose a method for suppressing their effects. While emission from faint sources that are not accounted for in calibration catalogs is believed to be spectrally smooth, deviations of true visibilities from model visibilities are not, due to the inherent chromaticity of the interferometer's sky-response (the "wedge"). Thus, unmodeled foregrounds, below the confusion limit of many instruments, introduce frequency structure into gain solutions on the same l…
We use information theory to derive fundamental limits on the capacity to calibrate next-generation radio interferometers, and measure parameters of point sources for instrument calibration, point source subtraction, and data deconvolution. We demonstrate the implications of these fundamental limits, with particular reference to estimation of the 21cm Epoch of Reionization power spectrum with next-generation low-frequency instruments (e.g., the Murchison Widefield Array -- MWA, Precision Array for Probing the Epoch of Reionization -- PAPER), where short time scale instrumental calibration is r…
The formulation of the radio interferometer measurement equation (RIME) by Hamaker et al. has provided us with an elegant mathematical apparatus for better understanding, simulation and calibration of existing and future instruments. The calibration of the new radio telescopes (LOFAR, SKA) would be unthinkable without the RIME formalism, and new software to exploit it. MeqTrees is designed to implement numerical models such as the RIME, and to solve for arbitrary subsets of their parameters. The technical goal of MeqTrees is to provide a tool for rapid implementation of such models, while offe…
The 21-cm signal of neutral hydrogen - emitted during the Epoch of Reionization - promises to be an important source of information for the study of the infant universe. However, its detection is impossible without sufficient mitigation of other strong signals in the data, which requires an accurate knowledge of the instrument. Using the result of instrument calibration, a large part of the contaminating signals are removed and the resulting residual data is further analyzed in order to detect the 21-cm signal. Direction dependent calibration (DDC) can strongly affect the 21-cm signal, however…
We present development work aiming towards a large scale ice-based hybrid detector including acoustic sensors for the detection of neutrinos in the GZK range. A facility for characterization and calibration of acoustic sensors in clear (bubble-free) ice has been developed and the first measurements done at this facility are presented. Further, a resonant sensor intended primarily for characterization of the ambient noise in the ice at the South Pole has been developed and some data from its performance are given.
Papers I and II of this series have extended the radio interferometry measurement equation (RIME) formalism to the full-sky case, and provided a RIME-based description of calibration and the problem of direction-dependent effects (DDEs). This paper aims to provide a practical demonstration of a RIME-based approach to calibration, via an example of extremely high-dynamic range calibration of WSRT observations of 3C 147 at 21 cm, with full treatment of DDEs. A version of the RIME incorporating differential gains has been implemented in MeqTrees, and applied to the 3C 147 data. This was used to p…
For a ground-based radio interferometer observing at low frequencies, the ionosphere causes propagation delays and refraction of cosmic radio waves which result in phase errors in the received signal. These phase errors can be corrected using a calibration method that assumes a two-dimensional phase screen at a fixed altitude above the surface of the Earth, known as the thin-layer model. Here we investigate the validity of the thin-layer model and provide a simple equation with which users can check when this approximation can be applied to observations for varying time of day, zenith angle, i…
In this paper, we aim to design robust estimation techniques based on the compound-Gaussian (CG) process and adapted for calibration of radio interferometers. The motivation beyond this is due to the presence of outliers leading to an unrealistic traditional Gaussian noise assumption. Consequently, to achieve robustness, we adopt a maximum a posteriori (MAP) approach which exploits Bayesian statistics and follows a sequential updating procedure here. The proposed algorithm is applied in a multi-frequency scenario in order to enhance the estimation and correction of perturbation effects. Numeri…
Future generations of radio interferometers targeting the 21\,cm signal at cosmological distances with $N\gg 1000$ antennas could face a significant computational challenge in building correlators with the traditional architecture, whose computational resource requirement scales as $\mathcal{O}(N^2)$ with array size. The fundamental output of such correlators is the cross-correlation products of all antenna pairs in the array. The FFT-correlator architecture reduces the computational resources scaling to $\mathcal{O}(N\log{N})$ by computing cross-correlation products through a spatial Fourier …
This paper investigates calibration of sensor arrays in the radio astronomy context. Current and future radio telescopes require computationally efficient algorithms to overcome the new technical challenges as large collecting area, wide field of view and huge data volume. Specifically, we study the calibration of radio interferometry stations with significant direction dependent distortions. We propose an iterative robust calibration algorithm based on a relaxed maximum likelihood estimator for a specific context: i) observations are affected by the presence of outliers and ii) parameters of …
The response of the Advanced LIGO interferometers is known to vary with time [arXiv:1608.05134]. Accurate calibration of the interferometers must therefore track and compensate for temporal variations in calibration model parameters. These variations were tracked during the first three Advanced LIGO observing runs, and compensation for some of them has been implemented in the calibration procedure. During the second observing run, multiplicative corrections to the interferometer response were applied while producing calibrated strain data both in real-time and in high-latency. In a high-latenc…
Redundant calibration is a technique in radio astronomy that allows calibration of radio arrays whose antennas lie on a lattice by exploiting the fact that redundant baselines should see the same sky signal. Because the number of measured visibilities scales quadratically with the number of antennas but the number of unknowns describing the individual antenna responses and the available information about the sky scales only linearly with the array size, the problem is always over-constrained as long as the array is big and dense enough. This is true even for non-lattice array configurations. I…
We report on the MIT Epoch of Reionization (MITEoR) experiment, a pathfinder low-frequency radio interferometer whose goal is to test technologies that improve the calibration precision and reduce the cost of the high-sensitivity 3D mapping required for 21 cm cosmology. MITEoR accomplishes this by using massive baseline redundancy, which enables both automated precision calibration and correlator cost reduction. We demonstrate and quantify the power and robustness of redundancy for scalability and precision. We find that the calibration parameters precisely describe the effect of the instrumen…
Since its formulation by Hamaker et al., the radio interferometer measurement equation (RIME) has provided a rigorous mathematical basis for the development of novel calibration methods and techniques, including various approaches to the problem of direction-dependent effects (DDEs). This series of papers aims to place recent developments in the treatment of DDEs into one RIME-based mathematical framework, and to demonstrate the ease with which the various effects can be described and understood. It also aims to show the benefits of a RIME-based approach to calibration. Paper I re-derives the …
Star sensor's image plane can have three kinds of displacement after a long time working in space, and the displacements are the principal point drift, incline displacement and rotation displacement. These displacements can severely decrease star sensor's measuring accuracy, therefore it's necessary to analyze and calibrate them. The previous researches have only considered the principal point drift of image plane, which is three-degree-of-freedom. In contrast, the image plane displacements under the rest three degrees of freedom, that are the incline displacement and the rotation displacement…
From the Virgo interferometer calibration to the bias and uncertainty of the h(t) detector strain during the O4 run
Université de Strasbourg, CNRS, IPHC UMR 7178（斯特拉斯堡大学）；Laboratoire d’Annecy de Physique des Particules (LAPP), Univ. Grenoble Alpes, Université Savoie Mont Blanc, CNRS/IN2P3（阿讷西粒子物理实验室）；Institut de Fisica d’Altes Energies (IFAE), Barcelona Institute of Science and Technology, and ICREA（高能物理研究所）；Universiteit Antwerpen（安特卫普大学）
AMIGO: a Data-Driven Calibration of the JWST Interferometer
Sydney Institute for Astronomy, School of Physics, University of Sydney（悉尼大学物理学院天体物理研究所）；School of Mathematical & Physical Sciences, Macquarie University（麦考瑞大学数学与物理科学学院）；Department of Physics and Astronomy, University of Victoria（维多利亚大学物理与天文系）；Space Telescope Science Institute（太空望远镜科学研究所）；European Southern Observatory（欧洲南方天文台）
本文提出AMIGO框架，通过端到端可微架构校准JWST干涉仪，提升高对比度成像性能，成功恢复AB Dor AC双星并发现HD206893B和HD206893c，超越现有算法。
Gravitational-wave (GW) laser interferometers such as Advanced LIGO transduce spacetime strain into optical power fluctuation. Converting this optical power fluctuations back into an estimated spacetime strain requires a calibration process that accounts for both the interferometer's optomechanical response and the feedback control loop used to control the interferometer test masses. Systematic errors in the calibration parameters lead to systematic errors in the GW strain estimate, and hence to systematic errors in the astrophysical parameter estimates in a particular GW signal. In this work …
The Near-Infrared Spectrograph (NIRSpec) on board of the James Webb Space Telescope will be the first multi-object spectrograph in space offering ~250,000 configurable micro-shutters, apart from being equipped with an integral field unit and fixed slits. At its heart, the NIRSpec grating wheel assembly is a cryogenic mechanism equipped with six dispersion gratings, a prism, and a mirror. The finite angular positioning repeatability of the wheel causes small but measurable displacements of the light beam on the focal plane, precluding a static solution to predict the light-path. To address that…
With ever increasing data rates produced by modern radio telescopes like LOFAR and future telescopes like the SKA, many data processing steps are overwhelmed by the amount of data that needs to be handled using limited compute resources. Calibration is one such operation that dominates the overall data processing computational cost, nonetheless, it is an essential operation to reach many science goals. Calibration algorithms do exist that scale well with the number of stations of an array and the number of directions being calibrated. However, the remaining bottleneck is the raw data volume, w…
We discuss the ongoing development of single-mode fiber Fabry-Perot (FFP) Interferometers as precise astro-photonic calibration sources for high precision radial velocity (RV) spectrographs. FFPs are simple, inexpensive, monolithic units that can yield a stable and repeatable output spectrum. An FFP is a unique alternative to a traditional etalon, as the interferometric cavity is made of single-mode fiber rather than an air-gap spacer. This design allows for excellent collimation, high spectral finesse, rigid mechanical stability, insensitivity to vibrations, and no need for vacuum operation. …
Spectral features introduced by instrumental chromaticity of radio interferometers have the potential to negatively impact the ability to perform Epoch of Reionisation (EoR) and Cosmic Dawn (CD) science using the redshifted neutral hydrogen emission line from the early Universe. We describe instrument calibration choices that influence the spectral characteristics of the science data, and assess their impact on EoR statistical and tomographic experiments. Principally, we consider the intrinsic spectral response of the receiving antennas, embedded within a complete frequency-dependent primary b…
As the precision frontier of large-area survey astrophysics advances towards the one millimagnitude level, flux calibration of astronomical instrumentation remains an ongoing challenge. We describe initial testing of silicon solar cells as large-aperture precise calibration photodiodes. We present measurements of dark current, linearity, frequency response, spatial response uniformity, and noise characteristics of the Sunpower C60 solar cells, an interdigitated back-contact 125mm x 125mm monocrystalline solar cell. We find that these devices hold considerable promise as large-area flux calibra…
We introduce CALAMITY, a precision bandpass calibration method for radio interferometry. CALAMITY can solve for direction independent gains with arbitrary frequency structure to the high precision required for 21 cm cosmology with minimal knowledge of foregrounds or antenna beams and does not require any degree of redundancy (repeated identical measurements of the same baseline). We have achieved this through two key innovations. Firstly, we model the foregrounds on each baseline independently using a flexible and highly efficient set of basis functions that have minimal overlap with 21 cm mod…
Several types of Wavefront Sensors (WFS) are nowadays available in the field of Adaptive Optics (AO). Generally speaking, their basic principle consists in measuring slopes or curvatures of Wavefront Errors (WFE) transmitted by a telescope, subsequently reconstructing WFEs digitally. Such process, however, does not seem to be well suited for evaluating co-phasing or piston errors of future large segmented telescopes in quasi real-time. This communication presents an original, recently proposed technique for direct WFE sensing. The principle of the device, which is named "Telescope-Interferomet…
The optical sensors of the IceCube Neutrino Observatory are attached on vertical strings of cables. They were frozen into the ice in the deployment holes made by hot water drill. This hole ice, to the best of our knowledge, consists of a bubbly central column, with the remainder of the re-frozen volume being optically clear. The bubbly ice often blocks one or several of the calibration LEDs in every optical sensor and significantly distorts the angular profile of the calibration light pulses. It also affects the sensors' response to in-coming photons at different locations and directions. We p…
This paper presents the basic principle and theoretical relationships of an original method allowing to retrieve the Wavefront Errors (WFE) of a ground or space-borne telescope when combining its main pupil with a second, decentered reference optical arm. The measurement accuracy of such a "telescope-interferometer" is then estimated by means of various numerical simulations, demonstrating a high performance excepted on limited areas near the telescope pupil rim. In particular, it allows direct phase evaluation (thus avoiding the use of first or second-order derivatives), which is of special i…
The wavelength calibration of spectrographs is an essential but challenging task in many disciplines. Calibration is traditionally accomplished by imaging the spectrum of a light source containing features that are known to appear at certain wavelengths and mapping them to their location on the sensor. This is typically required in conjunction with each scientific observation to account for mechanical and optical variations of the instrument over time, which may span years for certain projects. The method presented here investigates the usage of color itself instead of spectral features to cal…
The Earth Observation planning community has access to tools that can propagate orbits and compute coverage of Earth observing imagers with customizable shapes and orientation, model the expected Earth Reflectance at various bands, epochs and directions, generate simplified instrument performance metrics for imagers and radars, and schedule single and multiple spacecraft payload operations. We are working toward integrating existing tools to design a planner that allows commercial small spacecraft to assess the opportunities for cross-calibration of their sensors against current satellite to b…
