Neutral hydrogen intensity mapping can in principle deliver rapid and large-volume cosmological surveys with exquisitely accurate redshifts that are determined directly from imaging. However, intensity maps suffer from very strong foreground contamination. Future surveys will require efficient data pipelines to remove the foregrounds and reveal the cosmological signal. It is expected that this cleaning will not remove the signal in substantial parts of the available Fourier space and that significant loss of signal due to imperfect cleaning will be confined to specific regions of Fourier space. This suggests a strategy which is useful for simplified estimates and rapid computations -- i.e., to apply foreground filters that avoid the regions where loss of signal is significant. The standard Fourier-space power spectrum and foreground filters use a flat-sky approximation and thus exclude wide-angle correlations. We provide a new geometrical formulation of foreground filters in harmonic space, which naturally includes all wide-angle effects in the power spectrum. Foreground filtering leads to a loss of isotropy in Fourier space. In harmonic space this produces off-diagonal correlations. We derive analytical expressions for the generalised HI power spectrum and its cross-power with CMB lensing, for both single-dish and interferometer mode surveys. We show numerically that the off-diagonal contributions are negligible for the auto power. In the cross power, there is a non-negligible off-diagonal contribution, but only for a small interval of the largest available scales. For auto and cross power, the signal loss due to foreground avoidance decreases with increasing multipole (i.e. smaller scales), and the loss in interferometer mode is equal to, or slightly greater than, in single-dish mode. We find that the cross power in single-dish mode vanishes below a critical multipole, ...
Foreground contamination in Ly-alpha intensity mapping during the epoch of reionization
在再电离时期（EoR）的Ly-alpha发射的强度映射将受到来自较低红移的前景发射线的污染。计算了Ly-alpha发射在z~7处的平均强度和功率谱，并根据相关的天体物理过程估计了不确定度。我们发现，来自6563 A H-α，5007 A [OIII]和3727 A [OII]的低红移发射线将是观测到的Ly-alpha功率谱上的强污染物。我们利用恒星形成率（SFR）和光度函数（LF）来估计H-α在z~0.5处，[OIII]在z~0.9处和[OII]在z~1.6处的三条前景线的平均强度和功率谱，因为它们会污染z~7处的Ly-alpha发射。而这一点，也是最强的。我们分析了遮蔽的前景线高于一些线强度阈值的明亮的调查像素作为一种方式，以减少污染的强度映射调查。我们发现，如果我们去除通量大于1.4 × 10 ^-20 W/m^2的像素，前景污染可以忽略不计。
We apply for the first time Gaussian Process Regression (GPR) as a foreground removal technique in the context of single-dish, low redshift HI intensity mapping, and present an open-source Python toolkit for doing so. We use MeerKAT and SKA1-MID-like simulations of 21cm foregrounds (including polarisation leakage), HI cosmological signal and instrumental noise. We find that it is possible to use GPR as a foreground removal technique in this context, and that it is better suited in some cases to recover the HI power spectrum than Principal Component Analysis (PCA), especially on small scales. G…
Generalised Visibility ILC: a new foreground mitigation strategy for interferometric HI intensity mapping in the low-redshift Universe
Instituto de Física de Cantabria (CSIC-Universidad de Cantabria)（坎塔布里亚物理研究所）；Dpto. de Física Moderna, Universidad de Cantabria（坎塔布里亚大学现代物理系）；Jodrell Bank Centre for Astrophysics, Department of Physics and Astronomy, The University of Manchester（曼彻斯特大学天体物理学乔德雷尔银行中心）；State Key Laboratory of Radio Astronomy and Technology, Shanghai Astronomical Observatory, CAS（中国科学院上海天文台射电天文与技术国家重点实验室）
The high dynamic range between contaminating foreground emission and the fluctuating 21cm brightness temperature field is one of the most problematic characteristics of 21cm intensity mapping data. While these components would ordinarily have distinctive frequency spectra, making it relatively easy to separate them, instrumental effects and calibration errors further complicate matters by modulating and mixing them together. A popular class of foreground cleaning method are unsupervised techniques related to Principal Component Analysis (PCA), which exploit the different shapes and amplitudes …
The future of precision cosmology could benefit from cross-correlations between intensity maps of unresolved neutral hydrogen (HI) and more conventional optical galaxy surveys. A major challenge that needs to be overcome is removing the 21cm foreground emission that contaminates the cosmological HI signal. Using N-body simulations we simulate HI intensity maps and optical catalogues which share the same underlying cosmology. Adding simulated foreground contamination and using state-of-the-art reconstruction techniques we investigate the impacts that 21cm foregrounds and other systematics have …
Potential evidence for primordial non-Gaussianity (PNG) is expected to lie in the largest scales mapped by cosmological surveys. Forthcoming 21cm intensity mapping experiments will aim to probe these scales by surveying neutral hydrogen (HI) within galaxies. However, foreground signals dominate the faint 21cm emission, meaning foreground cleaning is required to recover the cosmological signal. The effect this has is to damp the HI power spectrum on the largest scales, especially along the line-of-sight. Whilst there is agreement that this contamination is potentially problematic for probing PN…
Neutral Hydrogen Intensity Mapping (HI IM) surveys will be a powerful new probe of cosmology. However, strong astrophysical foregrounds contaminate the signal and their coupling with instrumental systematics further increases the data cleaning complexity. In this work, we simulate a realistic single-dish HI IM survey of a $5000$~deg$^2$ patch in the $950 - 1400$ MHz range, with both the MID telescope of the SKA Observatory (SKAO) and MeerKAT, its precursor. We include a state-of-the-art HI simulations and explore different foreground models and instrumental effects such as non-homogeneous ther…
We conduct the first case study towards developing optimal foreground mitigation strategies for neutral hydrogen (HI) intensity mapping using radio interferometers at low redshifts. A pipeline for simulation, foreground mitigation and power spectrum estimation is built, which can be used for ongoing and future surveys using MeerKAT and Square Kilometre Array Observatory (SKAO). It simulates realistic sky signals to generate visibility data given instrument and observation specifications, which is subsequently used to perform foreground mitigation and power spectrum estimation. A quadratic esti…
Measurements of the one-point probability distribution function and higher-order moments (variance, skewness, and kurtosis) of the high-redshift 21 cm fluctuations are among the most direct statistical probes of the non-Gaussian nature of structure formation and evolution during reionization. However, contamination from astrophysical foregrounds and instrument systematics pose significant challenges in measuring these statistics in real observations. In this work, we use forward modelling to investigate the feasibility of measuring 21 cm one-point statistics through a foreground avoidance stra…
21 cm intensity mapping has arisen as a powerful probe of the high-redshift universe, but its potential is limited by extremely bright foregrounds and high source confusion. In this Letter, we propose a new analysis which can help solve both problems. From the combination of an intensity map with an overlapping galaxy survey we construct a new one-point statistic which is unbiased by foregrounds and contains information left out of conventional analyses. We show that our method can measure the HI mass function with unprecedented precision using observations similar to recent 21 cm detections.
The Principal Component Analysis (PCA) method and the Singular Value Decomposition (SVD) method are widely used for foreground subtraction in 21 cm intensity mapping experiments. We show their equivalence, and point out that the condition for completely clean separation of foregrounds and cosmic 21 cm signal using the PCA/SVD is unrealistic. We propose a PCA-based foreground subtraction method, dubbed "Singular Vector Projection (SVP)" method, which exploits a priori information of the left and/or right singular vectors of the foregrounds. We demonstrate with simulation tests that this new, se…
We forecast ability of dedicated 21 cm intensity mapping experiments to constraint primordial non-Gaussianity using power spectrum and bispectrum. We model the signal including the non-linear biasing expansion using a generalized halo model approach. We consider the importance of foreground filtering scale and of the foreground wedge. We find that the current generation intensity mapping experiments like CHIME do not posses sufficient sensitivity to be competitive with the existing limits. On the other hand, upcoming experiments like HIRAX can improve the current constraints and the proposed P…
Foreground removal in HI 21 cm intensity mapping under frequency-dependent beam distortions
Foundation for Research and Technology Hellas (FORTH)（希腊研究与技术基金会）；Université Paris-Saclay（巴黎萨克雷大学）；Université Paris Cité（巴黎西岱大学）；CEA（法国原子能和替代能源委员会）；CNRS（法国国家科学研究中心）；Observatoire de la Côte d’Azur（蔚蓝海岸天文台）；University of the Western Cape（西开普敦大学）；University of Crete（克里特大学）
We present a framework and an open-source python toolkit to analyse the 2-point statistics of 3D fluctuations in the context of HI intensity maps using the multipole expansion formalism. We include simulations of the cosmological HI signal using N-body and log-normal methods, foregrounds and their removal, as well as instrumental effects. Using these simulations and analytical modelling, we investigate the impact of foreground cleaning and the instrumental beam on the power spectrum multipoles as well as on the Fourier space clustering wedges. We find that both the instrumental beam and the fo…
\textsc{Hi} intensity mapping will provide maps of the large-scale distribution of neutral hydrogen (\textsc{Hi}) in the universe. These are prime candidates to be used to constrain primordial non-Gaussianity using the Large Scale Structure of the Universe as well as to provide further tests of Einstein's theory of Gravity (GR). But \textsc{Hi} maps are contaminated by foregrounds, which can be several orders of magnitude above the cosmological signal. Here we quantify how degenerated are the large-scale effects ($f_{\rm NL}$ and GR effects) with the residual foregrounds. We conclude that a jo…
Intensity mapping has attracted significant interest as an approach to measure the properties of the interstellar medium in typical galaxies at high redshift. Intensity mapping measures the statistics of surface brightness as a function of frequency, making it sensitive not only to all line emission of interest but also radiation from all other sources. Significant effort has gone into developing approaches that reject foreground contamination. Additionally, the target galaxies have multiple sources of emission that can complicate the interpretation of the line brightness. We describe the prob…
Observations of the 21cm Epoch of Reionization (EoR) signal are dominated by Galactic and extragalactic foregrounds. The need for foreground removal has led to the development of two main techniques, often referred to as "foreground avoidance" and "foreground subtraction." Avoidance is associated with filtering foregrounds in Fourier space, while subtraction uses an explicit foreground model that is removed. Using 1088 hours of data from the 64-element PAPER array, we demonstrate that subtraction of a foreground model prior to delay-space foreground filtering results in a modest but measurable…
We provide perturbation theory predictions for the HI intensity mapping power spectrum multipoles using the Effective Field Theory of Large Scale Structure (EFTofLSS), which should allow us to constrain cosmological parameters exploiting mildly nonlinear scales. Assuming survey specifications typical of proposed interferometric HI intensity mapping experiments like CHORD and PUMA, and realistic ranges of validity for the perturbation theory modelling, we run mock full shape MCMC analyses at a redshift bin centred at $z=0.5$, and compare with Stage-IV optical galaxy surveys. We include the impa…
Deep convolutional neural networks have been a popular tool for image generation and restoration. The performance of these networks is related to the capability of learning realistic features from a large dataset. In this work, we applied the problem of inpainting non-Gaussian signal, in the context of Galactic diffuse emissions at the millimetric and sub-millimetric regimes, specifically Synchrotron and Thermal Dust emission. Both of them are affected by contamination at small angular scales due to extra-galactic radio sources (the former) and to dusty star-forming galaxies (the latter). We c…
Intensity mapping of the HI 21 cm line and the CO 2.61 mm line from the epoch of reionization has emerged as powerful, complementary, probes of the high-redshift Universe. However, both maps and their cross-correlation are dominated by foregrounds. We propose a new analysis by which the signal is unbiased by foregrounds, i.e. it can be measured without foreground mitigation. We construct the antisymmetric part of the HI-CO cross-correlation, arising because the statistical fluctuations of two fields have different evolution in time. We show that the sign of this new signal can distinguish mode…
Line intensity mapping (LIM) is a promising probe to study star formation, the large-scale structure of the Universe, and the epoch of reionization (EoR). Since carbon monoxide (CO) is the second most abundant molecule in the Universe except for molecular hydrogen ${\rm H}_2$, it is suitable as a tracer for LIM surveys. However, just like other LIM surveys, CO intensity mapping also suffers strong foreground contamination that needs to be eliminated for extracting valuable astrophysical and cosmological information. In this work, we take $^{12}$CO($\it J$=1-0) emission line as an example to in…
We introduce DAYENU, a linear, spectral filter for HI intensity mapping that achieves the desirable foreground mitigation and error minimization properties of inverse co-variance weighting with minimal modeling of the underlying data. Beyond 21 cm power-spectrum estimation, our filter is suitable for any analysis where high dynamic-range removal of spectrally smooth foregrounds in irregularly (or regularly) sampled data is required, something required by many other intensity mapping techniques. Our filtering matrix is diagonalized by Discrete Prolate Spheroidal Sequences which are an optimal b…
Extracting the neutral hydrogen (HI) signal is a great challenge for cosmological 21cm experiments, both the astrophysical foregrounds and the receiver noise are typically several orders of magnitude greater than the 21cm signal. However, the different properties of the 21cm signal, foreground, and noise can be exploited to separate these components. The foregrounds are generally smooth or correlated over the frequency space along a line of sight (l.o.s.), while both the 21cm signal and the noise varies stochastically along the same l.o.s. The foreground can be removed by filtering out the smo…
Erasing the Milky Way: new cleaning technique applied to GBT intensity mapping data
我们提出了一个新的前景去除管道的第一个应用程序，目前领先的HI强度映射数据集，获得的绿岸望远镜（GBT）。我们研究了Masui et al（2013）和Switzer et al（2013）先前提出的GBT观测的15小时和1小时场数据，覆盖约41平方度，0.6<z<1.0，可以用WiggleZ暗能量巡天的星系分布测量交叉相关。在所提出的管道中，我们减去银河系前景连续和点源污染使用独立分量分析技术（fastica），并开发一个基于傅立叶的最佳估计计算温度功率谱的强度图和互相关与星系调查数据。我们表明，fastica是一个可靠的工具，通过其概率分布的非高斯性质减去扩散和点源发射。强度图的温度功率谱主要由小尺度上的仪器噪声所控制，而fastica作为非高斯信号的保守减法技术，不能减轻这种噪声。然而，我们确定了与奇异值分解（SVD）方法获得的GBT-WiggleZ互相关测量结果相似的GBT-WiggleZ互相关测量结果，并证实了fastica前景减法对21 cm信号丢失具有鲁棒性，如这些互相关测量结果的收敛幅度所示。我们的结论是SVD和fastica是互补的方法来调查前景和噪声系统存在于强度映射数据集。
We assess the performance of the multipole expansion formalism in the case of single-dish HI intensity mapping, including instrumental and foreground removal effects. This formalism is used to provide MCMC forecasts for a range of HI and cosmological parameters, including redshift space distortions and the Alcock-Paczynski effect. We first determine the range of validity of our power spectrum modelling by fitting to simulation data, concentrating on the monopole, quadrupole, and hexadecapole contributions. We then show that foreground subtraction effects can lead to severe biases in the determ…
Observations of the redshifted 21-cm signal emitted by neutral hydrogen represent a promising probe of large-scale structure in the universe. However, cosmological 21-cm signal is challenging to observe due to astrophysical foregrounds which are several orders of magnitude brighter. Traditional linear foreground removal methods can optimally remove foregrounds for a known telescope response but are sensitive to telescope systematic errors such as antenna gain and delay errors, leaving foreground contamination in the recovered signal. Non-linear methods such as principal component analysis, on …
We use full sky simulations, including the effects of foreground contamination and removal, to explore multi-tracer synergies between a SKA-like 21cm intensity mapping survey and a LSST-like photometric galaxy redshift survey. In particular we study ratios of auto and cross-correlations between the two tracers as estimators of the ratio of their biases, a quantity that should benefit considerably from the cosmic variance cancellation of the multi-tracer approach. We show how well we should be able to measure the bias ratio on very large scales (down to $\ell \sim 3$), which is crucial to measu…
The post-reionization $(z \le 6)$ neutral hydrogen (HI) 21-cm intensity mapping signal holds the potential to probe the large scale structures, study the expansion history and constrain various cosmological parameters. Here we apply the Tapered Gridded Estimator (TGE) to estimate $P(k_{\perp},k_{\parallel})$ the power spectrum of the $z = 2.28$ $(432.8\, {\rm MHz})$ redshifted 21-cm signal using a $24.4\,{\rm MHz}$ sub-band drawn from uGMRT Band 3 observations of European Large-Area ISO Survey-North 1 (ELAIS-N1). The TGE allows us to taper the sky response which suppresses the foreground contr…
The cosmic microwave background $B$-mode signal is potentially weaker than the diffuse Galactic foregrounds over most of the sky at any frequency. A common method of separating the CMB from these foregrounds is via pixel-based parametric-model fitting. There are not currently enough all-sky maps to fit anything more than the most simple models of the sky. By simulating the emission in seven representative pixels, we demonstrate that the inclusion of a 5 GHz data point allows for more complex models of low-frequency foregrounds to be fitted than at present. It is shown that the inclusion of the…
The bispectrum is a 3-point statistic with the potential to provide additional information beyond power spectra analyses of survey datasets. Radio telescopes which broadly survey the 21cm emission from neutral hydrogen (HI) are a promising way to probe LSS and in this work we present an investigation into the HI intensity mapping (IM) bispectrum using simulations. We present a model of the redshift space HI IM bispectrum including observational effects from the radio telescope beam and 21cm foreground contamination. We validate our modelling prescriptions with measurements from robust IM simul…
The success of HI intensity mapping is largely dependent on how well 21cm foreground contamination can be controlled. In order to progress our understanding further, we present a range of simulated foreground data from four different $\sim3000$\,deg$^2$ sky regions, with and without effects from polarization leakage. Combining these with underlying cosmological HI simulations creates a range of single-dish intensity mapping test cases that require different foreground treatments. This allows us to conduct the most generalized study to date into 21cm foregrounds and their cleaning techniques fo…
We discuss the possibility of studying diffuse baryon distributions with kinematic Sunyaev-Zel'dovich (kSZ) effect by correlating cosmic microwave background (CMB) temperature fluctuations with density fluctuations from 21\,cm intensity mapping (IM). The biggest challenge for the cross-correlation is the loss of large-scale information in IM, due to foregrounds and the zero spacing problem of interferometers. We apply the tidal reconstruction algorithm to restore the lost large-scale modes, which increases the correlation by more than a factor of three. With the predicted foreground level, we …
Upcoming and future neutral hydrogen Intensity Mapping surveys offer a great opportunity to constrain cosmology in the post-reionization Universe, provided a good accuracy is achieved in the separation between the strong foregrounds and the cosmological signal. Cleaning methods rely on the frequency smoothness of the foregrounds and are often applied under the assumption of a simplistic Gaussian primary beam. In this work, we test the cleaning in the presence of a realistic primary beam model with a non trivial frequency dependence. We focus on the Square Kilometre Array precursor MeerKAT tele…
The 21-cm intensity mapping (IM) of neutral hydrogen (HI) is a promising tool to probe the large-scale structures. Sky maps of 21-cm intensities can be highly contaminated by different foregrounds, such as Galactic synchrotron radiation, free-free emission, extragalactic point sources, and atmospheric noise. We here present a model of foreground components and a method of removal, especially to quantify the potential of Five-hundred-meter Aperture Spherical radio Telescope (FAST) for measuring HI IM. We consider 1-year observational time with the survey area of $20,000\,{\rm deg}^{2}$ to captu…
Methodological Frontiers in 21-cm Intensity Mapping: the Treatment of Systematics and Foreground Contamination
Observatoire de la Côte d’Azur（蔚蓝海岸天文台）；University of the Western Cape（西开普敦大学）；Indian Institute of Technology Kharagpur（印度理工学院卡拉格普尔分校）；Foundation for Research and Technology Hellas (FORTH)（希腊研究与技术基金会）；The University of Manchester（曼彻斯特大学）；The University of Edinburgh（爱丁堡大学）；Indian Institute of Technology Madras（印度理工学院马德拉斯分校）；ETH Zurich（苏黎世联邦理工学院）；University of Portsmouth（朴茨茅斯大学）；Banwarilal Bhalotia College（班瓦里拉尔·巴洛蒂亚学院）；University of Cambridge（剑桥大学）；Northeastern University（东北大学）；Chinese Academy of Sciences（中国科学院）
HI intensity mapping (IM) is an exciting new probe that could revolutionize the future of cosmology. However, the relative faintness of the HI signal when compared to foregrounds of astrophysical or terrestrial origin will make HI IM extremely challenging. The imprint of these foregrounds may result in systematic errors in the recovered cosmological signal. We discuss an IM simulation pipeline developed at Manchester that can introduce systematic errors at the TOD level in order to help assess their impact. We will present results for two potential sources of systematics for HI IM surveys: 1/f…
Bayes-SCF: A Bayesian filter to mitigate foreground leakage in the 21-cm power spectrum
Centre for Strings, Gravitation and Cosmology, Department of Physics, Indian Institute of Technology Madras（印度金奈印度理工学院Madras分校弦、引力和宇宙学中心物理系）；School of Physical Sciences, National Institute of Science Education and Research（印度布巴内斯瓦尔印度科学教育与研究国家研究所物理科学学院）
JESSNet: Joint dEconvolution and Sparse Separation Network for HI 21 cm foreground cleaning
Foundation for Research and Technology Hellas (FORTH)（希腊基金会）；Université Paris-Saclay（巴黎萨克雷大学）；Université Paris Cité（巴黎西岱大学）；CEA（法国原子能和替代能源委员会）；CNRS（法国国家科学研究中心）；University of Crete（克里特大学）；Observatoire de la Côte d’Azur（蔚蓝海岸天文台）；Laboratoire Lagrange（拉格朗日实验室）；University of the Western Cape（西开普大学）；Institute of Computer Science, Foundation for Research and Technology Hellas (FORTH)（希腊基金会计算机科学研究所）
