Conventional algorithms for galaxy power spectrum estimation measure the true spectrum convolved with a survey window function, which, for parameter inference, must be compared with a similarly convolved theory model. In this work, we directly estimate the unwindowed power spectrum multipoles using quadratic estimators akin to those introduced in the late 1990s. Under Gaussian assumptions, these are optimal and free from the leading-order effects of pixellization and non-Poissonian shot-noise. They may be straightforwardly computed given the survey data-set and a suite of simulations of known cosmology. We implement the pixel-based maximum-likelihood estimator and a simplification based on the FKP weighting scheme, both of which can be computed via FFTs and conjugate gradient descent methods. Furthermore, the estimators allow direct computation of spectrum coefficients in an arbitrary linear compression scheme, without needing to first bin the statistic. Applying the technique to a subset of the BOSS DR12 galaxies, we find that the pixel-based quadratic estimators give statistically consistent power spectra, compressed coefficients, and cosmological parameters to those obtained with the usual windowed approaches. Due to the sample's low number density and compact window function, the optimal weighting scheme gives little improvement over the simplified form; this may change for dense surveys or those focusing on primordial non-Gaussianity. The technique is shown to be efficient and robust, and shows significant potential for measuring the windowless power spectrum and bispectrum in the presence of weak non-Gaussianity.
In this essay we extend the standard discussion of neutrino oscillations to astrophysical neutrinos propagating through expanding space. This extension introduces a new cosmological parameter $I$ into the oscillation phase. The new parameter records cosmic history in much the same manner as the redshift z or the apparent luminosity D_L. Measuring $I$ through neutrino oscillations could help determine cosmological parameters and discriminate among different cosmologies.
We introduce a new estimator of the peculiar velocity of a galaxy or group of galaxies from redshift and distance estimates. This estimator results in peculiar velocity estimates which are statistically unbiased and that have errors that are Gaussian distributed, thus meeting the assumptions of analyses that rely on individual peculiar velocities. We apply this estimator to the SFI++ and the Cosmicflows-2 catalogs of galaxy distances and, using the fact that peculiar velocity estimates of distant galaxies are error dominated, examine their error distributions, The adoption of the new estimator…
In this paper, we develop a full statistical method for the pairwise velocity estimator previously proposed, and apply Cosmicflows-2 catalogue to this method to constrain cosmology. We first calculate the covariance matrix for line-of-sight velocities for a given catalogue, and then simulate the mock full-sky surveys from it, and then calculate the variance for the pairwise velocity field. By applying the $8315$ independent galaxy samples and compressed $5224$ group samples from Cosmicflows-2 catalogue to this statistical method, we find that the joint constraint on $Ω^{0.6}_{\rm m}h$ and $σ_{…
When analyzing the galaxy bispectrum measured from spectroscopic surveys, it is imperative to account for the effects of non-uniform survey geometry. Conventionally, this is done by convolving the theory model with the the window function; however, the computational expense of this prohibits full exploration of the bispectrum likelihood. In this work, we provide a new class of estimators for the unwindowed bispectrum; a quantity that can be straightforwardly compared to theory. This builds upon the work of Philcox (2021) for the power spectrum, and comprises two parts (both obtained from an Ed…
We introduce a generalization of the 4-dimensional averaging window function of Gasperini, Marozzi and Veneziano (2010) that may prove useful for a number of applications. The covariant nature of spatial scalar averaging schemes to address the averaging problem in relativistic cosmology is an important property that is implied by construction, but usually remains implicit. We employ here the approach of Gasperini et al. for two reasons. First, the formalism and its generalization presented here are manifestly covariant. Second, the formalism is convenient for disentangling the dependencies on …
Rank-2 tensor fields of large-scale structure, e.g. a tensor field inferred from shapes of galaxies, open up a window to directly access 2-scalar, 2-vector and 2-tensor modes, where the scalar fields can be measured independently from the standard density field that is traced by distribution of galaxies. Here we develop an estimator of the multipole moments of power spectra for the three-dimensional tensor field, taking into account the projection onto plane perpendicular to the line-of-sight direction. To do this, we find that a convenient representation of the power spectrum multipoles can b…
The non-Gaussianity of inflationary perturbations, as encoded in the bispectrum (or 3-point correlator), has become an important additional way of distinguishing between inflation models, going beyond the linear Gaussian perturbation quantities of the power spectrum. This habilitation thesis provides a review of my work on both the theoretical and the observational aspects of these non-Gaussianities. In the first part a formalism is described, called the long-wavelength formalism, that provides a way to compute the non-Gaussianities in multiple-field inflation. Applications of this formalism t…
Likelihood-free inference provides a framework for performing rigorous Bayesian inference using only forward simulations, properly accounting for all physical and observational effects that can be successfully included in the simulations. The key challenge for likelihood-free applications in cosmology, where simulation is typically expensive, is developing methods that can achieve high-fidelity posterior inference with as few simulations as possible. Density-estimation likelihood-free inference (DELFI) methods turn inference into a density estimation task on a set of simulated data-parameter p…
Cross-power spectrum is a quadratic estimator between two maps that can provide unbiased estimate of the underlying power spectrum of the correlated signals, which is therefore used for extracting the power spectrum in the WMAP data. In this paper we discuss the limit of cross-power spectrum and derive the residual from uncorrelated signal, which is the source of error in power spectrum extraction. We employ the estimator to extract window functions by crossing pairs of extragalactic point sources. We desmonstrate its usefulness in WMAP Difference Assembly maps where the window functions are m…
Accurate measurement of the cluster mass function is a crucial element in efforts to constrain structure formation models, the normalisation of the matter power spectrum and the cosmological matter density, and the nature and evolution of dark energy. Large weak lensing surveys of ~20,000 galaxy clusters and groups will be key tools in the observational pursuit of that goal. These weak lensing studies often proceed by stacking the lensing signals of many clusters and groups binned by mass-correlated observables such as richness and luminosity; typically such analyses ignore the triaxial struct…
Neutrinos are expected to freestream (i.e. not interact with anything) since they decouple in the early Universe at a temperature $T\sim 2~{\rm MeV}$. However, there are many relevant particle physics scenarios that can make neutrinos interact at $T< 2~{\rm MeV}$. In this work, we take a global perspective and aim to identify the temperature range in which neutrinos can interact given current cosmological observations. We consider a generic set of rates parametrizing neutrino interactions and by performing a full Planck cosmic microwave background (CMB) analysis we find that neutrinos cannot i…
We conduct a thorough study into the feasibility of measuring large-scale correlated proper motions of galaxies with astrometric surveys. We introduce a harmonic formalism for analysing proper motions and their correlation functions on the sphere based on spin-weighted spherical harmonics, and study the statistics of the transverse velocity field induced by large-scale structure. We use a likelihood formalism to derive optimal estimators for the secular parallax due to the Solar System's motion relative to distant objects, and compute the variance and bias due to peculiar velocities and relati…
An optimal quadratic estimator for window-free cosmic shear power spectra
Kavli Institute for the Physics and Mathematics of the Universe (WPI), The University of Tokyo Institutes for Advanced Study (UTIAS), The University of Tokyo（东京大学宇宙物质前沿研究所（WPI）、东京大学高等研究院（UTIAS）、东京大学）；Department of Physics, The University of Tokyo（东京大学物理学系）；Center for Data-Driven Discovery (CD3), Kavli IPMU (WPI), UTIAS, The University of Tokyo（东京大学数据驱动发现中心（CD3）、卡弗里宇宙物理数学前沿研究所（WPI）、UTIAS、东京大学）
We present measurements of the spatial mapping between (hot) baryons and the total matter in the Universe, via the cross-correlation between the thermal Sunyaev-Zeldovich (tSZ) map from Planck and the weak gravitational lensing maps from the Red Sequence Cluster Survey (RCSLenS). The cross-correlations are performed on the map level where all the sources (including diffuse intergalactic gas) contribute to the signal. We consider two configuration-space correlation function estimators, $ξ^{ y-κ}$ and $ξ^ {y-γ_{t}}$, and a Fourier space estimator, $C_{\ell}^{y-κ}$, in our analysis. We detect a s…
Cosmological experiments often employ Bayesian workflows to derive constraints on cosmological and astrophysical parameters from their data. It has been shown that these constraints can be combined across different probes such as Planck and the Dark Energy Survey and that this can be a valuable exercise to improve our understanding of the universe and quantify tension between multiple experiments. However, these experiments are typically plagued by differing systematics, instrumental effects and contaminating signals, which we collectively refer to as `nuisance' components, that have to be mod…
The success of present and future cosmological studies is tied to the ability to detect discrepancies in complex data sets within the framework of a cosmological model. Tensions caused by the presence of unknown systematic effects need to be isolated and corrected to increase the overall accuracy of parameter constraints, while discrepancies due to new physical phenomena need to be promptly identified. We develop a full set of estimators of internal and mutual agreement and disagreement, whose strengths complement each other. These allow to take into account the effect of prior information and…
Optimal and exact wide-angle power spectrum estimation
Kavli Institute for Particle Astrophysics and Cosmology, Stanford University（斯坦福大学卡弗里粒子天体物理与宇宙学研究所）；Berkeley Center for Cosmological Physics, Department of Physics, University of California, Berkeley（加州大学伯克利分校物理学系宇宙学物理中心）；Lawrence Berkeley National Laboratory（劳伦斯伯克利国家实验室）；Perimeter Institute for Theoretical Physics（理论物理前沿研究所）；Department of Physics, University of Wisconsin-Madison（威斯康星大学麦迪逊分校物理学系）；Department of Physics and Astronomy, University of Pennsylvania（宾夕法尼亚大学物理与天文系）
We introduce new Fourier band-power estimators for cosmic shear data analysis and E/B-mode separation. We consider both the case where one performs E/B-mode separation and the case where one does not. The resulting estimators have several nice properties which make them ideal for cosmic shear data analysis. First, they can be written as linear combinations of the binned cosmic shear correlation functions. Second, they account for the survey window function in real-space. Third, they are unbiased by shape noise since they do not use correlation function data at zero separation. Fourth, the band…
Normalizing flows are a powerful tool to create flexible probability distributions with a wide range of potential applications in cosmology. Here we are studying normalizing flows which represent cosmological observables at field level, rather than at the level of summary statistics such as the power spectrum. We evaluate the performance of different normalizing flows for both density estimation and sampling of near-Gaussian random fields, and check the quality of samples with different statistics such as power spectrum and bispectrum estimators. We explore aspects of these flows that are spec…
For there to be a successful measurement of the 21 cm Epoch of Reionization (EoR) power spectrum, it is crucial that strong foreground contaminants be robustly suppressed. These foregrounds come from a variety of sources (such as Galactic synchrotron emission and extragalactic point sources), but almost all share the property of being spectrally smooth, and when viewed through the chromatic response of an interferometer, occupy a signature "wedge" region in cylindrical $k_\perp k_\parallel$ Fourier space. The complement of the foreground wedge is termed the "EoR window", and is expected to be …
One of the primary challenges in enabling the scientific potential of 21 cm intensity mapping at the Epoch of Reionization (EoR) is the separation of astrophysical foreground contamination. Recent works have claimed that Gaussian process regression (GPR) can robustly perform this separation, particularly at low Fourier $k$ wavenumbers where the signal reaches its peak signal-to-noise ratio. We revisit this topic by casting GPR foreground subtraction (GPR-FS) into the quadratic estimator formalism, thereby putting its statistical properties on stronger theoretical footing. We find that GPR-FS c…
We introduce a new estimator of the CMB lensing power spectrum, together with its likelihood, based on iterative lensing reconstruction. Despite the increased complexity of the lensing maps, this estimator shares similarities with the standard quadratic estimator. Most importantly, it is unbiased towards the assumptions done on the noise and cosmology for the lensing reconstruction. This new spectrum estimator can double the constraints on the lensing amplitude compared to the quadratic estimator, while keeping numerical cost under control and being robust to errors.
We utilize the Canny edge detection algorithm as an estimator for primordial non-Gaussianities. In preliminary tests on simulated sky patches with a window size of 57 degrees and multipole moments $l$ up to 1024, we find a $3σ$ distinction between maps with local non-Gaussianity $f_{NL}=350$ (or $f_{NL}=-700$) and Gaussian maps. We present evidence that high resolution CMB studies will strongly enhance the sensitivity of the Canny algorithm to non-Gaussianity, making it a promising technique to estimate primordial non-Gaussianity.
We develop and demonstrate an acceleration of the Liu & Tegmark quadratic estimator formalism for inverse variance foreground subtraction and power spectrum estimation in 21 cm tomography from O(N^3) to O(N log N), where N is the number of voxels of data. This technique makes feasible the megavoxel scale analysis necessary for current and upcoming radio interferometers by making only moderately restrictive assumptions about foreground models and survey geometry. We exploit iterative and Monte Carlo techniques and the symmetries of the foreground covariance matrices to quickly estimate the 21 c…
The technique of intensity mapping (IM) has emerged as a powerful tool to explore the universe at $z < 6$. IM measures the integrated emission from sources over a broad range of frequencies, unlocking significantly more information than traditional galaxy surveys. Astrophysical uncertainties, however, constitute an important systematic in our attempts to constrain cosmology with IM. I describe an innovative approach which allows us to fully utilize our current knowledge of astrophysics in order to develop cosmological forecasts from IM. This framework can be used to exploit synergies with othe…
Contamination from instrumental effects interacting with bright astrophysical sources is the primary impediment to measuring Epoch of Reionization and BAO 21 cm power spectra---an effect called mode-mixing. In this paper we identify four fundamental power spectrum shapes produced by mode-mixing that will affect all upcoming observations. We are able, for the first time, to explain the wedge-like structure seen in advanced simulations and to forecast the shape of an 'EoR window' that is mostly free of contamination. Understanding the origins of these contaminations also enables us to identify c…
Emission line galaxies (ELGs), more generally star-forming galaxies, are valuable tracers of large-scale structure and therefore main targets of upcoming wide-area spectroscopic galaxy surveys. We propose a fixed-aperture shape estimator of each ELG for extracting the intrinsic alignment (IA) signal, and assess the performance of the method using image simulations of ELGs generated from the IllustrisTNG simulation including observational effects such as the sky background noise. We show that our method enables a significant detection of the IA power spectrum with the linear-scale coefficient $…
Despite the impressive success of the standard cosmological model, several anomalies defy its triumph. Among them is the so-called lensing anomaly: the Planck satellite observes stronger CMB gravitational lensing than expected. The role of neutrinos in this anomaly has been mostly overlooked, despite their key role in CMB lensing, because in the standard scenario they tend to increase the tension. Here, we show that this strongly depends on the assumed neutrino equation of state. We demonstrate that if neutrinos have yet undiscovered long-range interactions, the lensing pattern is significantl…
Detecting cosmological signals from the Epoch of Reionization (EoR) requires high-precision calibration to isolate the cosmological signals from foreground emission. In radio interferometery, perturbed primary beams of antenna elements can disrupt the precise calibration, which results in contaminating the foreground-free region, or the EoR window, in the cylindrically averaged power spectrum. For Hydrogen Epoch of Reionization Array (HERA), we simulate and characterize the perturbed primary beams induced by feed motions such as axial, lateral, and tilting motions, above the 14-meter dish. To …
We present the Image-based Tapered Gridded Estimator (ITGE) to measure the angular power spectrum $(C_{\ell})$ of the sky signal directly from the visibilities measured in radio-interferometric observations. The ITGE allows us to modulate the sky response through a window function which is implemented in the image plane, and it is possible to choose a wide variety of window functions. In the context of the cosmological HI 21-cm signal, this is useful for masking out the sky signal from specific directions which have strong residual foregrounds. In the context of the ISM in external galaxies, t…
The most commonly used estimators of the anisotropic galaxy power spectrum employ Fast Fourier transforms, and rely on a specific choice of the line-of-sight that breaks the symmetry between the galaxy pair. This leads to wide-angle effects, including the presence of odd power spectrum multipoles like the dipole ($\ell = 1$) and octopole ($\ell = 3$). In Fourier-space these wide-angle effects also couple to the survey window function. We present a self-consistent framework extending the commonly used window function treatment to include the wide-angle effects. We show that our framework can su…
Estimating the cross-correlation power spectra of cosmic microwave background (CMB), in particular, the T B and EB spectra, is important for testing parity symmetry in cosmology and diagnosing insidious instruments systematics. The Quadratic Maximum Likelihood (QML) estimator provides the optimal estimates of power spectra, but it is computationally very expensive. The hybrid pseudo-Cl estimator is computationally fast but performs poorly on large scales. As a natural extension of previous work (Chen et al. 2021), in this article, we present a new unbiased estimator based on the Smith-Zaldarri…
We study the behavior of internal signal chain reflections and antenna cross coupling as systematics for 21 cm cosmological surveys. We outline the mathematics for how these systematics appear in interferometric visibilities and describe their phenomenology. We then describe techniques for modeling and removing these systematics without attenuating the 21 cm signal in the data. This has critical implications for low-frequency radio surveys aiming to characterize the 21cm signal from the Epoch of Reionization and Cosmic Dawn, as systematics can cause bright foreground emission to contaminate th…
Cosmic shear can only be measured where there are galaxies. This source-lens clustering (SLC) effect has two sources, intrinsic source clustering and cosmic magnification (magnification/size bias). Lensing tomography can suppress the former. However, this reduction is limited by the existence of photo-z error and nonzero redshift bin width. Furthermore, SLC induced by cosmic magnification cannot be reduced by lensing tomography. Through N-body simulations, we quantify the impact of SLC on the lensing power spectrum in the context of lensing tomography. We consider both the standard estimator a…
In this paper we establish the accuracy and robustness of a fast estimator for the bispectrum - the "FFT bispectrum estimator". The implementation of the estimator presented here offers speed and simplicity benefits over a direct sampling approach. We also generalise the derivation so it may be easily be applied to any order polyspectra, such as the trispectrum, with the cost of only a handful of FFTs. All lower order statistics can also be calculated simultaneously for little extra cost. To test the estimator we make use of a non-linear density field, and for a more strongly non-Gaussian test…
Traditional estimators of the galaxy power spectrum and bispectrum are sensitive to the survey geometry. They yield spectra that differ from the true underlying signal since they are convolved with the window function of the survey. For the current and future generations of experiments, this bias is statistically significant on large scales. It is thus imperative that the effect of the window function on the summary statistics of the galaxy distribution is accurately modelled. Moreover, this operation must be computationally efficient in order to allow sampling posterior probabilities while pe…
In many astrophysical settings covariance matrices of large datasets have to be determined empirically from a finite number of mock realisations. The resulting noise degrades inference and precludes it completely if there are fewer realisations than data points. This work applies a recently proposed non-linear shrinkage estimator of covariance to a realistic example from large-scale structure cosmology. After optimising its performance for the usage in likelihood expressions, the shrinkage estimator yields subdominant bias and variance comparable to that of the standard estimator with a factor…
