Mapping the Galaxy Color-Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
Daniel Masters, Peter Capak, Daniel Stern, Olivier Ilbert, Mara Salvato, Samuel Schmidt, Giuseppe Longo, Jason Rhodes, Stephane Paltani, Bahram Mobasher, Henk H… 展开作者
Daniel Masters, Peter Capak, Daniel Stern, Olivier Ilbert, Mara Salvato, Samuel Schmidt, Giuseppe Longo, Jason Rhodes, Stephane Paltani, Bahram Mobasher, Henk Hoekstra, Hendrik Hildebrandt, Jean Coupon, Charles Steinhardt, Josh Speagle, Andreas Faisst, Adam Kalinich, Mark Brodwin, Massimo Brescia, Stefano Cavuoti
Calibrating the photometric redshifts of >10^9 galaxies for upcoming weak lensing cosmology experiments is a major challenge for the astrophysics community. The path to obtaining the required spectroscopic redshifts for training and calibration is daunting, given the anticipated depths of the surveys and the difficulty in obtaining secure redshifts for some faint galaxy populations. Here we present an analysis of the problem based on the self-organizing map, a method of mapping the distribution of data in a high-dimensional space and projecting it onto a lower-dimensional representation. We apply this method to existing photometric data from the COSMOS survey selected to approximate the anticipated Euclid weak lensing sample, enabling us to robustly map the empirical distribution of galaxies in the multidimensional color space defined by the expected Euclid filters. Mapping this multicolor distribution lets us determine where - in galaxy color space - redshifts from current spectroscopic surveys exist and where they are systematically missing. Crucially, the method lets us determine whether a spectroscopic training sample is representative of the full photometric space occupied by the galaxies in a survey. We explore optimal sampling techniques and estimate the additional spectroscopy needed to map out the color-redshift relation, finding that sampling the galaxy distribution in color space in a systematic way can efficiently meet the calibration requirements. While the analysis presented here focuses on the Euclid survey, similar analysis can be applied to other surveys facing the same calibration challenge, such as DES, LSST, and WFIRST.
Weak gravitational lensing is one of the most promising cosmological probes to constrain dark matter, dark energy, and the nature of gravity at cosmic scales. Intrinsic alignments (IAs) of galaxies have been recognized as one of the most serious systematic effects facing gravitational lensing. Such alignments must be isolated and removed to obtain a pure lensing signal. Furthermore, the alignments are related to the processes of galaxy formation, so their extracted signal can help in understanding such formation processes and improving their theoretical modeling. We report in this Letter the f…
We present results exploring the role that probabilistic deep learning models can play in cosmology from large scale astronomical surveys through estimating the distances to galaxies (redshifts) from photometry. Due to the massive scale of data coming from these new and upcoming sky surveys, machine learning techniques using galaxy photometry are increasingly adopted to predict galactic redshifts which are important for inferring cosmological parameters such as the nature of dark energy. Associated uncertainty estimates are also critical measurements, however, common machine learning methods t…
The evaluation of the physical parameters or effects such as the luminosity function (LF) or the photometric maximum (PM) for galaxies is routinely modeled by their spectroscopic redshift. Here, we model LF and PM for galaxies by the photometric redshift as given by the Spitzer Wide-Area Infrared Extragalactic (SWIRE) catalog in the framework of a lognormal LF. In addition, we compare our model with the Schechter LF for galaxies. The adopted cosmological framework is that of the flat cosmology.
Photo-z error is one of the major sources of systematics degrading the accuracy of weak lensing cosmological inferences. Zhang et al. (2010) proposed a self-calibration method combining galaxy-galaxy correlations and galaxy-shear correlations between different photo-z bins. Fisher matrix analysis shows that it can determine the rate of photo-z outliers at a level of 0.01-1% merely using photometric data and do not rely on any prior knowledge. In this paper, we develop a new algorithm to implement this method by solving a constrained nonlinear optimization problem arising in the self-calibratio…
One of the principal challenges of 21 cm cosmology experiments is overcoming calibration error. Established calibration approaches in the field require an exquisitely accurate sky model, and low-level sky model errors introduce calibration errors that corrupt the cosmological signal. We present a novel calibration approach called Delay-Weighted Calibration, or DWCal, that enables precise calibration even in the presence of sky model error. Sky model error does not affect all power spectrum modes equally, and DWCal fits calibration solutions preferentially from error-free modes. We apply this t…
We develop a general method to "self-calibrate" observations of galaxy clustering with respect to systematics associated with photometric calibration errors. We first point out the danger posed by the multiplicative effect of calibration errors, where large-angle error propagates to small scales and may be significant even if the large-scale information is cleaned or not used in the cosmological analysis. We then propose a method to measure the arbitrary large-scale calibration errors and use these measurements to correct the small-scale (high-multipole) power which is most useful for constrai…
Some million Type Ia supernovae (SN) will be discovered and monitored during upcoming wide area time domain surveys such as the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). For cosmological use, accurate redshifts are needed among other characteristics; however the vast majority of the SN will not have spectroscopic redshifts, even for their host galaxies, only photometric redshifts. We assess the redshift systematic control necessary for robust cosmology. Based on the photometric vs true redshift relation generated by machine learning applied to a simulation of 500,000 ga…
The observing strategy of a galaxy survey influences the degree to which its resulting data can be used to accomplish any science goal. LSST is thus seeking metrics of observing strategies for multiple science cases in order to optimally choose a cadence. Photometric redshifts are essential for many extragalactic science applications of LSST's data, including but not limited to cosmology, but there are few metrics available, and they are not straightforwardly integrated with metrics of other cadence-dependent quantities that may influence any given use case. We propose a metric for observing s…
The uncertainty in the photometric redshift estimation is one of the major systematics in weak lensing cosmology. The self-calibration method is able to reduce this systematics without assuming strong priors. We improve the recently proposed self-calibration algorithm to enhance the stability and robustness with the noisy measurement. The improved algorithm is tested on the power spectra measured from the simulated catalogues constructed according to DECaLS DR8 photometric catalogue. For the fiducial analysis with 5 equal-width redshift bins over $0<z<1$ and 6 bands over scales $100 \leq \ell<…
We present a calibration of the Tip of the Red Giant Branch (TRGB) in the Large Magellanic Cloud (LMC) on the HST/ACS F814W system. We use archival HST observations to derive blending corrections and photometric transformations for two ground-based wide-area imaging surveys of the Magellanic Clouds. We show that these surveys are biased bright by up to ~0.1 mag in the optical due to blending, and that the bias is a function of local stellar density. We correct the LMC TRGB magnitudes from Jang & Lee (2017) and use the geometric distance from Pietrzynski et al. (2019) to obtain an absolute TRGB…
We study the potential of the kinematic SZ effect as a probe for cosmology, focusing on the pairwise method. The main challenge is disentangling the cosmologically interesting mean pairwise velocity from the cluster optical depth and the associated uncertainties on the baryonic physics in clusters. Furthermore, the pairwise kSZ signal might be affected by internal cluster motions or correlations between velocity and optical depth. We investigate these effects using the Magneticum cosmological hydrodynamical simulations, one of the largest simulations of this kind performed to date. We produce …
The XMM Cluster Archive Super Survey (X-CLASS) is a serendipitously-detected X-ray-selected sample of 845 galaxy clusters based on 2774 XMM archival observations and covering approximately 90 deg$^2$ spread across the high-Galactic latitude ($|b|>20$ deg) sky. The primary goal of this survey is to produce a well-selected sample of galaxy clusters on which cosmological analyses can be performed. This article presents the photometric redshift followup of a high signal-to-noise subset of 266 of these clusters with declination $δ<+20$ deg with GROND, a seven channel ($grizJHK$) simultaneous imager…
Precise instrument calibration is critical to the success of 21 cm Cosmology experiments. Unmitigated errors in calibration contaminate the Epoch of Reionization (EoR) signal, precluding a detection. Barry et al. 2016 characterizes one class of inherent errors that emerge from calibrating to an incomplete sky model, however it has been unclear if errors in the sky model affect the calibration of redundant arrays. In this paper, we show that redundant calibration is vulnerable to errors from sky model incompleteness even in the limit of perfect antenna positioning and identical beams. These err…
We present a method of calibrating the properties of photometric redshift bins as part of a larger Markov Chain Monte Carlo (MCMC) analysis for the inference of cosmological parameters. The redshift bins are characterised by their mean and variance, which are varied as free parameters and marginalised over when obtaining the cosmological parameters. We demonstrate that the likelihood function for cross-correlations in an angular power spectrum framework tightly constrains the properties of bins such that they may be well determined, reducing their influence on cosmological parameters and avoid…
Calibration precision is currently a limiting systematic in 21 cm cosmology experiments. While there are innumerable calibration approaches, most can be categorized as either `sky-based,' relying on an extremely accurate model of astronomical foreground emission, or `redundant,' requiring a precisely regular array with near-identical antenna response patterns. Both of these classes of calibration are inflexible to the realities of interferometric measurement. In practice, errors in the foreground model, antenna position offsets, and beam response inhomogeneities degrade calibration performance…
Accurate photometric redshift calibration is central to the robustness of all cosmology constraints from cosmic shear surveys. Analyses of the KiDS re-weighted training samples from all overlapping spectroscopic surveys to provide a direct redshift calibration. Using self-organising maps (SOMs) we demonstrate that this spectroscopic compilation is sufficiently complete for KiDS, representing $99\%$ of the effective 2D cosmic shear sample. We use the SOM to define a $100\%$ represented `gold' cosmic shear sample, per tomographic bin. Using mock simulations of KiDS and the spectroscopic training…
We present a new method for joint cosmological parameter inference and cluster mass calibration from a combination of weak lensing measurements and the abundance of thermal Sunyaev-Zel'dovich (tSZ) selected galaxy clusters. We combine cluster counts with the spherical harmonic cosmic shear power spectrum and the cross-correlation between cluster overdensity and cosmic shear. These correlations constrain the cluster mass-observable relation. We model the observables using a halo model framework, including their full non-Gaussian covariance. Forecasting constraints on cosmological and mass calib…
This white paper summarizes the conclusions of the Snowmass White Paper "Spectroscopic Needs for Imaging Dark Energy Experiments" (arXiv:1309.5384) which are relevant to the calibration of LSST photometric redshifts; i.e., the accurate characterization of biases and uncertainties in photo-z's. Any significant miscalibration will lead to systematic errors in photo-z's, impacting nearly all extragalactic science with LSST. As existing deep redshift samples have failed to yield highly-secure redshifts for a systematic 20%-60% of their targets, it is a strong possibility that future deep spectrosc…
The cosmological exploitation of modern photometric galaxy surveys requires both accurate (unbiased) and precise (narrow) redshift probability distributions derived from broadband photometry. Existing methodologies do not meet those requirements. Standard template fitting delivers interpretable models and errors, but lacks flexibility to learn inaccuracies in the observed photometry or the spectral templates. Machine learning addresses those issues, but requires representative training data, and the resulting models and uncertainties cannot be interpreted in the context of a physical model or …
21 cm cosmology is a promising new probe of the evolution of visible matter in our universe, especially during the poorly-constrained Cosmic Dawn and Epoch of Reionization. However, in order to separate the 21 cm signal from bright astrophysical foregrounds, we need an exquisite understanding of our telescopes so as to avoid adding spectral structure to spectrally-smooth foregrounds. One powerful calibration method relies on repeated simultaneous measurements of the same interferometric baseline to solve for the sky signal and for instrumental parameters simultaneously. However, certain degree…
We compare the absolute gain photometric calibration of the Planck/HFI and Herschel/SPIRE instruments on diffuse emission. The absolute calibration of HFI and SPIRE each relies on planet flux measurements and comparison with theoretical far-infrared emission models of planetary atmospheres. We measure the photometric cross calibration between the instruments at two overlapping bands, 545 GHz / 500 $μ$m and 857 GHz / 350 $μ$m. The SPIRE maps used have been processed in the Herschel Interactive Processing Environment (Version 12) and the HFI data are from the 2015 Public Data Release 2. For our …
Galaxy cross-correlations with high-fidelity redshift samples hold the potential to precisely calibrate systematic photometric redshift uncertainties arising from the unavailability of complete and representative training and validation samples of galaxies. However, application of this technique in the Dark Energy Survey (DES) is hampered by the relatively low number density, small area, and modest redshift overlap between photometric and spectroscopic samples. We propose instead using photometric catalogs with reliable photometric redshifts for photo-z calibration via cross-correlations. We v…
The expansion of our Universe is accelerating, due to dark energy. But the nature of dark energy has been a mystery since its discovery at the end of the past century. In Research Highlight https://doi.org/10.1002/ntls.20220003 , Justin Albert, Dmitry Budker and Hossein Sadeghpour provide an overview of how a laser photometric ratio star (a novel light source generated by laser excitation of the Earth's upper-atmospheric sodium layer, which will radiate equally brightly at wavelengths of 589 nm and 820 nm) can help us precisely calibrate telescopes in order to understand the nature of dark ene…
Current and future Cosmic Microwave Background (CMB) Radiation experiments are targeting the polarized $B$-mode signal. The small amplitude of this signal makes a successful measurement challenging for current technologies. Therefore, very accurate studies to mitigate and control possible systematic effects are vital to achieve a successful observation. An additional challenge is coming from the presence of polarized Galactic foreground signals that contaminate the CMB signal. When they are combined, the foreground signals dominate the polarized CMB signal at almost every relevant frequency. F…
A Fully Photometric Approach to Type Ia Supernova Cosmology in the LSST Era: Host Galaxy Redshifts and Supernova Classification
National Center for Supercomputing Applications（国家超级计算应用中心）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；University of Chicago（芝加哥大学）；Stanford University（斯坦福大学）；SLAC National Accelerator Laboratory（SLAC国家加速器实验室）；Massachusetts Institute of Technology（麻省理工学院）；Center for Astrophysics | Harvard & Smithsonian（天体物理中心|哈佛与史密森尼学会）；The Inter-University Centre for Astronomy and Astrophysics (IUCAA)（大学间天文学和天体物理学中心）
We use N-body-spectro-photometric simulations to investigate the impact of incompleteness and incorrect redshifts in spectroscopic surveys to photometric redshift training and calibration and the resulting effects on cosmological parameter estimation from weak lensing shear-shear correlations. The photometry of the simulations is modeled after the upcoming Dark Energy Survey and the spectroscopy is based on a low/intermediate resolution spectrograph with wavelength coverage of 5500Å < λ < 9500Å. The principal systematic errors that such a spectroscopic follow-up encounters are incompleteness (…
We present a method that accurately propagates residual uncertainties in photometric redshift distributions into the cosmological inference from weak lensing measurements. The redshift distributions of tomographic redshift bins are parameterised using a flexible modified Gaussian mixture model. We fit this model to pre-calibrated redshift distributions and implement an analytic marginalisation over the potentially several hundred redshift nuisance parameters in the weak lensing likelihood, which is demonstrated to accurately recover the cosmological posterior. By iteratively fitting cosmologic…
Photometric redshift requirements for lens galaxies in galaxy-galaxy lensing analyses
弱引力透镜是研究星系形成和宇宙学的重要工具。在这里，我们量化的影响，使用光度红移（photo-z）在星系星系透镜，无论是源和镜头，无论是直接的目标，使用星系与photo-z作为镜头在斯隆数字巡天（SDSS），并作为一个示范的方法，为大型，即将到来的弱透镜调查，将由必然的主导镜头样本与photo-z。我们计算了透镜质量校准中的偏差以及绝对幅度的结果（即，k-校正）和恒星质量的估计，SDSS数据发布8（DR 8）星系的大样本。在SDSS DR 8 ugriz光度计上用基于模板的光z代码ZEBRA获得红移。我们组装和校准样品（~ 9 k光谱红移从四个调查），以获得光度红移误差和透镜偏差对应于我们的完整的SDSS DR 8镜头和源目录。我们对校准样品的测试还突出了当光谱校准覆盖其足迹的一小部分时成像调查中观察条件的影响;校准场中的非典型成像条件可能导致关于完整调查的照片z的错误结论。对于SDSS DR 8星表，透镜星表和源星表的σ_z/（1+z）分别为0.096和0.113，通量极限分别为r=21和r=21.8。我们还探讨了系统的不确定性时，使用源photo-z的透镜信号校准，镜头和源photo-z;鉴于现有的训练样本的大小，我们可以限制透镜信号校准（因此归一化的表面质量密度）分别在2%和4%。[删节]
Recently, the common methodology used to transform type Ia supernovae (SNe Ia) into genuine standard candles has been suffering criticism. Indeed, it assumes a particular cosmological model (namely the flat $Λ$CDM) to calibrate the standardisation corrections parameters, i.e. the dependency of the supernova peak absolute magnitude on its colour, post-maximum decline rate and host galaxy mass. As a result, this assumption could make the data compliant to the assumed cosmology and thus nullify all works previously conducted on model comparison. In this work, we verify the viability of these hypo…
China Space Station Telescope (CSST) is a forthcoming powerful Stage IV space-based optical survey equipment. It is expected to explore a number of important cosmological problems in extremely high precision. In this work, we focus on investigating the constraints on neutrino mass and other cosmological parameters under the model of cold dark matter with a constant equation of state of dark energy ($w$CDM), using the mock data from the CSST photometric galaxy clustering and cosmic shear surveys (i.e. 3$\times$2pt). The systematics from galaxy bias, photometric redshift uncertainties, intrinsic…
The halo mass function (HMF) is a critical element in cosmological analyses of galaxy cluster catalogs. We quantify the impact of uncertainties in HMF parameters on cosmological constraints from cluster catalogs similar to those from Planck, those expected from the Euclid, Roman and Rubin surveys, and from a hypothetical larger future survey. We analyse simulated catalogs in each case, gradually loosening priors on HMF parameters to evaluate the degradation in cosmological constraints. While current uncertainties on HMF parameters do not substantially impact Planck-like surveys, we find that t…
Large sets of objects with spectroscopic redshift measurements will be needed for imaging dark energy experiments to achieve their full potential, serving two goals:_training_, i.e., the use of objects with known redshift to develop and optimize photometric redshift algorithms; and_calibration_, i.e., the characterization of moments of redshift (or photo-z error) distributions. Better training makes cosmological constraints from a given experiment stronger, while highly-accurate calibration is needed for photo-z systematics not to dominate errors. In this white paper, we investigate the requir…
Weak gravitational lensing is becoming a mature technique for constraining cosmological parameters, and future surveys will be able to constrain the dark energy equation of state $w$. When analyzing galaxy surveys, redshift information has proven to be a valuable addition to angular shear correlations. We forecast parameter constraints on the triplet $(Ω_m,w,σ_8)$ for an LSST-like photometric galaxy survey, using tomography of the shear-shear power spectrum, convergence peak counts and higher convergence moments. We find that redshift tomography with the power spectrum reduces the area of the …
We investigate the expected cosmological constraints from a combination of weak lensing and large-scale galaxy clustering using realistic redshift distributions. Introducing a systematic bias in the weak lensing redshift distributions (of 0.05 in redshift) produces a $>2σ$ bias in the recovered matter power spectrum amplitude and dark energy equation of state, for preliminary Stage III surveys. We demonstrate that these cosmological errors can be largely removed by marginalising over unknown biases in the assumed weak lensing redshift distributions, if we assume high quality redshift informati…
The mass of galaxy clusters can be inferred from the temperature of their X-ray emitting gas, $T_{\mathrm{X}}$. Their masses may be underestimated if it is assumed that the gas is in hydrostatic equilibrium, by an amount $b^{\mathrm{hyd}}\sim(20\pm10)$ % suggested by simulations. We have previously found consistency between a sample of observed \textit{Chandra} X-ray masses and independent weak lensing measurements. Unfortunately, uncertainties in the instrumental calibration of {\em Chandra} and {\em XMM-Newton} observatories mean that they measure different temperatures for the same gas. In …
Machine Learning Closure Audits for LSST Photometric Supernova Cosmology
Center for AstroPhysical Surveys, National Center for Supercomputing Applications（国家超级计算应用中心天体物理调查中心）；Department of Astronomy, University of Illinois at Urbana Champaign（伊利诺伊大学厄巴纳-香槟分校天文系）
We consider the application of relative self-calibration using overlap regions to spectroscopic galaxy surveys that use slit-less spectroscopy. This method is based on that developed for the SDSS by Padmanabhan at al. (2008) in that we consider jointly fitting and marginalising over calibrator brightness, rather than treating these as free parameters. However, we separate the calibration of the detector-to-detector from the full-focal-plane exposure-to-exposure calibration. To demonstrate how the calibration procedure will work, we simulate the procedure for a potential implementation of the s…
Type Ia supernovae (SNe Ia) measurements of the Hubble constant, H$_0$, the cosmological mass density, $Ω_M$, and the dark energy equation-of-state parameter, $w$, rely on numerous SNe surveys using distinct photometric systems across three decades of observation. Here, we determine the sensitivities of the upcoming SH0ES+Pantheon+ constraints on H$_0$, $Ω_M$, and $w$ to unknown systematics in the relative photometric zeropoint calibration between the 17 surveys that comprise the Pantheon+ supernovae data set. Varying the zeropoints of these surveys simultaneously with the cosmological paramet…
Foreground mitigation is critical to all next-generation radio interferometers that target cosmology using the redshifted neutral hydrogen 21 cm emission line. Attempts to remove this foreground emission have led to new analysis techniques as well as new developments in hardware specifically dedicated to instrument beam and gain calibration, including stabilized signal injection into the interferometric array and drone-based platforms for beam mapping. The radio calibration sources currently used in the literature are broad-band incoherent sources that can only be detected as excess power and …
Mass calibration uncertainty is the largest systematic effect for using clusters of galaxies to constrain cosmological parameters. We present weak lensing mass measurements from the Canada-France-Hawaii Telescope Stripe 82 Survey for galaxy clusters selected through their high signal-to-noise thermal Sunyaev-Zeldovich (tSZ) signal measured with the Atacama Cosmology Telescope (ACT). For a sample of 9 ACT clusters with a tSZ signal-to-noise greater than five the average weak lensing mass is $\left(4.8\pm0.8\right)\,\times10^{14}\,\mathrm{M}_\odot$, consistent with the tSZ mass estimate of $\lef…
