There are several networks of precision quantum sensors in existence, including networks of atomic clocks, magnetometers, and gravitational wave detectors. These networks can be re-purposed for searches of exotic physics, such as direct dark matter searches. Here we explore a detection strategy for macroscopic dark matter objects with such networks using the matched-filter technique. Such "clumpy" dark matter objects would register as transients sweeping through the network at galactic velocities. As a specific example, we consider a network of atomic clocks aboard the Global Positioning System (GPS) satellites. We apply the matched-filter technique to simulated GPS atomic clock data and study its utility and performance. The analysis and the developed methodology have a wide applicability to other networks of quantum sensors.
Modern radio interferometers enable observations of spectral lines with unprecedented spatial resolution and sensitivity. In spite of these technical advances, many lines of interest are still at best weakly detected and therefore necessitate detection and analysis techniques specialized for the low signal-to-noise ratio (SNR) regime. Matched filters can leverage knowledge of the source structure and kinematics to increase sensitivity of spectral line observations. Application of the filter in the native Fourier domain improves SNR while simultaneously avoiding the computational cost and ambig…
We develop a method for planet detection in transit data, which is based on the Matched Filter technique, combined with the Gaussianization of the noise outliers. The method is based on Fourier transforms and is as fast as the existing methods for planet searches. The Gaussinized Matched Filter (GMF) method significantly outperforms the standard baseline methods in terms of the false positive rate, enabling planet detections at up to 30 % lower transit amplitudes. Moreover, the method extracts all the main planet transit parameters, amplitude, period, phase, and duration. By comparison to the …
Columbia University in the City of New York（纽约市哥伦比亚大学）；University of Florida（佛罗里达大学）
Gravitational wave science is a pioneering field with rapidly evolving data analysis methodology currently assimilating and inventing deep learning techniques. The bulk of the sophisticated flagship searches of the field rely on the time-tested matched filtering principle within their core. In this paper, we make a key observation on the relationship between the emerging deep learning and the traditional techniques: matched filtering is formally equivalent to a particular neural network. This means that a neural network can be constructed analytically to exactly implement matched filtering, an…
We have designed, fabricated and characterized absorptive thermal blocking filters for cryogenic microwave applications. The transmission line filter's input characteristic impedance is designed to match $50\,Ω$ and its response has been validated from 0-to-50\,GHz. The observed return loss in the 0-to-20\,GHz design band is greater than $20\,$dB and shows graceful degradation with frequency. Design considerations and equations are provided that enable this approach to be scaled and modified for use in other applications.
Discovered in 2011 with LOFAR, the $15$ Jy low-frequency radio transient ILT J225347+862146 heralds a potentially prolific population of radio transients at $<100$ MHz. However, subsequent transient searches in similar parameter space yielded no detections. We test the hypothesis that these surveys at comparable sensitivity have missed the population due to mismatched survey parameters. In particular, the LOFAR survey used only $195$ kHz of bandwidth at $60$ MHz while other survey were at higher frequencies or had wider bandwidth. Using $137$ hours of all-sky images from the Owens Valley Radio…
We report on the construction of a deep convolutional neural network that can reproduce the sensitivity of a matched-filtering search for binary black hole gravitational-wave signals. The standard method for the detection of well modeled transient gravitational-wave signals is matched filtering. However, the computational cost of such searches in low latency will grow dramatically as the low frequency sensitivity of gravitational-wave detectors improves. Convolutional neural networks provide a highly computationally efficient method for signal identification in which the majority of calculatio…
Matched Filtering for the Canadian Hydrogen Observatory and Radio-Transient Detector Galaxy Search
Perimeter Institute for Theoretical Physics；Waterloo Center for Astrophysics, University of Waterloo（滑铁卢大学天体物理中心）；Queen’s University（女王大学）；Arizona State University（亚利桑那州立大学）
The speedup of heavy numerical tasks by quantum computing is now actively investigated in various fields including data analysis in physics and astronomy. In this paper, we propose a new quantum algorithm for matched filtering in gravitational wave (GW) data analysis based on the previous work by Gao et al., Phys. Rev. Research 4, 023006 (2022) [arXiv:2109.01535]. Our approach uses the quantum algorithm for Monte Carlo integration for the signal-to-noise ratio (SNR) calculation instead of the fast Fourier transform used in Gao et al. and searches signal templates with high SNR by quantum ampli…
The performance of adaptive optics systems is partially dependant on the algorithms used within the real-time control system to compute wavefront slope measurements. We demonstrate use of a matched filter algorithm for the processing of elongated laser guide star (LGS) Shack-Hartmann images, using the CANARY adaptive optics instrument on the 4.2m William Herschel Telescope and the European Southern Observatory Wendelstein LGS Unit placed 40m away. This algorithm has been selected for use with the forthcoming Thirty Meter Telescope, but until now had not been demonstrated on-sky. From the resul…
FPGA-based Matched Filter Group Optimisation for SKA Pulsar Search Engine
PARC Lab, University of Auckland（奥克兰大学）；Jodrell Bank Centre for Astrophysics, University of Manchester（曼彻斯特大学）；Raman Research Institute, University of Manchester（曼彻斯特大学拉曼研究所）
Searching for gravitational waves from compact binary coalescence (CBC) is performed by matched filtering the observed strain data from gravitational-wave observatories against a discrete set of waveform templates designed to accurately approximate the expected gravitational-wave signal, and are chosen to efficiently cover a target search region. The computational cost of matched filtering scales with both the number of templates required to cover a parameter space and the in-band duration of the waveform. Both of these factors increase in difficulty as the current observatories improve in sen…
The hot ionized gas of the intra-cluster medium emits thermal radiation in the X-ray band and also distorts the cosmic microwave radiation through the Sunyaev-Zel'dovich (SZ) effect. Combining these two complementary sources of information through innovative techniques can therefore potentially improve the cluster detection rate when compared to using only one of the probes. Our aim is to build such a joint X-ray-SZ analysis tool, which will allow us to detect fainter or more distant clusters while maintaining high catalogue purity. We present a method based on matched multifrequency filters (…
Detection of templates (e.g., sources) embedded in low-number count Poisson noise is a common problem in astrophysics. Examples include source detection in X-ray images, gamma-rays, UV, neutrinos, and search for clusters of galaxies and stellar streams. However, the solutions in the X-ray-related literature are sub-optimal -- in some cases by considerable factors. Using the lemma of Neyman-Pearson we derive the optimal statistics for template detection in the presence of Poisson noise. We demonstrate that this method provides higher completeness, for a fixed false-alarm probability value, comp…
The matched filter (MF) is widely used to detect signals hidden within the noise. If the noise is Gaussian, its performances are well-known and describable in an elegant analytical form. The treatment of non-Gaussian noises is often cumbersome as in most cases there is no analytical framework. This is true also for Poisson noise which, especially in the low-number count regime, presents the additional difficulty to be discrete. For this reason in the past methods have been proposed based on heuristic or semi-heuristic arguments. Recently, an analytical form of the MF has been introduced but th…
We review the well-known matched filter method for the detection of point sources in astronomical images. This is shown to be optimal (that is, to saturate the Cramer--Rao bound) under stated conditions that are very strong: an isolated source in background-dominated imaging with perfectly known background level, point-spread function, and noise models. We show that the matched filter produces a maximum-likelihood estimate of the brightness of a purported point source, and this leads to a simple way to combine multiple images---taken through the same bandpass filter but with different noise le…
SGNAX: a unified matched-filter and excess-power pipeline for gravitational-wave detector characterization
Louisiana State University（路易斯安那州立大学）；LIGO Laboratory, California Institute of Technology（加州理工学院 LIGO 实验室）；The Pennsylvania State University（宾夕法尼亚州立大学）；University of Rhode Island（罗德岛大学）
Quantum computational devices, currently under development, have the potential to accelerate data analysis techniques beyond the ability of any classical algorithm. We propose the application of a quantum algorithm for the detection of unknown signals in noisy data. We apply Grover's algorithm to matched-filtering, a signal processing technique that compares data to a number of candidate signal templates. In comparison to the classical method, this provides a speed-up proportional to the square-root of the number of templates, which would make possible otherwise intractable searches. We demons…
Institute of Applied Physics ISU（伊尔库茨克国立大学应用物理研究所）；Karlsruhe Institute of Technology (KIT)（卡尔斯鲁厄理工学院）；University of Zürich（苏黎世大学）；Vrije Universiteit Brussel（布鲁塞尔自由大学）；Skobeltsyn Institute of Nuclear Physics MSU（莫斯科国立大学斯科别利岑核物理研究所）
The Tunka Radio Extension (Tunka-Rex) is a digital antenna array, which measures the radio emission of the cosmic-ray air-showers in the frequency band of 30-80 MHz. Tunka-Rex is co-located with TAIGA experiment in Siberia and consists of 63 antennas, 57 of them are in a densely instrumented area of about 1 km\textsuperscript{2}. In the present work we discuss the improvements of the signal reconstruction applied for the Tunka-Rex. At the first stage we implemented matched filtering using averaged signals as template. The simulation study has shown that matched filtering allows one to decrease…
Matched filters (MFs) are elegant and widely used tools to detect and measure signals that resemble a known template in noisy data. However, they can perform poorly in the presence of contaminating sources of similar or smaller spatial scale than the desired signal, especially if signal and contaminants are spatially correlated. We introduce new multicomponent MF and matched multifilter (MMF) techniques that allow for optimal reduction of the contamination introduced by sources that can be approximated by templates. The application of these new filters is demonstrated by applying them to micro…
In this paper we review the application of the matched filter (MF) technique and its application to detect weak, deterministic, smooth signals in a stationary, random, Gaussian noise. This is particular suitable in astronomy to detect emission lines in spectra and point-sources in two-dimensional maps. A detailed theoretical development is already available in many books (e.g. Kay 1998; Poor 1994; McNicol 2005; Hippenstiel 2002; Macmillan & Creelma 2005; Wickens 2002; Barkat 2005; Tuzlukov 2001; Levy 2008). Our aim is to examine some practical issues that are typically ignored in textbooks or …
Gravitational Waves (GWs) are tiny ripples in the fabric of space-time predicted by Einstein's General Relativity. Pulsar timing arrays (PTAs) are well poised to detect low frequency ($10^{-9}$ -- $10^{-7}$ Hz) GWs in the near future. There has been a significant amount of research into the detection of a stochastic background of GWs from supermassive black hole binaries (SMBHBs). Recent work has shown that single continuous sources standing out above the background may be detectable by PTAs operating at a sensitivity sufficient to detect the stochastic background. The most likely sources of c…
The matched filter (MF) represents one of the main tools to detect signals from known sources embedded in the noise. In the Gaussian case the noise is assumed to be the realization of a Gaussian random field (GRF). The most important property of the MF, the maximization of the probability of detection subject to a constant probability of false detection or false alarm (PFA), makes it one of the most popular techniques. However, the MF technique relies upon the a priori knowledge of the number and the position of the searched signals in the GRF which usually are not available. A typical way out…
We present a new matched filter algorithm for direct detection of point sources in the immediate vicinity of bright stars. The stellar Point Spread Function (PSF) is first subtracted using a Karhunen-Loéve Image Processing (KLIP) algorithm with Angular and Spectral Differential Imaging (ADI and SDI). The KLIP-induced distortion of the astrophysical signal is included in the matched filter template by computing a forward model of the PSF at every position in the image. To optimize the performance of the algorithm, we conduct extensive planet injection and recovery tests and tune the exoplanet s…
The detection reliability of weak signals is a critical issue in many astronomical contexts and may have severe consequences for determining number counts and luminosity functions, but also for optimising the use of telescope time in follow-up observations. Because of its optimal properties, one of the most popular and widely-used detection technique is the matched filter (MF). This is a linear filter designed to maximise the detectability of a signal of known structure that is buried in additive Gaussian random noise. In this work we show that in the very common situation where the number and…
The matched filter (MF) is one of the most popular and reliable techniques to the detect signals of known structure and amplitude smaller than the level of the contaminating noise. Under the assumption of stationary Gaussian noise, MF maximizes the probability of detection subject to a constant probability of false detection or false alarm (PFA). This property relies upon a priori knowledge of the position of the searched signals, which is usually not available. Recently, it has been shown that when applied in its standard form, MF may severely underestimate the PFA. As a consequence the stati…
Agentic AI for Gravitational Wave Data Analysis: A Head-to-Head Comparison of Coding Agents Executing a Matched Filter Pipeline on Einstein Telescope Simulated Data
The combination of X-ray and SZ observations can potentially improve the cluster detection efficiency when compared to using only one of these probes, since both probe the same medium: the hot ionized gas of the intra-cluster medium. We present a method based on matched multifrequency filters (MMF) for detecting galaxy clusters from SZ and X-ray surveys. This method builds on a previously proposed joint X-ray-SZ extraction method (Tarrío et al. 2016) and allows to blindly detect clusters, that is finding new clusters without knowing their position, size or redshift, by searching on SZ and X-ra…
The mass ranges of meteors, imaged by electro-optical (EO) cameras and backscatter radar receivers, for the most part do not overlap. Typical EO systems detect meteoroid masses down to 10$^{-5}$ kg or roughly magnitude +2 meteors when using moderate field of view optics, un-intensified optical components, and meteor entry velocities around 45 km/sec. This is near the high end of the mass range of typical meteor radar observations. Having the same mass meteor measured by different sensor wavelength bands would be a benefit in terms of calibrating mass estimations for both EO and radar. To that …
Matched filter (MF) techniques have been widely used for retrieval of greenhouse gas enhancements (enh.) from imaging spectroscopy datasets. While multiple algorithmic techniques and refinements have been proposed, the greenhouse gas target spectrum used for concentration enh. estimation has remained largely unaltered since the introduction of quantitative MF retrievals. The magnitude of retrieved methane and carbon dioxide enh., and thereby integrated mass enh. (IME) and estimated flux of point-source emitters, is heavily dependent on this target spectrum. Current standard use of molecular ab…
New approach to template banks of gravitational waves with higher harmonics: Reducing matched-filtering cost by over an order of magnitude
Institute for Advanced Study（高等研究院）；University of California at Santa Barbara（加州大学圣巴巴拉分校）；Tata Institute of Fundamental Research（塔塔基础研究院）；California Institute of Technology（加州理工学院）；Princeton University（普林斯顿大学）；Weizmann Institute of Science（魏茨曼科学研究所）
