arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.01010stat.ME
收藏

在窗口受限统计下序列相关结构变化检测

Sequential Change Detection in Correlation Structures with Window-Limited Statistics

The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));University of Minnesota(明尼苏达大学)

Jie Gao, Liyan Xie, Zhaoyuan Li

AI总结:

本文提出了一种在窗口受限统计下检测流数据相关结构变化的方法,通过ℓ₁和ℓ∞范数构造统计量,并结合符号翻转排列算法提升效率,实验证明其在厄尔尼诺事件预测和地震检测中表现优异。

摘要:

我们考虑在对底层数据分布假设最少的情况下,检测流数据相关结构中的变化点。针对密集和稀疏变化设置,我们基于向量化的预变化和后变化相关矩阵的平方差的ℓ₁和ℓ∞范数构造检测统计量。我们还提出了一种基于符号翻转排列的新阈值确定算法,该算法提高了我们的方法效率,尤其是在数据维度远大于窗口大小时。在无变化情况下,我们提供了所提出方法的理论保证,以平均运行长度衡量;在后变化情况下,以预期检测延迟作为衡量标准。我们评估了所提出方法在广泛模拟数据集上的性能,并展示了其有效性,其检测延迟较小,与精确最优CUSUM测试相当。最后,我们在现实数据集上展示了我们的方法的有效性,包括厄尔尼诺事件预测,在此我们实现了超过0.86的命中率,接近零的误报率,以及地震事件检测。

英文摘要:

We consider detecting change points in the correlation structure of streaming data with minimum assumptions posed on the underlying data distribution. Detection statistics are constructed for dense and sparse change settings, based on $\ell_1$ and $\ell_{\infty}$ norms of the squared difference of vectorized pre- and post-change correlation matrices, respectively. We also propose a novel threshold determination algorithm based on sign-flip permutations that enhances the efficiency of our procedure, particularly when the data dimension is large compared to the window size. Theoretical guarantees of the proposed methods are provided in terms of average run length in the no-change regime and expected detection delay in the post-change regime. We evaluate the performance of the proposed methods across a wide range of simulated datasets and demonstrate their effectiveness, with small detection delays that are comparable to the exact optimal CUSUM test. Finally, we demonstrate the effectiveness of our methods on real-world datasets, including El Ni{ñ}o event forecasting, where we achieve a state-of-the-art hit rate exceeding 0.86 with near-zero false alarms, as well as seismic event detection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑