arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1906.02265stat.MEmath.STstat.TH
收藏

大规模数据流的鲁棒变化检测

Robust Change Detection for Large-Scale Data Streams

Ruizhi Zhang, Yajun Mei, Jianjun Shi

摘要:

大规模数据流的鲁棒变点检测在工业质量控制、信号检测、生物监测等领域有着广泛的应用。不幸的是,由于三个挑战,开发有效的方案是非常重要的:(1)受影响的数据流的未知稀疏子集,(2)意外的离群值,以及(3)实时监控和检测的计算可扩展性。在这篇文章中,我们开发了一个家庭的有效的实时鲁棒检测计划监测大规模的独立数据流。对于每个数据流,我们建议构造一个新的本地鲁棒检测统计量称为$L_α$-$L_α$统计量,可以通过使用似然函数的Box-Cox变换来减少离群值的影响。然后,全局方案将基于这些局部$L_α$-$L_α$统计的收缩变换的总和来发出警报,以便过滤掉未受影响的数据流。此外,我们提出了一个新的概念,称为{\em虚警击穿点}来衡量在线监测方案的鲁棒性,并提出了一个最坏情况下的检测效率得分来衡量检测效率时,数据包含离群值。然后,我们的故障点和我们提出的计划的效率得分的特点。渐近分析和数值模拟表明,我们提出的方案的鲁棒性和效率。

英文摘要:

Robust change-point detection for large-scale data streams has many real-world applications in industrial quality control, signal detection, biosurveillance. Unfortunately, it is highly non-trivial to develop efficient schemes due to three challenges: (1) the unknown sparse subset of affected data streams, (2) the unexpected outliers, and (3) computational scalability for real-time monitoring and detection. In this article, we develop a family of efficient real-time robust detection schemes for monitoring large-scale independent data streams. For each data stream, we propose to construct a new local robust detection statistic called $L_α$-CUSUM statistic that can reduce the effect of outliers by using the Box-Cox transformation of the likelihood function. Then the global scheme will raise an alarm based upon the sum of the shrinkage transformation of these local $L_α$-CUSUM statistics so as to filter out unaffected data streams. In addition, we propose a new concept called {\em false alarm breakdown point} to measure the robustness of online monitoring schemes and propose a worst-case detection efficiency score to measure the detection efficiency when the data contain outliers. We then characterize the breakdown point and the efficiency score of our proposed schemes. Asymptotic analysis and numerical simulations are conducted to illustrate the robustness and efficiency of our proposed schemes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑