arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1810.05973stat.ME
收藏

高维非欧数据的序列变点检测

Sequential Change-point Detection for High-dimensional and non-Euclidean Data

Lynna Chu, Hao Chen

摘要:

在许多应用中,在高维或非欧几里德观测的流序列中检测异常事件通常具有实际和科学意义。我们研究了一个非参数框架,利用最近邻观测信息检测在线设置中的变化。只要在样本空间上定义一个相似性度量,它就可以应用于任意维的数据和非欧数据。我们认为,在这个框架下,新的检验统计量,可以更有效地检测异常事件比现有的测试,同时保持错误发现率控制在一个固定的水平。解析公式近似的平均运行长度的新方法推导出,使它们快速适用于现代数据集。仿真研究提供支持的理论结果。所提出的方法说明了纽约市出租车数据集的分析。

英文摘要:

In many applications, it is often of practical and scientific interest to detect anomaly events in a streaming sequence of high-dimensional or non-Euclidean observations. We study a non-parametric framework that utilizes nearest neighbor information among the observations to detect changes in an online setting. It can be applied to data in arbitrary dimension and non-Euclidean data as long as a similarity measure on the sample space can be defined. We consider new test statistics under this framework that can detect anomaly events more effectively than the existing test while keeping the false discovery rate controlled at a fixed level. Analytic formulas approximating the average run lengths of the new approaches are derived to make them fast applicable to modern datasets. Simulation studies are provided to support theoretical results. The proposed approach is illustrated with an analysis of the NYC taxi dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑