arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1702.08435eess.SYcs.SYmath.OCstat.ML
收藏

通过马尔可夫模型的复合假设检验进行统计异常检测

Statistical Anomaly Detection via Composite Hypothesis Testing for Markov Models

Boston University(波士顿大学)

Jing Zhang, Ioannis Ch. Paschalidis

AI总结:

本文提出一种基于复合假设检验的新估计器,用于改进异常检测中的阈值估计,在通信网络和交通网络中验证了其在减少误报和保持检测概率方面的优势。

摘要:

在马尔可夫假设下,我们利用检验统计量中经验测度的中心极限定理(CLT),以建立检验统计量的弱收敛结果,并由此推导出新的阈值估计器。我们通过广泛的数值实验展示了该估计器优于现有估计器的优势,发现其在控制误报的同时保持了满意的检测概率。随后,我们将该Hoeffding检验与我们的阈值估计器应用于两个不同的应用领域:通信网络和交通网络。前者旨在增强网络安全,后者旨在构建智能交通系统。

英文摘要:

Under Markovian assumptions, we leverage a Central Limit Theorem (CLT) for the empirical measure in the test statistic of the composite hypothesis Hoeffding test so as to establish weak convergence results for the test statistic, and, thereby, derive a new estimator for the threshold needed by the test. We first show the advantages of our estimator over an existing estimator by conducting extensive numerical experiments. We find that our estimator controls better for false alarms while maintaining satisfactory detection probabilities. We then apply the Hoeffding test with our threshold estimator to detecting anomalies in two distinct applications domains: one in communication networks and the other in transportation networks. The former application seeks to enhance cyber security and the latter aims at building smarter transportation systems in cities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑