一种两阶段的高维数据流在线监测方法
A Two-stage Online Monitoring Procedure for High-Dimensional Data Streams
摘要:
先进的计算技术和数据采集技术使得许多领域的高维数据流采集成为可能。高效的在线监测工具,可以正确地识别任何异常的数据流,这些数据是非常抢手的。然而,大多数现有的监控程序直接应用错误发现率(FDR)控制程序的数据在每个时间点,并在每个时间点的FDR(逐点FDR)是由用户指定或由控制(IC)的平均游程长度(ARL)确定。如果逐点FDR是由用户指定的,则产生的过程缺乏对全局FDR的控制,并且使用户在IC-ARL方面处于黑暗中。如果逐点FDR由IC-ARL确定,则所得到的过程不给予用户选择他们在识别异常数据流时可以容忍的假警报(第一类错误)的数量的灵活性,这通常使得过程过于保守。为了解决这些限制,我们提出了一个两阶段的监测程序,可以控制在用户指定的水平的IC-ARL和第一类错误。因此,所提出的程序允许用户不仅选择当所有数据流都是IC时他们期望任何假警报的频率,而且还可以选择当识别异常数据流时他们可以容忍多少假警报。有了这种额外的灵活性,我们提出的两阶段监测程序在模拟研究和实际数据分析中显示优于现有的方法。
英文摘要:
Advanced computing and data acquisition technologies have made possible the collection of high-dimensional data streams in many fields. Efficient online monitoring tools which can correctly identify any abnormal data stream for such data are highly sought after. However, most of the existing monitoring procedures directly apply the false discover rate (FDR) controlling procedure to the data at each time point, and the FDR at each time point (the point-wise FDR) is either specified by users or determined by the in-control (IC) average run length (ARL). If the point-wise FDR is specified by users, the resulting procedure lacks control of the global FDR and keeps users in the dark in terms of the IC-ARL. If the point-wise FDR is determined by the IC-ARL, the resulting procedure does not give users the flexibility to choose the number of false alarms (Type-I errors) they can tolerate when identifying abnormal data streams, which often makes the procedure too conservative. To address those limitations, we propose a two-stage monitoring procedure that can control both the IC-ARL and Type-I errors at the levels specified by users. As a result, the proposed procedure allows users to choose not only how often they expect any false alarms when all data streams are IC, but also how many false alarms they can tolerate when identifying abnormal data streams. With this extra flexibility, our proposed two-stage monitoring procedure is shown in the simulation study and real data analysis to outperform the exiting methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。