arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2207.08640cs.LG
收藏

数据流的轻量级自动化特征监控

Lightweight Automated Feature Monitoring for Data Streams

Feedzai

João Conde, Ricardo Moreira, João Torres, Pedro Cardoso, Hugo R. C. Ferreira, Marco O. P. Sampaio, João Tiago Ascensão, Pedro Bizarro

摘要:

监控自动实时流处理系统的行为已经成为现实世界应用中最相关的问题之一。这种系统的复杂性已经严重依赖于高维输入数据和数据饥渴的机器学习(ML)算法。我们提出了一个灵活的系统,功能监控(FM),检测数据漂移,在这样的数据集,在流媒体应用程序中具有小而恒定的内存占用和小的计算成本。该方法基于多变量统计检验,并且是由设计驱动的数据(根据数据估计全参考分布)。它监控系统使用的所有功能,同时在发生警报时提供可解释的功能排名(以帮助进行根本原因分析)。该系统的计算和存储器亮度是由于使用指数移动直方图。在我们的实验研究中,我们分析了系统的行为与其参数,更重要的是,显示的例子中,它检测到的问题是不直接相关的单一功能。这说明了FM如何消除添加自定义信号来检测特定类型问题的需要,并且监视功能的可用空间通常就足够了。

英文摘要:

Monitoring the behavior of automated real-time stream processing systems has become one of the most relevant problems in real world applications. Such systems have grown in complexity relying heavily on high dimensional input data, and data hungry Machine Learning (ML) algorithms. We propose a flexible system, Feature Monitoring (FM), that detects data drifts in such data sets, with a small and constant memory footprint and a small computational cost in streaming applications. The method is based on a multi-variate statistical test and is data driven by design (full reference distributions are estimated from the data). It monitors all features that are used by the system, while providing an interpretable features ranking whenever an alarm occurs (to aid in root cause analysis). The computational and memory lightness of the system results from the use of Exponential Moving Histograms. In our experimental study, we analyze the system's behavior with its parameters and, more importantly, show examples where it detects problems that are not directly related to a single feature. This illustrates how FM eliminates the need to add custom signals to detect specific types of problems and that monitoring the available space of features is often enough.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑