arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.16906cs.LG
收藏

CADM:基于混淆模型的块数据流实漂移检测方法

CADM: Confusion Model-based Detection Method for Real-drift in Chunk Data Stream

Beijing Institute of Technology(北京理工大学);Tsinghua University(清华大学)

Songqiao Hu, Zeyi Liu, Xiao He

摘要:

概念漂移检测由于其在健康监测和故障诊断等实际应用中的重要性而引起了人们的广泛关注。传统上,大多数先进的方法在环境的评价标准发生变化(即概念漂移)时性能较差,只能检测和适应虚拟漂移。在本文中,我们提出了一种新的方法来检测块数据流中的实际漂移有限的注释的基础上概念混淆。当新的数据块到达时,我们使用真实标签和伪标签来更新预测和漂移检测后的模型。在这种情况下,一旦发生漂移,模型将被混淆并产生预测差异。然后,我们采用余弦相似性来衡量差异。并提出了一种自适应阈值法来发现异常值。实验结果表明,该方法具有较低的虚警率和漏报率与利用不同的分类器。

英文摘要:

Concept drift detection has attracted considerable attention due to its importance in many real-world applications such as health monitoring and fault diagnosis. Conventionally, most advanced approaches will be of poor performance when the evaluation criteria of the environment has changed (i.e. concept drift), either can only detect and adapt to virtual drift. In this paper, we propose a new approach to detect real-drift in the chunk data stream with limited annotations based on concept confusion. When a new data chunk arrives, we use both real labels and pseudo labels to update the model after prediction and drift detection. In this context, the model will be confused and yields prediction difference once drift occurs. We then adopt cosine similarity to measure the difference. And an adaptive threshold method is proposed to find the abnormal value. Experiments show that our method has a low false alarm rate and false negative rate with the utilization of different classifiers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑