基于弱数据切片的机器学习模型漂移检测
Machine Learning Model Drift Detection Via Weak Data Slices
摘要:
检测机器学习(ML)模型的性能漂移是一个公认的挑战。为了使ML模型成为业务应用程序的一个组成部分,必须检测ML模型何时偏离可接受的操作。然而,通常情况下,实际的标签很难获得,而且价格昂贵,例如,因为它们需要专家判断。因此,需要在没有标记的情况下检测ML操作中可能的劣化的方法。我们提出了一种方法,利用特征空间规则,称为数据切片,漂移检测。我们提供的实验表明,我们的方法可能会识别出ML模型可能会根据底层数据的变化而改变性能。
英文摘要:
Detecting drift in performance of Machine Learning (ML) models is an acknowledged challenge. For ML models to become an integral part of business applications it is essential to detect when an ML model drifts away from acceptable operation. However, it is often the case that actual labels are difficult and expensive to get, for example, because they require expert judgment. Therefore, there is a need for methods that detect likely degradation in ML operation without labels. We propose a method that utilizes feature space rules, called data slices, for drift detection. We provide experimental indications that our method is likely to identify that the ML model will likely change in performance, based on changes in the underlying data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。