Picket:在学习和推理过程中防止表格数据中的损坏数据
Picket: Guarding Against Corrupted Data in Tabular Data during Learning and Inference
摘要:
数据损坏是现代机器学习部署的一个障碍。损坏的数据可能会严重影响学习模型,也可能导致无效的推断。我们提出了Picket,一个简单的框架,以防止在表格数据上训练和部署机器学习模型期间发生数据损坏。对于训练阶段,Picket从训练数据中识别并移除损坏的数据点,以避免获得有偏差的模型。对于部署阶段,Picket以在线方式标记损坏的查询指向一个经过训练的机器学习模型,该模型由于噪声将导致不正确的预测。为了检测损坏的数据,Picket使用了一种用于混合类型表格数据的自监督深度学习模型,我们称之为PicketNet。为了最大限度地减少部署负担,学习PicketNet模型不需要任何人工标记的数据。Picket被设计为一个插件,可以增加任何机器学习管道的鲁棒性。我们在各种现实数据上评估Picket,考虑不同的腐败模型,包括训练和测试期间的系统性和对抗性噪声。我们表明,Picket在从SVM到神经网络的各种模型的训练和部署过程中始终可以防止数据损坏,击败了从数据质量验证模型到强大的离群检测模型的各种竞争方法。
英文摘要:
Data corruption is an impediment to modern machine learning deployments. Corrupted data can severely bias the learned model and can also lead to invalid inferences. We present, Picket, a simple framework to safeguard against data corruptions during both training and deployment of machine learning models over tabular data. For the training stage, Picket identifies and removes corrupted data points from the training data to avoid obtaining a biased model. For the deployment stage, Picket flags, in an online manner, corrupted query points to a trained machine learning model that due to noise will result in incorrect predictions. To detect corrupted data, Picket uses a self-supervised deep learning model for mixed-type tabular data, which we call PicketNet. To minimize the burden of deployment, learning a PicketNet model does not require any human-labeled data. Picket is designed as a plugin that can increase the robustness of any machine learning pipeline. We evaluate Picket on a diverse array of real-world data considering different corruption models that include systematic and adversarial noise during both training and testing. We show that Picket consistently safeguards against corrupted data during both training and deployment of various models ranging from SVMs to neural networks, beating a diverse array of competing methods that span from data quality validation models to robust outlier-detection models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。