arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.11541cs.LG
收藏

面向数据分布偏移的多标准自动化MLOps流水线:用于云上分类器高效重训练

A Multi-Criteria Automated MLOps Pipeline for Cost-Effective Cloud-Based Classifier Retraining in Response to Data Distribution Shifts

Department of Mathematics and Computer Science, University of Kinshasa(数学与计算机科学系,刚果(金)大学)

Emmanuel K. Katalay, David O. Dimandja, Jordan F. Masakuna

AI总结:

本研究提出一种多标准自动化MLOps流水线,用于在数据分布偏移时高效重训练云上分类器,提升模型准确性和鲁棒性。

摘要:

机器学习(ML)模型的性能往往在底层数据分布变化时会下降,这种现象称为数据分布偏移。当发生这种情况时,ML模型需要重新训练和重新部署。ML运维(MLOps)通常手动进行,即人类触发模型重新训练和重新部署的过程。在本工作中,我们提出了一种自动化MLOps流水线,旨在解决神经网络分类器在显著数据分布变化时的重新训练问题。我们的MLOps流水线采用多标准统计技术来检测分布偏移,并仅在必要时触发模型更新,以确保计算效率和资源优化。我们通过在多个基准异常检测数据集上的实验展示了框架的有效性,证明了与传统重训练策略相比,模型准确性和鲁棒性有显著提升。我们的工作为在数据分布变化频繁的动态现实环境中部署更可靠和适应性强的ML系统提供了基础。

英文摘要:

The performance of machine learning (ML) models often deteriorates when the underlying data distribution changes over time, a phenomenon known as data distribution drift. When this happens, ML models need to be retrained and redeployed. ML Operations (MLOps) is often manual, i.e., humans trigger the process of model retraining and redeployment. In this work, we present an automated MLOps pipeline designed to address neural network classifier retraining in response to significant data distribution changes. Our MLOps pipeline employs multi-criteria statistical techniques to detect distribution shifts and triggers model updates only when necessary, ensuring computational efficiency and resource optimization. We demonstrate the effectiveness of our framework through experiments on several benchmark anomaly detection data sets, showing significant improvements in model accuracy and robustness compared to traditional retraining strategies. Our work provides a foundation for deploying more reliable and adaptive ML systems in dynamic real-world settings, where data distribution changes are common.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑