arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.17102cs.LG
收藏

基于无服务器架构的机器学习操作化:一种工业级的机器学习操作化:一种用于协调系统代码预测的工业实现

Operationalization of Machine Learning with Serverless Architecture: An Industrial Operationalization of Machine Learning with Serverless Architecture: An Industrial Implementation for Harmonized System Code Prediction

Sai Vineeth Kandappareddigari, Santhoshkumar Jagadish, Gauri Verma, Ilhuicamina Contreras, Christopher Dignam, Anmol Srivastava, Benjamin Demers

AI总结:

本文提出了一种基于无服务器架构的工业级机器学习操作化方案,用于协调系统代码预测,通过自动化流程提升准确性和成本效益。

摘要:

本文提出了一种无服务器MLOps框架,该框架协调了从数据摄入、训练、部署、监控和重新训练到使用事件驱动管道和托管服务的完整机器学习生命周期。该架构是模型无关的,通过标准化接口支持多样的推理模式,使快速适应成为可能,而无需基础设施开销。我们通过一种工业实现来展示其实际应用,该实现用于协调系统(HS)代码预测,这是一个关键合规任务,其中简短、无结构的产品描述被映射到海关当局在国际贸易中使用的标准化代码。频繁的更新和模糊的描述使分类变得困难,错误会导致运输延误和经济损失。我们的解决方案使用了定制的文本嵌入编码器和多种深度学习架构,Text-CNN在真实数据上实现了98%的准确率。除了准确性之外,该管道通过自动扩展确保了可重复性、可追溯性和在负载变化下的SLA合规性。一个关键特性是自动化A/B测试,使动态模型选择和在生产环境中的安全推广成为可能。成本效益驱动模型选择;虽然Transformer可能实现相似的准确性,但其长期运营成本显著更高。确定性的分类、可预测的延迟和可解释性被优先考虑,尽管该架构仍可扩展到Transformer变体和基于LLM的推理。本文首先介绍了深度学习架构,通过模拟和模型比较进行了介绍,然后讨论了通过无服务器架构实现工业化,展示了自动重新训练、预测和验证HS代码的过程。这项工作提供了一种可复制的蓝图,用于使用无服务器架构操作化机器学习,使企业能够在扩展的同时优化性能和经济性。

英文摘要:

This paper presents a serverless MLOps framework orchestrating the complete ML lifecycle from data ingestion, training, deployment, monitoring, and retraining to using event-driven pipelines and managed services. The architecture is model-agnostic, supporting diverse inference patterns through standardized interfaces, enabling rapid adaptation without infrastructure overhead. We demonstrate practical applicability through an industrial implementation for Harmonized System (HS) code prediction, a compliance-critical task where short, unstructured product descriptions are mapped to standardized codes used by customs authorities in global trade. Frequent updates and ambiguous descriptions make classification challenging, with errors causing shipment delays and financial losses. Our solution uses a custom text embedding encoder and multiple deep learning architectures, with Text-CNN achieving 98 percent accuracy on ground truth data. Beyond accuracy, the pipeline ensures reproducibility, auditability, and SLA adherence under variable loads via auto-scaling. A key feature is automated A/B testing, enabling dynamic model selection and safe promotion in production. Cost-efficiency drives model choice; while transformers may achieve similar accuracy, their long-term operational costs are significantly higher. Deterministic classification with predictable latency and explainability is prioritized, though the architecture remains extensible to transformer variants and LLM-based inference. The paper first introduces the deep learning architectures with simulations and model comparisons, then discusses industrialization through serverless architecture, demonstrating automated retraining, prediction, and validation of HS codes. This work provides a replicable blueprint for operationalizing ML using serverless architecture, enabling enterprises to scale while optimizing performance and economics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑