arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.18591cs.SE
收藏

MLOps框架在开源项目中是如何被使用的?一项实证分析

How are MLOps Frameworks Used in Open Source Projects? An Empirical Characterization

University of Sannio(桑尼奥大学)

Fiorella Zampetti, Federico Stocchetti, Federica Razzano, Damian Andrew Tamburri, Massimiliano Di Penta

AI总结:

本文通过实证分析研究了MLOps框架在开源项目中的实际使用情况,发现开发者主要通过API实现自定义功能,而非直接使用框架。

摘要:

机器学习(ML)操作(MLOps)框架旨在支持开发者和人工智能工程师管理其ML模型的生命周期。尽管此类框架提供了广泛的功能,开发者可能只利用其中一部分功能,而遗漏了一些高度需要的功能。本文研究了八个流行的开源MLOps框架的实用使用情况和所需功能增强。具体而言,我们分析了依赖这些框架的GitHub项目如何调用框架的API和命令。然后,我们对框架的问题跟踪器中挖掘的功能请求和增强进行定性分析,将这些所需改进与之前确定的使用特征联系起来。结果表明,MLOps框架很少被直接使用,并且很少被集成到GitHub工作流中,但开发者更倾向于使用其API来在项目中实现自定义功能。使用的功能涉及核心ML阶段和整个基础设施治理,有时会利用多个具有互补功能的框架。与功能请求的映射显示,用户主要要求对框架核心功能的增强,但也要求更好的API暴露和持续集成/持续交付(CI/CD)集成。

英文摘要:

Machine Learning (ML) Operations (MLOps) frameworks have been conceived to support developers and AI engineers in managing the lifecycle of their ML models. While such frameworks provide a wide range of features, developers may leverage only a subset of them, while missing some highly desired features. This paper investigates the practical use and desired feature enhancements of eight popular open-source MLOps frameworks. Specifically, we analyze their usage by dependent projects on GitHub, examining how they invoke the frameworks' APIs and commands. Then, we qualitatively analyze feature requests and enhancements mined from the frameworks' issue trackers, relating these desired improvements to the previously identified usage features. Results indicate that MLOps frameworks are rarely used out-of-the-box and are infrequently integrated into GitHub Workflows, but rather, developers use their APIs to implement custom functionality in their projects. Used features concern core ML phases and whole infrastructure governance, sometimes leveraging multiple frameworks with complementary features. The mapping with feature requests highlights that users mainly ask for enhancements to core features of the frameworks, but also better API exposure and CI/CD integration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑