谁需要MLOps:数据科学家寻求完成什么以及MLOps如何提供帮助?
Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help?
摘要:
在持续的软件工程实践之后,人们对快速部署称为MLOps的机器学习(ML)功能的兴趣越来越大。在本文中,我们研究了MLOp在数据科学家日常活动中的重要性,基于一项调查,我们收集了来自63个不同国家的331名ML领域专业人士的回复,表明他们在过去三个月里正在从事的工作。根据结果,高达40%的受访者表示他们同时使用模型和基础设施;大部分工作围绕关系和时间序列数据;待解决的最大类别的问题是预测分析,时间序列数据和计算机视觉。最大的感知问题围绕着数据,尽管人们已经意识到了与将模型部署到生产和相关过程相关的问题。假设一下,我们认为调查中所代表的组织可以分为三类-(i)找出如何最好地使用数据;(ii)专注于构建第一个模型并将其投入生产;(iii)管理多个模型,它们的版本和训练数据集,以及重新训练和频繁部署重新训练的模型。在结果中,大多数答复者属于第(i)或第(ii)类,侧重于数据和模型;然而,只有在需要经常重新培训和重新部署时,MLOp的好处才出现在第(iii)类中。因此,当一个组织将ML作为概念验证的一步,将ML作为名义活动的一部分时,建立MLOps管道是一个自然的步骤。
英文摘要:
Following continuous software engineering practices, there has been an increasing interest in rapid deployment of machine learning (ML) features, called MLOps. In this paper, we study the importance of MLOps in the context of data scientists' daily activities, based on a survey where we collected responses from 331 professionals from 63 different countries in ML domain, indicating on what they were working on in the last three months. Based on the results, up to 40% respondents say that they work with both models and infrastructure; the majority of the work revolves around relational and time series data; and the largest categories of problems to be solved are predictive analysis, time series data, and computer vision. The biggest perceived problems revolve around data, although there is some awareness of problems related to deploying models to production and related procedures. To hypothesise, we believe that organisations represented in the survey can be divided to three categories -- (i) figuring out how to best use data; (ii) focusing on building the first models and getting them to production; and (iii) managing several models, their versions and training datasets, as well as retraining and frequent deployment of retrained models. In the results, the majority of respondents are in category (i) or (ii), focusing on data and models; however the benefits of MLOps only emerge in category (iii) when there is a need for frequent retraining and redeployment. Hence, setting up an MLOps pipeline is a natural step to take, when an organization takes the step from ML as a proof-of-concept to ML as a part of nominal activities.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。