arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.12781cs.SEcs.LG
收藏

基于流的编程在机器学习部署环境中的实证评估

An Empirical Evaluation of Flow Based Programming in the Machine Learning Deployment Context

University of Cambridge(剑桥大学)

Andrei Paleyes, Christian Cabrera, Neil D. Lawrence

摘要:

随着数据驱动技术的普及,软件工程师经常面临使用数据驱动方法(如机器学习(ML)算法)解决业务问题的任务。在大型软件系统中部署ML带来了标准工程实践无法解决的新挑战,因此企业观察到ML部署项目失败率很高。面向数据的架构(DOA)是一种新兴的方法,可以支持数据科学家和软件开发人员应对这些挑战。然而,在实践中如何实现DOA系统缺乏明确性。本文提出了考虑流为基础的编程(FBP)作为一个范例,用于创建DOA应用程序。我们在代表典型数据科学项目的四个应用程序的ML部署背景下对FBP进行了经验评估。我们使用面向服务的体系结构(SOA)作为比较的基准。针对不同的应用程序域、ML部署阶段和代码质量指标进行评估。结果表明,FBP是一个合适的范例数据汇集和数据科学任务,并能够简化数据汇集和发现相比,SOA。我们讨论了FBP的优点,以及需要解决的差距,以增加FBP通过作为DOA的标准设计范例。

英文摘要:

As use of data driven technologies spreads, software engineers are more often faced with the task of solving a business problem using data-driven methods such as machine learning (ML) algorithms. Deployment of ML within large software systems brings new challenges that are not addressed by standard engineering practices and as a result businesses observe high rate of ML deployment project failures. Data Oriented Architecture (DOA) is an emerging approach that can support data scientists and software developers when addressing such challenges. However, there is a lack of clarity about how DOA systems should be implemented in practice. This paper proposes to consider Flow-Based Programming (FBP) as a paradigm for creating DOA applications. We empirically evaluate FBP in the context of ML deployment on four applications that represent typical data science projects. We use Service Oriented Architecture (SOA) as a baseline for comparison. Evaluation is done with respect to different application domains, ML deployment stages, and code quality metrics. Results reveal that FBP is a suitable paradigm for data collection and data science tasks, and is able to simplify data collection and discovery when compared with SOA. We discuss the advantages of FBP as well as the gaps that need to be addressed to increase FBP adoption as a standard design paradigm for DOA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑