机器学习使能系统工程中的痛点命名
Naming the Pain in Machine Learning-Enabled Systems Engineering
AI总结:
本文通过一项覆盖25国188名从业者的国际调查,系统揭示了机器学习使能系统工程中的实践现状与各生命周期阶段的关键问题,为问题驱动的学术研究奠定基础并倡导改进软件工程实践。
摘要:
背景:机器学习(ML)使能系统正被越来越多的公司采用,旨在改进其产品和运营流程。目标:本文旨在全面概述当前工程化机器学习使能系统的现状,并为引导实践相关且问题驱动的学术研究奠定基础。方法:我们开展了一项国际调查,以收集从业者对工程化机器学习使能系统当前实践和问题的见解。我们收到了来自25个国家的188份完整回复。我们使用带置信区间的自助法(bootstrapping)对当代实践进行了定量统计分析,并使用开放式编码和轴心编码程序对所报告的问题进行了定性分析。结果:我们的调查结果强化并扩展了关于工程化机器学习使能系统的现有经验证据,提供了对典型机器学习使能系统项目背景、机器学习生命周期阶段的感知相关性和复杂性,以及与问题理解、模型部署和模型监控相关的当前实践的额外见解。此外,定性分析提供了从业者在每个机器学习生命周期阶段所面临问题的详细图谱,以及导致整体项目失败的问题。结论:这些结果有助于更好地理解实际环境中的现状和问题。我们倡导进一步调整和传播软件工程实践,以增强机器学习使能系统的工程化。
英文摘要:
Context: Machine learning (ML)-enabled systems are being increasingly adopted by companies aiming to enhance their products and operational processes. Objective: This paper aims to deliver a comprehensive overview of the current status quo of engineering ML-enabled systems and lay the foundation to steer practically relevant and problem-driven academic research. Method: We conducted an international survey to collect insights from practitioners on the current practices and problems in engineering ML-enabled systems. We received 188 complete responses from 25 countries. We conducted quantitative statistical analyses on contemporary practices using bootstrapping with confidence intervals and qualitative analyses on the reported problems using open and axial coding procedures. Results: Our survey results reinforce and extend existing empirical evidence on engineering ML-enabled systems, providing additional insights into typical ML-enabled systems project contexts, the perceived relevance and complexity of ML life cycle phases, and current practices related to problem understanding, model deployment, and model monitoring. Furthermore, the qualitative analysis provides a detailed map of the problems practitioners face within each ML life cycle phase and the problems causing overall project failure. Conclusions: The results contribute to a better understanding of the status quo and problems in practical environments. We advocate for the further adaptation and dissemination of software engineering practices to enhance the engineering of ML-enabled systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。