arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2208.08982cs.SEcs.LG
收藏

机器学习软件系统中的质量问题

Quality issues in Machine Learning Software Systems

Polytechnique Montréal(蒙特利尔理工学院)

Pierre-Olivier Côté, Amin Nikanjam, Rached Bouchoucha, Foutse Khomh

摘要:

背景:在各个领域中观察到越来越多的需求,以采用机器学习(ML)来解决复杂问题。ML模型被实现为软件组件并部署在机器学习软件系统(MLSS)中。问题:迫切需要确保MLSS的服务质量。这些系统的错误或错误决策可能导致其他系统故障,重大财务损失,甚至威胁到人类生命。MLSS的质量保证被认为是一项具有挑战性的任务,目前是一个热门的研究课题。此外,还必须涵盖最低生活保障系统质量的各个方面。目的:从从业人员的角度探讨医疗器械质量保障体系中实际质量问题的特征。这项实证研究的目的是确定一个目录的不良做法有关的质量差的MLSS。方法:我们计划与从业者/专家进行一系列访谈,相信访谈是在处理质量问题时检索他们的经验和做法的最佳方法。我们希望在这一步开发的问题目录也将帮助我们以后确定MLSS质量问题的严重性,根本原因和可能的补救措施,使我们能够为ML模型和MLSS开发有效的质量保证工具。

英文摘要:

Context: An increasing demand is observed in various domains to employ Machine Learning (ML) for solving complex problems. ML models are implemented as software components and deployed in Machine Learning Software Systems (MLSSs). Problem: There is a strong need for ensuring the serving quality of MLSSs. False or poor decisions of such systems can lead to malfunction of other systems, significant financial losses, or even threat to human life. The quality assurance of MLSSs is considered as a challenging task and currently is a hot research topic. Moreover, it is important to cover all various aspects of the quality in MLSSs. Objective: This paper aims to investigate the characteristics of real quality issues in MLSSs from the viewpoint of practitioners. This empirical study aims to identify a catalog of bad-practices related to poor quality in MLSSs. Method: We plan to conduct a set of interviews with practitioners/experts, believing that interviews are the best method to retrieve their experience and practices when dealing with quality issues. We expect that the catalog of issues developed at this step will also help us later to identify the severity, root causes, and possible remedy for quality issues of MLSSs, allowing us to develop efficient quality assurance tools for ML models and MLSSs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑