组件不匹配是公共部门部署AI系统的关键瓶颈
Component Mismatches Are a Critical Bottleneck to Fielding AI-Enabled Systems in the Public Sector
摘要:
机器学习或人工智能(ML/AI)的使用在改善公共部门的许多功能和需求方面具有巨大的潜力。然而,在实践中,将ML/AI组件集成到公共部门应用程序中不仅受到这些组件及其算法的脆弱性的严重限制,而且还因为ML启用系统的组件之间的不匹配。例如,如果ML模型是在与操作环境中的数据不同的数据上训练的,则ML组件的现场性能将显著降低。与软件工程考虑因素分开,在系统中部署ML/AI组件所需的专业知识通常来自软件工程之外。因此,来自这些不同学科的从业者使用的假设甚至描述性语言可能会加剧将ML/AI组件集成到更大系统中的其他挑战。我们正在调查ML/AI系统集成中的不匹配类别,以确定不同领域的从业者(数据科学家,软件工程师,运营人员)所做的隐含假设,并找到明确传达适当信息的方法。我们将讨论几类不匹配,并提供每个类的示例。为了使ML/AI组件能够以有意义的方式部署,我们需要了解存在的不匹配并制定实践来减轻这些不匹配的影响。
英文摘要:
The use of machine learning or artificial intelligence (ML/AI) holds substantial potential toward improving many functions and needs of the public sector. In practice however, integrating ML/AI components into public sector applications is severely limited not only by the fragility of these components and their algorithms, but also because of mismatches between components of ML-enabled systems. For example, if an ML model is trained on data that is different from data in the operational environment, field performance of the ML component will be dramatically reduced. Separate from software engineering considerations, the expertise needed to field an ML/AI component within a system frequently comes from outside software engineering. As a result, assumptions and even descriptive language used by practitioners from these different disciplines can exacerbate other challenges to integrating ML/AI components into larger systems. We are investigating classes of mismatches in ML/AI systems integration, to identify the implicit assumptions made by practitioners in different fields (data scientists, software engineers, operations staff) and find ways to communicate the appropriate information explicitly. We will discuss a few categories of mismatch, and provide examples from each class. To enable ML/AI components to be fielded in a meaningful way, we will need to understand the mismatches that exist and develop practices to mitigate the impacts of these mismatches.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。