arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.11690cs.HCcs.LG
收藏

使用众包故障报告发现和验证AI错误

Discovering and Validating AI Errors With Crowdsourced Failure Reports

Carnegie Mellon University(卡内基梅隆大学)

Ángel Alexander Cabrera, Abraham J. Druck, Jason I. Hong, Adam Perer

摘要:

人工智能系统可能无法学习重要的行为,导致安全问题和偏见等现实问题。发现这些系统性故障通常需要开发人员的大量关注,从假设潜在的边缘情况到收集证据和验证模式。为了扩展和简化这一过程,我们引入了众包失败报告,最终用户对模型如何或为什么失败的描述,并展示了开发人员如何使用它们来检测AI错误。我们还设计和实现了Deblinder,这是一个可视化分析系统,用于合成故障报告,开发人员可以使用该系统来发现和验证系统故障。在半结构化访谈和有声思维研究中,我们与10名人工智能从业者一起探索了Deblinder系统的启示以及失败报告在现实世界中的适用性。最后,我们展示了如何从开发人员确定的组中收集额外的数据可以提高模型性能。

英文摘要:

AI systems can fail to learn important behaviors, leading to real-world issues like safety concerns and biases. Discovering these systematic failures often requires significant developer attention, from hypothesizing potential edge cases to collecting evidence and validating patterns. To scale and streamline this process, we introduce crowdsourced failure reports, end-user descriptions of how or why a model failed, and show how developers can use them to detect AI errors. We also design and implement Deblinder, a visual analytics system for synthesizing failure reports that developers can use to discover and validate systematic failures. In semi-structured interviews and think-aloud studies with 10 AI practitioners, we explore the affordances of the Deblinder system and the applicability of failure reports in real-world settings. Lastly, we show how collecting additional data from the groups identified by developers can improve model performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑