arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.01301stat.MLcs.AIcs.LG
收藏

一种面向不确定性感知AI自评估的决策驱动设计方法

A Decision-driven Methodology for Designing Uncertainty-aware AI Self-Assessment

The Johns Hopkins University Applied Physics Laboratory(约翰霍普金斯大学应用物理实验室);Software Engineering Institute(软件工程研究所);Carnegie Mellon University(卡内基梅隆大学)

Gregory Canal, Vladimir Leung, Philip Sage, Eric Heim, I-Jeng Wang

AI总结:

本文提出一种决策驱动的AI自评估设计方法,通过分类不确定性估计技术并考虑其对下游决策成本与收益的影响,为从业者提供选择合适自评估工具的实用指导。

摘要:

人工智能(AI)已经彻底改变了整个社会中的决策过程和系统,尤其是在事关国家利益的高影响场景中,AI已成为一项重要技术。然而,尽管AI在受控环境中展现出令人印象深刻的预测能力,它仍然面临一系列实际障碍,阻碍了其在各种关键场景中的广泛使用。特别是,下游应用中的决策者通常并不清楚某个给定AI系统的预测是否值得信赖。为了满足对更透明、更稳健、更可信的AI系统的需求,已经开发出一套工具来量化AI预测的不确定性,并且更广泛地使AI能够对其预测的可靠性进行“自评估”。在本文中,我们沿若干关键维度对AI自评估方法进行分类,并为从业者选择和设计适合其需求的方法提供指导。我们特别关注不确定性估计技术,这些技术考虑了自评估对下游决策者所做选择的影响,以及由此产生的决策结果的成本和收益。为了展示我们的自评估设计方法的实用性,我们以两个现实的国家利益场景为例说明其应用。本文是面向机器学习工程师和AI系统用户的实用指南,旨在帮助他们为每个问题选择理想的自评估技术。

英文摘要:

Artificial intelligence (AI) has revolutionized decision-making processes and systems throughout society and, in particular, has emerged as a significant technology in high-impact scenarios of national interest. Yet, despite AI's impressive predictive capabilities in controlled settings, it still suffers from a range of practical setbacks preventing its widespread use in various critical scenarios. In particular, it is generally unclear if a given AI system's predictions can be trusted by decision-makers in downstream applications. To address the need for more transparent, robust, and trustworthy AI systems, a suite of tools has been developed to quantify the uncertainty of AI predictions and, more generally, enable AI to "self-assess" the reliability of its predictions. In this manuscript, we categorize methods for AI self-assessment along several key dimensions and provide guidelines for selecting and designing the appropriate method for a practitioner's needs. In particular, we focus on uncertainty estimation techniques that consider the impact of self-assessment on the choices made by downstream decision-makers and on the resulting costs and benefits of decision outcomes. To demonstrate the utility of our methodology for self-assessment design, we illustrate its use for two realistic national-interest scenarios. This manuscript is a practical guide for machine learning engineers and AI system users to select the ideal self-assessment techniques for each problem.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑