arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.01531cs.LG
收藏

MACEst:可靠可信的模型无关置信度估计

MACEst: The reliable and trustworthy Model Agnostic Confidence Estimator

Gravity Exploration Institute(引力探索研究所);Cardiff University(卡迪夫大学);Oracle AI Apps(甲骨文人工智能应用);Oracle(甲骨文公司)

Rhys Green, Matthew Rowe, Alberto Polleri

摘要:

可靠的置信度估计对于任何机器学习模型真正有用都非常重要。在本文中,我们认为任何基于标准机器学习点预测算法的置信度估计都存在根本性缺陷,并且在具有大量认知不确定性的情况下可能是不可信的。为了解决这些问题,我们提出了MACEst,一个模型不可知的信心估计,它提供了可靠和值得信赖的信心估计。该算法不同于目前的方法,通过独立地估计置信度作为一个局部量,明确占任意和认知的不确定性。此方法不同于使用全局点预测模型作为置信度估计的起点的标准校准方法。

英文摘要:

Reliable Confidence Estimates are hugely important for any machine learning model to be truly useful. In this paper, we argue that any confidence estimates based upon standard machine learning point prediction algorithms are fundamentally flawed and under situations with a large amount of epistemic uncertainty are likely to be untrustworthy. To address these issues, we present MACEst, a Model Agnostic Confidence Estimator, which provides reliable and trustworthy confidence estimates. The algorithm differs from current methods by estimating confidence independently as a local quantity which explicitly accounts for both aleatoric and epistemic uncertainty. This approach differs from standard calibration methods that use a global point prediction model as a starting point for the confidence estimate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑