arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.00539cs.LGstat.ML
收藏

CONFINE:面向可解释神经网络的共形预测

CONFINE: Conformal Prediction for Interpretable Neural Networks

Princeton University(普林斯顿大学)

Linhui Huang, Sayeri Lala, Niraj K. Jha

AI总结:

CONFINE 提出一种通用共形预测框架,为任意预训练分类器生成带统计不确定性保证的预测集,在提升可解释性与置信度估计的同时将准确率提高最多 3.6%,并引入正确效率指标验证其有效性。

摘要:

深度神经网络表现出卓越的性能,但其黑箱特性限制了它们在医疗等可解释性至关重要的领域中的应用。现有的可解释性方法往往牺牲准确性,并且缺乏对预测不确定性的可量化度量。在本研究中,我们提出了面向可解释神经网络的共形预测(CONFINE),这是一个通用框架,它生成具有统计稳健不确定性估计的预测集,而不是点预测,以增强模型的透明度和可靠性。CONFINE 不仅为单个预测提供基于示例的解释和置信度估计,还将准确率提高了多达 3.6%。我们定义了一个新的指标——正确效率(correct efficiency),用于评估恰好包含正确标签的预测集所占的比例,并表明 CONFINE 实现的正确效率比原始准确率高出多达 3.3%,达到或超过了先前的方法。CONFINE 的边际覆盖率和类别条件覆盖率证明了其在从医学图像分类到语言理解等任务中的有效性。由于能够适配任何预训练分类器,CONFINE 标志着在关键领域中迈向透明且可信的深度学习应用的重要进展。

英文摘要:

Deep neural networks exhibit remarkable performance, yet their black-box nature limits their utility in fields like healthcare where interpretability is crucial. Existing explainability approaches often sacrifice accuracy and lack quantifiable measures of prediction uncertainty. In this study, we introduce Conformal Prediction for Interpretable Neural Networks (CONFINE), a versatile framework that generates prediction sets with statistically robust uncertainty estimates instead of point predictions to enhance model transparency and reliability. CONFINE not only provides example-based explanations and confidence estimates for individual predictions but also boosts accuracy by up to 3.6%. We define a new metric, correct efficiency, to evaluate the fraction of prediction sets that contain precisely the correct label and show that CONFINE achieves correct efficiency of up to 3.3% higher than the original accuracy, matching or exceeding prior methods. CONFINE's marginal and class-conditional coverages attest to its validity across tasks spanning medical image classification to language understanding. Being adaptable to any pre-trained classifier, CONFINE marks a significant advance towards transparent and trustworthy deep learning applications in critical domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑