arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.09489cs.AI
收藏

利用表格基础模型计算条件Shapley值

Computing Conditional Shapley Values Using Tabular Foundation Models

Norwegian Computing Center(挪威计算中心);Norwegian Defence Research Establishment (FFI)(挪威国防研究机构(FFI))

Lars Henry Berge Olsen, Dennis Christensen

AI总结:

本文利用TabPFN模型高效计算条件Shapley值,在模拟和真实数据上表现优异,运行效率高。

摘要:

Shapley值已成为可解释AI的基石,但其计算成本很高,尤其是在特征相互依赖的情况下。评估它们需要近似大量的条件期望,可以通过蒙特卡洛积分或回归来实现。直到最近,人们才无法充分利用深度学习进行回归方法,因为为每个条件期望重新训练太耗时。表格基础模型如TabPFN通过利用上下文学习克服了这一计算障碍,因此每个条件期望可以无需重新训练即可近似。在本文中,我们使用多种TabPFN变体计算Shapley值,并在模拟和真实数据集上将其性能与最先进的方法进行比较。在大多数情况下,TabPFN表现最佳;在它不好的情况下,也仅略逊于最佳方法,但运行时间仅为后者的一小部分。我们还讨论了进一步的改进以及如何更有效地将表格基础模型适应于条件Shapley值估计。

英文摘要:

Shapley values have become a cornerstone of explainable AI, but they are computationally expensive to use, especially when features are dependent. Evaluating them requires approximating a large number of conditional expectations, either via Monte Carlo integration or regression. Until recently it has not been possible to fully exploit deep learning for the regression approach, because retraining for each conditional expectation takes too long. Tabular foundation models such as TabPFN overcome this computational hurdle by leveraging in-context learning, so each conditional expectation can be approximated without any re-training. In this paper, we compute Shapley values with multiple variants of TabPFN and compare their performance with state-of-the-art methods on both simulated and real datasets. In most cases, TabPFN yields the best performance; where it does not, it is only marginally worse than the best method, at a fraction of the runtime. We discuss further improvements and how tabular foundation models can be better adapted specifically for conditional Shapley value estimation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑