arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.19231stat.MEcs.AIstat.ML
收藏

AI驱动的贝叶斯推断

AI-Powered Bayesian Inference

Department of Statistics of the University of Chicago(芝加哥大学统计系);Booth School of Business at the University of Chicago(芝加哥大学商学院)

Sean O'Hagan, Veronika Ročková

AI总结:

本研究提出将GAI的生成随机性转化为Dirichlet过程先验构建AI驱动的非参数贝叶斯框架,通过增广数据优化实现后验采样,可结合AI预测完成概率推断与不确定性量化。

摘要:

生成式人工智能(GAI)的出现标志着一个转折点,改变了社会对知识获取的认知方式。尽管GAI在决策中不能被完全信任,但它仍可提供能整合到决策流程中的有价值信息。我们并未将GAI的不确定性和固有随机性视为问题,反而将其视作机遇。实际上,针对给定提示生成的多样化回答可被用来构建反映AI预测置信度的先验分布。该先验分布可与定制化数据集结合,用于开展以AI驱动先验为基础的完整贝叶斯分析。本文在非参数贝叶斯框架下探索了这种可能性。其核心思想是为数据生成分布分配一个以AI生成模型为基线的Dirichlet过程先验分布。该先验的超参数可通过样本外数据进行调优,以评估AI先验的信息含量。后验模拟通过在增广数据上计算适当的随机化泛函实现,增广数据由观测(已标注)数据以及使用AI填补标签的伪数据组成。该策略可并行化,并且无需从条件分布采样,而是通过优化快速生成后验分布的独立同分布(iid)样本。我们的方法能够以连贯的概率方式利用AI预测实现(预测性)推断和不确定性量化。

英文摘要:

The advent of Generative Artificial Intelligence (GAI) has heralded an inflection point that changed how society thinks about knowledge acquisition. While GAI cannot be fully trusted for decision-making, it may still provide valuable information that can be integrated into a decision pipeline. Rather than seeing the lack of certitude and inherent randomness of GAI as a problem, we view it as an opportunity. Indeed, variable answers to given prompts can be leveraged to construct a prior distribution which reflects assuredness of AI predictions. This prior distribution may be combined with tailored datasets for a fully Bayesian analysis with an AI-driven prior. In this paper, we explore such a possibility within a non-parametric Bayesian framework. The basic idea consists of assigning a Dirichlet process prior distribution on the data-generating distribution with AI generative model as its baseline. Hyper-parameters of the prior can be tuned out-of-sample to assess the informativeness of the AI prior. Posterior simulation is achieved by computing a suitably randomized functional on an augmented data that consists of observed (labeled) data as well as fake data whose labels have been imputed using AI. This strategy can be parallelized and rapidly produces iid samples from the posterior by optimization as opposed to sampling from conditionals. Our method enables (predictive) inference and uncertainty quantification leveraging AI predictions in a coherent probabilistic manner.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑