arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.15845stat.ME
收藏

基于Besag-Clifford方法的无归一化检验e值

Besag-Clifford e-values for unnormalized testing

Gladstone Institute of Data Science and Biotechnology(格拉德斯通数据科学与生物技术研究所);Department of Biomedical Data Science, Stanford University(斯坦福大学生物医学数据科学系);Department of Statistics and Data Science, Carnegie Mellon University(卡内基梅隆大学统计与数据科学系);Machine Learning Department, Carnegie Mellon University(卡内基梅隆大学机器学习系)

Alexander Dombowsky, Barbara E. Engelhardt, Aaditya Ramdas

AI总结:

本文提出利用Besag-Clifford方法生成可交换样本,用于生成有效e值,以解决无归一化分布下的似然比检验问题,并通过模拟和应用验证了理论。

摘要:

无归一化概率分布常用于机器学习建模复杂数据生成过程。尽管MCMC算法可近似采样,但其归一化常数的不可行性使似然比检验不可行。本文提出使用Besag和Clifford的并行方法生成与数据在原假设下可交换的样本,从而生成有效的e值。我们证明,随着样本数量增加,使用无归一化似然比构建的Besag-Clifford e值在混合时间下具有对数最优性。此外,多个链的输出平均保留有效性并提高e-power。本文将Besag-Clifford e值扩展到一般无归一化检验统计量问题,允许应用于复合假设、不确定性量化、生成模型评估和序列检验。通过模拟和星系速度建模应用,我们经验性验证了理论,探讨了自相关和混合的影响,并评估了Besag-Clifford e值的性能。

英文摘要:

Unnormalized probability distributions are frequently used in machine learning for modeling complex data generating processes. Though Markov chain Monte Carlo (MCMC) algorithms can approximately sample from unnormalized distributions, intractability of their normalizing constants renders likelihood ratio testing infeasible. We propose to use the parallel method of Besag and Clifford to generate samples that are exchangeable with the data under the null, to then generate valid e-values for any number of iterations or algorithmic steps. We show that as the number of samples grows, these Besag-Clifford e-values constructed using the unnormalized likelihood ratio are actually log-optimal up to a multiplicative term that diminishes with the mixing time of the Markov chain. Additionally, averaging over the output of multiple chains retains validity while increasing the e-power. We extend Besag-Clifford e-values to the general problem of unnormalized test statistics, which allows application to composite hypotheses, uncertainty quantification, generative model evaluation, and sequential testing. Through simulations and an application to galaxy velocity modeling, we empirically verify our theory, explore the impact of autocorrelation and mixing, and evaluate the performance of Besag-Clifford e-values.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑