arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2212.00219stat.MLcs.LGstat.OT
收藏

你是否正确使用了测试对数似然?

Are you using test log-likelihood correctly?

University of Wisconsin–Madison(威斯康星大学麦迪逊分校);MIT-IBM Watson AI Lab(MIT-IBM沃森人工智能实验室);IBM Research(IBM研究院);Massachusetts Institute of Technology(麻省理工学院)

Sameer K. Deshpande, Soumya Ghosh, Tin D. Nguyen, Tamara Broderick

AI总结:

本文通过简单示例揭示测试对数似然作为模型与近似推理算法评价指标的局限,指出其可能与后验近似质量及均方根误差所反映的预测性能相矛盾。

摘要:

测试对数似然通常用于比较同一数据的不同模型,或比较拟合同一概率模型的不同近似推理算法。我们给出简单示例,说明基于测试对数似然的比较如何可能与依据其他目标的比较相矛盾。具体而言,我们的示例表明:(i)获得更高测试对数似然的近似 Bayesian 推理算法,并不一定也能产生更准确的后验近似;(ii)基于测试对数似然比较得出的预测准确性结论,可能与基于均方根误差得出的结论不一致。

英文摘要:

Test log-likelihood is commonly used to compare different models of the same data or different approximate inference algorithms for fitting the same probabilistic model. We present simple examples demonstrating how comparisons based on test log-likelihood can contradict comparisons according to other objectives. Specifically, our examples show that (i) approximate Bayesian inference algorithms that attain higher test log-likelihoods need not also yield more accurate posterior approximations and (ii) conclusions about forecast accuracy based on test log-likelihood comparisons may not agree with conclusions based on root mean squared error.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑