通过Legendre变换进行测度变换
Change of measure through the Legendre transform
AI总结:
本文研究基于f-分歧度的测度变换不等式,结合Legendre变换与Fenchel-Young不等式,推导出PAC-Bayes界限,扩展了PAC-Bayesian保证的应用条件。
摘要:
PAC-Bayes泛化界限是通过测度变换不等式推导出来的,该不等式将参考测度的集中性质转移到所有后验测度。特定的测度变换选择决定了对经验风险的假设要求;特别是经典的Donsker-Varadhan定理导致依赖于有界指数矩的界限。我们研究基于f-分歧度的测度变换不等式,通过将f的Legendre变换与Fenchel-Young不等式结合获得。除了在概率论中的内在兴趣外,我们还展示这些不等式在学习理论中的帮助,并在针对经验风险的定制假设下推导出PAC-Bayes界限,从而扩展了PAC-Bayesian保证可建立的条件范围。
英文摘要:
PAC-Bayes generalisation bounds are derived via change-of-measure inequalities that transfer concentration properties from a reference measure to all posterior measures. The specific choice of change of measure determines the assumptions required on the empirical risk; in particular, the classical Donsker--Varadhan theorem leads to bounds relying on bounded exponential moments. We study change-of-measure inequalities based on \(f\)-divergences, obtained by combining the Legendre transform of \(f\) with the Fenchel--Young inequality. Beyond their intrinsic interest in probability theory, we show how these inequalities are helpful in learning theory and yield PAC-Bayes bounds under tailored assumptions on the empirical risk, thereby extending the range of conditions under which PAC-Bayesian guarantees can be established.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。