arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2011.08299cs.LGstat.APstat.MEstat.ML
收藏

从合成数据进行贝叶斯学习的基础

Foundations of Bayesian Learning from Synthetic Data

Department of Statistics(统计系);Barcelona GSE(巴塞罗那经济学院);University of Warwick(华威大学);Universitat Pompeu Fabra(庞培法布拉大学);Mathematics Institute(数学研究所);University of Oxford(牛津大学);The Alan Turing Institute(阿兰·图灵研究所)

Harrison Wilde, Jack Jewson, Sebastian Vollmer, Chris Holmes

摘要:

在真实数据的发布由于隐私或可用性约束而受到限制的环境中,使用合成数据作为机器学习的使能者存在显著增长和兴趣。尽管有大量的合成数据生成的方法,有相对较少的结果对合成数据上学习的模型的统计特性,更少的情况下,研究人员希望增加真实数据与另一方的合成数据。我们使用贝叶斯范式来验证在这些设置中学习时模型参数的更新,表明在应用常规学习算法而不适当考虑合成数据生成过程和学习任务时应谨慎。最近的结果一般贝叶斯更新支持一种新的和强大的方法贝叶斯综合学习决策理论的基础上,优于标准的方法在重复实验的监督学习和推理问题。

英文摘要:

There is significant growth and interest in the use of synthetic data as an enabler for machine learning in environments where the release of real data is restricted due to privacy or availability constraints. Despite a large number of methods for synthetic data generation, there are comparatively few results on the statistical properties of models learnt on synthetic data, and fewer still for situations where a researcher wishes to augment real data with another party's synthesised data. We use a Bayesian paradigm to characterise the updating of model parameters when learning in these settings, demonstrating that caution should be taken when applying conventional learning algorithms without appropriate consideration of the synthetic data generating process and learning task. Recent results from general Bayesian updating support a novel and robust approach to Bayesian synthetic-learning founded on decision theory that outperforms standard approaches across repeated experiments on supervised learning and inference problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑