Recently, combinations of generative and Bayesian machine learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated distribution originating from limited training statistics. The interpretation of a distribution-wide uncertainty however remains ill-defined. We show a clear scheme for quantifying the calibration of Bayesian generative machine learning models. For a Continuous Normalizing Flow applied to a low-dimensional toy example, we evaluate the calibration of Bayesian uncertainties from either a mean-field Gaussian weight posterior, or Monte Carlo sampling network weights, to gauge their behaviour on unsteady distribution edges. Well calibrated uncertainties can then be used to roughly estimate the number of uncorrelated truth samples that are equivalent to the generated sample and clearly indicate data amplification for smooth features of the distribution.
A Bayesian Framework for Evaluating Scenario Compatibility in Generative Population Synthesis
Department of Civil and Architectural Engineering, KTH Royal Institute of Technology, Stockholm, Sweden(瑞典皇家理工学院土木与建筑工程系,瑞典斯德哥尔摩);Digital Futures, KTH Royal Institute of Technology, Stockholm, Sweden(瑞典皇家理工学院数字未来中心,瑞典斯德哥尔摩);Department of Data Science and Artificial Intelligence, Monash University, Melbourne, Australia(澳大利亚莫纳什大学数据科学与人工智能系,澳大利亚墨尔本)
A Bayesian latent Gaussian process framework for aerodynamic uncertainty quantification
Aerospace Engineering, The Pennsylvania State University, University Park, PA 16802(航空工程,宾夕法尼亚州立大学,University Park分校,PA 16802);Aerospace Engineering and the Institute of Computational and Data Science (ICDS), The Pennsylvania State University, University Park, PA 16802(航空工程和计算与数据科学研究所(ICDS),宾夕法尼亚州立大学,University Park分校,PA 16802)
A Bayesian Non-parametric Approach to Generative Models: Integrating Variational Autoencoder and Generative Adversarial Networks using Wasserstein and Maximum Mean Discrepancy
Department of Statistics and Actuarial Science University of Hong Kong(统计与精算科学系香港大学)
Bayesian Generative Adversarial Networks via Gaussian Approximation for Tabular Data Synthesis
Department of Social Statistics, The University of Manchester(社会统计系,曼彻斯特大学);Alliance Manchester Business School, The University of Manchester(曼彻斯特商业联盟学院,曼彻斯特大学)
Bayesian Cycle-Consistent Generative Adversarial Networks via Marginalizing Latent Sampling
School of Electrical Information and Communication Engineering, Huazhong University of Science & Technology(华中科技大学电子信息与通信学院);Microsoft AI & Research(微软人工智能与研究);Machine Learning Department, Carnegie Mellon University(卡内基梅隆大学机器学习系)
Unified Generative Modeling of 3D Molecules via Bayesian Flow Networks
Institute of AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Shanghai Institute of Materia Medica, Chinese Academy of Sciences(中国科学院上海药物研究所)
Fully Bayesian Autoencoders with Latent Sparse Gaussian Processes
EURECOM(欧洲通信研究院);University of California, Irvine(加州大学欧文分校)
自动编码器及其变体是表示学习和生成建模中使用最广泛的模型之一。然而,基于自动编码器的模型通常假设学习的表示是i.i.d.。并且不能捕获数据样本之间的相关性。为了解决这个问题,我们提出了一种新的稀疏高斯过程贝叶斯自动编码器(SGPAE)模型,在该模型中,我们对贝叶斯自动编码器的潜在空间施加完全贝叶斯稀疏高斯过程先验。我们通过随机梯度Hamilton Monte Carlo对该模型进行后验估计。我们在广泛的表示学习和生成建模任务上定性和定量地评估了我们的方法,并表明我们的方法始终优于依赖于变分自编码器的多个替代方案。
A Semi-Bayesian Nonparametric Estimator of the Maximum Mean Discrepancy Measure: Applications in Goodness-of-Fit Testing and Generative Adversarial Networks
University of Hong Kong(香港大学);University of Maryland(马里兰大学)
PriorCVAE: scalable MCMC parameter inference with Bayesian deep generative modelling
University of Oxford(牛津大学);Aalto University(阿尔托大学);Institute of Science and Technology Austria(奥地利科学技术研究所);University of Copenhagen(哥本哈根大学);Imperial College London(伦敦帝国学院)
Proximal-Based Generative Modeling for Bayesian Inverse Problems
School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences(中国科学院大学先进交叉科学学院);School of Mathematics, Sichuan University(四川大学数学学院);School of Mathematical Sciences, Beijing University of Posts and Telecommunications(北京邮电大学数学科学学院);Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);Ministry of Education Key Laboratory of Mathematics and Information Networks(教育部数学与信息网络重点实验室)
Bayesian computation with generative diffusion models by Multilevel Monte Carlo
School of Mathematical and Computer Sciences, Heriot-Watt University(赫瑞斯泰学院数学与计算机科学系);Departament de Matemàtiques and IMAC, Universitat Jaume I(数学系和IMAC, Jaime I大学);School of Mathematics, University of Edinburgh(爱丁堡大学数学系);Maxwell Institute for Mathematical Sciences, Edinburgh(爱丁堡数学科学研究所)
针对扩散模型用于贝叶斯逆问题 Monte Carlo 计算时神经评估成本高的问题,提出 Multilevel Monte Carlo 多层耦合策略,在不损失精度的情况下于三个成像基准上降低 4 至 8 倍成本。
Generative Bayesian Computation as a Scalable Alternative to Gaussian Process Surrogates
Booth School of Business, University of Chicago(芝加哥大学商学院);Department of Systems Engineering and Operations Research, George Mason University(乔治·马歇尔大学系统工程与运营管理系)
Calibrating Bayesian Learning via Regularization, Confidence Minimization, and Selective Inference
King’s Communications, Learning & Information Processing (KCLIP) lab(国王通讯、学习与信息处理(KCLIP)实验室);Centre for Intelligent Information Processing Systems (CIIPS)(智能信息处理系统中心);Department of Engineering, King’s College London(伦敦国王学院工程系)
Department of Computer Science, Tsinghua University(清华大学计算机科学与技术系);Sea AI Lab, Singapore(Sea AI实验室,新加坡);Qing Yuan Research Institute, Shanghai Jiao Tong University(上海交通大学清源研究院)
The Bayesian Case Model: A Generative Approach for Case-Based Reasoning and Prototype Classification
Massachusetts Institute of Technology(麻省理工学院)
我们提出了贝叶斯案例模型(Bayesian Case Model,简称CBR),它是贝叶斯案例推理(Bayesian Case-Based Reasoning,简称CBR)和原型分类与聚类的一个通用框架。它将CBR的直观力量引入贝叶斯生成框架。通过对聚类标签、原型和重要特征进行联合推理,该算法学习原型,即最能代表数据集中聚类的“精华”观察。与此同时,ESTA通过学习子空间来追求稀疏性,子空间是在原型表征中起重要作用的特征集。原型和子空间表示在保持分类准确性的同时在可解释性方面提供了定量优势。人类受试者实验证实,与现有技术给出的解释相比,当使用由ESTA产生的解释时,参与者的理解在统计学上显著改善。