In this paper, we propose a probabilistic physics-guided framework, termed Physics-guided Deep Markov Model (PgDMM). The framework targets the inference of the characteristics and latent structure of nonlinear dynamical systems from measurement data, where exact inference of latent variables is typically intractable. A recently surfaced option pertains to leveraging variational inference to perform approximate inference. In such a scheme, transition and emission functions of the system are parameterized via feed-forward neural networks (deep generative models). However, due to the generalized and highly versatile formulation of neural network functions, the learned latent space often lacks physical interpretation and structured representation. To address this, we bridge physics-based state space models with Deep Markov Models, thus delivering a hybrid modeling framework for unsupervised learning and identification of nonlinear dynamical systems. The proposed framework takes advantage of the expressive power of deep learning, while retaining the driving physics of the dynamical system by imposing physics-driven restrictions on the side of the latent space. We demonstrate the benefits of such a fusion in terms of achieving improved performance on illustrative simulation examples and experimental case studies of nonlinear systems. Our results indicate that the physics-based models involved in the employed transition and emission functions essentially enforce a more structured and physically interpretable latent space, which is essential for enhancing and generalizing the predictive capabilities of deep learning-based models.
Mastering the Minority: An Uncertainty-guided Multi-Expert Framework for Challenging-tailed Sequence Learning
Key Laboratory of Cyberspace Big Data Intelligent Security, Ministry of Education(教育部空天地大数据智能安全重点实验室);School of Artificial Intelligence, Chongqing University of Post and Telecommunications(重庆邮电大学人工智能学院);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院);Chongqing Key Laboratory of Brain-Inspired Cognitive Computing and Educational Rehabilitation for Children with Special Needs, Chongqing Normal University(重庆市脑科学与认知计算及特殊儿童教育康复重点实验室)
Efficient Uncertainty Quantification for Dynamic Subsurface Flow with Surrogate by Theory-guided Neural Network
College of Engineering, Peking University(北京大学工学院);School of Environmental Science and Engineering, Southern University of Science and Technology(南方科技大学环境科学与工程学院);Peng Cheng Laboratory(鹏城实验室)
Optimal Uncertainty-guided Neural Network Training
Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University(迪肯大学智能系统研究与创新研究所);Shiraz University of Technology(设拉子理工大学);National University of Singapore(新加坡国立大学)
Uncertainty-guided Continual Learning with Bayesian Neural Networks
UC Berkeley(加州大学伯克利分校);Facebook AI Research(脸书人工智能研究院);KAUST(阿卜杜拉国王科技大学);Stanford University(斯坦福大学)
持续学习的目的是学习新的任务而不忘记以前学过的。当无法访问先前任务的数据以及模型具有固定容量时,这尤其具有挑战性。目前基于正则化的持续学习算法需要一个外部表示和额外的计算来测量参数的\textit{importance}。相比之下,我们提出了不确定性指导的连续贝叶斯神经网络(UCB),其中学习率根据网络中权重的概率分布中定义的不确定性进行调整。不确定性是一种自然的方式来识别\textit{what to remember}和\textit{what to change},因为我们不断学习,从而减轻灾难性遗忘。我们还展示了我们模型的一个变体,它使用不确定性进行权重修剪,并通过保存每个任务的二进制掩码来修剪后保留任务性能。我们在不同的对象分类数据集上广泛评估了我们的UCB方法,这些数据集具有短序列和长序列的任务,并报告了与现有方法相比的优越或同等的性能。此外,我们表明,我们的模型并不一定需要在测试时的任务信息,即它不假定知识的任务样本属于。
Incorporating uncertainty quantification into travel mode choice modeling: a Bayesian neural network (BNN) approach and an uncertainty-guided active survey framework
EDUE: Expert Disagreement-Guided One-Pass Uncertainty Estimation for Medical Image Segmentation
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Applied Sciences Western Switzerland (HES-SO)(瑞士西部应用科学大学(HES-SO))
FedUAF: Uncertainty-Aware Fusion with Reliability-Guided Aggregation for Multimodal Federated Sentiment Analysis
Shanghai University(上海大学);North China Electric Power University(华北电力大学);Université de Technologie de Compiègne(法国图卢兹国立理工学院);Nanyang Technological University(南洋理工大学);City University of Hong Kong(香港城市大学);Macquarie University(麦考瑞大学)
Guided Uncertainty-Aware Policy Optimization: Combining Learning and Model-Based Strategies for Sample-Efficient Policy Learning
Stanford University(斯坦福大学);University of California, Berkeley(加州大学伯克利分校);Nvidia(英伟达);University of Toronto(多伦多大学);University of Sydney(悉尼大学);University of Washington(华盛顿大学)