arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2112.07263cs.LGcs.AI
收藏

量化世界模型中的多模态

Quantifying Multimodality in World Models

LMU Munich(慕尼黑大学)

Andreas Sedlmeier, Michael Kölle, Robert Müller, Leo Baudrexel, Claudia Linnhoff-Popien

摘要:

基于模型的深度强化学习(RL)假设环境的底层过渡动态模型的可用性。该模型可用于预测代理可能的行为的未来影响。当没有这样的模型可用时,可以例如通过使用生成神经网络(有时也称为世界模型)来学习真实环境的近似。由于大多数现实世界的环境是随机的性质和过渡动力学往往是多模态的,它是重要的是使用一种建模技术,能够反映这种多模态的不确定性。为了在现实世界中安全地部署这种学习系统,特别是在工业环境中,考虑这些不确定性至关重要。在这项工作中,我们分析了现有的,并提出了新的指标的检测和量化的多模态不确定性RL为基础的世界模型。对不确定未来状态的正确建模和检测为以安全的方式处理关键情况奠定了基础,这是在现实世界中部署RL系统的先决条件。

英文摘要:

Model-based Deep Reinforcement Learning (RL) assumes the availability of a model of an environment's underlying transition dynamics. This model can be used to predict future effects of an agent's possible actions. When no such model is available, it is possible to learn an approximation of the real environment, e.g. by using generative neural networks, sometimes also called World Models. As most real-world environments are stochastic in nature and the transition dynamics are oftentimes multimodal, it is important to use a modelling technique that is able to reflect this multimodal uncertainty. In order to safely deploy such learning systems in the real world, especially in an industrial context, it is paramount to consider these uncertainties. In this work, we analyze existing and propose new metrics for the detection and quantification of multimodal uncertainty in RL based World Models. The correct modelling & detection of uncertain future states lays the foundation for handling critical situations in a safe way, which is a prerequisite for deploying RL systems in real-world settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑