基于专家竞争的因果生成场景模型
Towards causal generative scene models via competition of experts
摘要:
学习如何以模块化的方式使用可重组组件对复杂场景进行建模是在物理世界中进行高阶推理和行动的先决条件。然而,目前的生成模型缺乏捕捉视觉场景的固有组成和分层性质的能力。虽然最近的工作在基于对象的场景表示的无监督学习方面取得了进展,但大多数模型仍然保持全局表示空间(即,对象没有被明确地分离),并且不能生成具有新颖的对象排列和深度排序的场景。在这里,我们提出了一种替代方法,它使用一种归纳偏见,通过训练生成模型(专家)的集合来鼓励模块化。在训练过程中,专家们竞相解释场景的各个部分,从而专注于不同的对象类别,对象被识别为在多个场景中重复出现的部分。我们的模型允许可控采样的个别对象和重组的专家在物理上合理的方式。与其他方法相比,深度分层和遮挡处理正确,移动这种方法更接近因果生成场景模型。简单的玩具数据上的实验定性地证明了所提出的方法的概念上的优势。
英文摘要:
Learning how to model complex scenes in a modular way with recombinable components is a pre-requisite for higher-order reasoning and acting in the physical world. However, current generative models lack the ability to capture the inherently compositional and layered nature of visual scenes. While recent work has made progress towards unsupervised learning of object-based scene representations, most models still maintain a global representation space (i.e., objects are not explicitly separated), and cannot generate scenes with novel object arrangement and depth ordering. Here, we present an alternative approach which uses an inductive bias encouraging modularity by training an ensemble of generative models (experts). During training, experts compete for explaining parts of a scene, and thus specialise on different object classes, with objects being identified as parts that re-occur across multiple scenes. Our model allows for controllable sampling of individual objects and recombination of experts in physically plausible ways. In contrast to other methods, depth layering and occlusion are handled correctly, moving this approach closer to a causal generative scene model. Experiments on simple toy data qualitatively demonstrate the conceptual advantages of the proposed approach.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。