基于高斯过程的视点感知推理
Gaussian Process Priors for View-Aware Inference
摘要:
虽然使用深度神经网络的帧无关预测已经成为许多计算机视觉任务的突出解决方案,但利用帧之间的相关性的潜在好处却很少受到关注。尽管概率机器学习提供了将相关性编码为推理的先验知识的能力,但将概率方法应用于现代视觉问题的理论和实践之间存在明显的差距。为此,我们推导出一个原则框架,将相机姿态(平移和方向)与深度模型之间的信息耦合结合起来。我们提出了一种新的视图核,推广了$\mathrm{SO}(3)$中的标准周期核。我们展示了这种软先验知识如何帮助几个姿势相关的视觉任务,如新颖的视图合成和预测生成模型的潜在空间中的任意点,指向帧间推理的一系列新应用。
英文摘要:
While frame-independent predictions with deep neural networks have become the prominent solutions to many computer vision tasks, the potential benefits of utilizing correlations between frames have received less attention. Even though probabilistic machine learning provides the ability to encode correlation as prior knowledge for inference, there is a tangible gap between the theory and practice of applying probabilistic methods to modern vision problems. For this, we derive a principled framework to combine information coupling between camera poses (translation and orientation) with deep models. We proposed a novel view kernel that generalizes the standard periodic kernel in $\mathrm{SO}(3)$. We show how this soft-prior knowledge can aid several pose-related vision tasks like novel view synthesis and predict arbitrary points in the latent space of generative models, pointing towards a range of new applications for inter-frame reasoning.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。