arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1708.06509cs.CV
收藏

ProbFlow:联合光流和不确定性估计

ProbFlow: Joint Optical Flow and Uncertainty Estimation

TU Darmstadt(达姆施塔特工业大学);University of Mannheim(曼海姆大学)

Anne S. Wannenwetsch, Margret Keuper, Stefan Roth

摘要:

光流估计由于无纹理区域、运动边界、遮挡等而仍然具有挑战性。因此,所估计的流量在整个图像上不是同样可靠的。为此,事后的信心措施已被引入,以评估每像素的流的可靠性。我们克服了人工分离的光流和置信度估计,通过引入一种方法,联合预测光流和其潜在的不确定性。从常见的基于能量的公式开始,我们依赖于给定图像的流的相应后验分布。我们推导出一个变分推理方案的平均场的基础上,它结合了能量最小化的最佳实践。沿着流在每个像素处获得作为变分分布的(边缘)熵的不确定性度量。我们证明了我们的概率方法的灵活性,将其应用到两个不同的能源和两个基准。我们不仅获得流的结果,是具有竞争力的基本能量最小化方法,但也是一个可靠的不确定性措施,显着优于现有的事后方法。

英文摘要:

Optical flow estimation remains challenging due to untextured areas, motion boundaries, occlusions, and more. Thus, the estimated flow is not equally reliable across the image. To that end, post-hoc confidence measures have been introduced to assess the per-pixel reliability of the flow. We overcome the artificial separation of optical flow and confidence estimation by introducing a method that jointly predicts optical flow and its underlying uncertainty. Starting from common energy-based formulations, we rely on the corresponding posterior distribution of the flow given the images. We derive a variational inference scheme based on mean field, which incorporates best practices from energy minimization. An uncertainty measure is obtained along the flow at every pixel as the (marginal) entropy of the variational distribution. We demonstrate the flexibility of our probabilistic approach by applying it to two different energies and on two benchmarks. We not only obtain flow results that are competitive with the underlying energy minimization approach, but also a reliable uncertainty measure that significantly outperforms existing post-hoc approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑