arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1805.12243cs.CVcs.LGstat.ML
收藏

基于光流的大规模场景视频预测

Novel Video Prediction for Large-scale Scene using Optical Flow

University of Victoria(维多利亚大学);Tongji University(同济大学);Horizon Robotics Inc.(地平线机器人有限公司)

Henglai Wei, Xiaochuan Yin, Penghong Lin

摘要:

预测未来帧是自动驾驶研究中的一个关键挑战。大多数现有的视频预测方法试图在简单和固定的场景中生成未来帧。在本文中,我们提出了一种新的和有效的光流条件的视频预测任务的方法,应用到复杂的城市场景。与以前的工作相比,预测模型只需要视频序列和光流序列进行训练和测试。我们的方法使用丰富的时空特征的视频序列。该方法充分利用了从相邻图像和前一图像之间的光流图中提取的运动信息。在KITTI数据集和Cityscapes数据集上的实验验证了该方法的有效性。

英文摘要:

Making predictions of future frames is a critical challenge in autonomous driving research. Most of the existing methods for video prediction attempt to generate future frames in simple and fixed scenes. In this paper, we propose a novel and effective optical flow conditioned method for the task of video prediction with an application to complex urban scenes. In contrast with previous work, the prediction model only requires video sequences and optical flow sequences for training and testing. Our method uses the rich spatial-temporal features in video sequences. The method takes advantage of the motion information extracting from optical flow maps between neighbor images as well as previous images. Empirical evaluations on the KITTI dataset and the Cityscapes dataset demonstrate the effectiveness of our method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑