Video2GIF:从视频自动生成动画GIF
Video2GIF: Automatic Generation of Animated GIFs from Video
摘要:
我们介绍了新的问题,自动生成动画GIF从视频。GIF是没有声音的短循环视频,是图像和视频的完美结合,真正吸引了我们的注意力。GIF讲述一个故事,表达情感,将事件变成幽默的时刻,是新闻摄影的新浪潮。我们提出这个问题:我们能否通过利用用户生成的大量GIF内容来自动化GIF创建的完全手动和精细的过程?我们提出了一个鲁棒的深度RankNet,给定一个视频,根据它们作为GIF的适用性生成其片段的排名列表。我们训练我们的模型,通过使用超过10万个用户生成的GIF及其相应的视频源来学习GIF通常选择哪些视觉内容。我们有效地处理嘈杂的网络数据,提出了一种新的自适应Huber损失的排名公式。我们表明,我们的方法是强大的离群值,并拿起几个模式,经常出现在流行的动画GIF。在我们新的大规模基准数据集上,我们展示了我们的方法比几种最先进的方法的优势。
英文摘要:
We introduce the novel problem of automatically generating animated GIFs from video. GIFs are short looping video with no sound, and a perfect combination between image and video that really capture our attention. GIFs tell a story, express emotion, turn events into humorous moments, and are the new wave of photojournalism. We pose the question: Can we automate the entirely manual and elaborate process of GIF creation by leveraging the plethora of user generated GIF content? We propose a Robust Deep RankNet that, given a video, generates a ranked list of its segments according to their suitability as GIF. We train our model to learn what visual content is often selected for GIFs by using over 100K user generated GIFs and their corresponding video sources. We effectively deal with the noisy web data by proposing a novel adaptive Huber loss in the ranking formulation. We show that our approach is robust to outliers and picks up several patterns that are frequently present in popular animated GIFs. On our new large-scale benchmark dataset, we show the advantage of our approach over several state-of-the-art methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。