从长篇电影视频中自动提取搞笑场景
Automatic Funny Scene Extraction from Long-form Cinematic Videos
AI总结:
本文提出了一种端到端系统,用于从长篇电影视频中自动识别和排名幽默场景,通过多模态方法提升场景定位和幽默检测精度。
摘要:
自动从电影标题中提取吸引人且高质量的幽默场景对于创建引人入胜的视频预告和可食用内容至关重要,有助于提升流媒体平台用户的参与度。长篇电影标题因其持续时间长和复杂的叙事而挑战场景定位,而幽默依赖于多种模态并具有微妙的风格,进一步增加了复杂性。本文介绍了一种端到端系统,用于自动识别和排名长篇电影标题中的幽默场景,包括镜头检测、多模态场景定位和优化于电影内容的幽默标签。关键创新包括一种结合视觉和文本线索的新场景分割方法,改进的镜头表示通过引导三元组挖掘,以及利用音频和文本的多模态幽默标签框架。我们的系统在OVSD数据集上比最先进的场景检测方法提高了18.3%的AP,并在长文本中检测幽默的F1得分为0.834。在五个电影标题上的广泛评估显示,87%的提取片段被认为是搞笑的,而98%的场景被准确定位。成功泛化到预告片,这些结果展示了该流程在增强内容创作流程、提高用户参与度和简化多样化电影媒体格式的可食用内容生成方面的潜力。
英文摘要:
Automatically extracting engaging and high-quality humorous scenes from cinematic titles is pivotal for creating captivating video previews and snackable content, boosting user engagement on streaming platforms. Long-form cinematic titles, with their extended duration and complex narratives, challenge scene localization, while humor's reliance on diverse modalities and its nuanced style add further complexity. This paper introduces an end-to-end system for automatically identifying and ranking humorous scenes from long-form cinematic titles, featuring shot detection, multimodal scene localization, and humor tagging optimized for cinematic content. Key innovations include a novel scene segmentation approach combining visual and textual cues, improved shot representations via guided triplet mining, and a multimodal humor tagging framework leveraging both audio and text. Our system achieves an 18.3% AP improvement over state-of-the-art scene detection on the OVSD dataset and an F1 score of 0.834 for detecting humor in long text. Extensive evaluations across five cinematic titles demonstrate 87% of clips extracted by our pipeline are intended to be funny, while 98% of scenes are accurately localized. With successful generalization to trailers, these results showcase the pipeline's potential to enhance content creation workflows, improve user engagement, and streamline snackable content generation for diverse cinematic media formats.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。