视频-语言理解:从模型架构、模型训练和数据视角的综述
Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectives
AI总结:
本文综述了视频-语言理解系统的关键任务与挑战,从模型架构、训练和数据角度总结方法,并比较性能,探讨未来研究方向。
摘要:
人类利用多种感官来理解环境。视觉和语言是最重要的感官之一,因为它们使我们能够轻松地表达思想并感知周围的世界。由于视频-语言对可以模拟人类的感官和动态时间环境,因此创建具有人类感官的视频-语言理解系统引起了大量兴趣。在本次综述中,我们回顾了这些系统的关键任务,并突显了相关的挑战。基于这些挑战,我们从模型架构、模型训练和数据视角总结了它们的方法。我们还比较了这些方法的性能,并讨论了未来研究的有前途的方向。
英文摘要:
Humans use multiple senses to comprehend the environment. Vision and language are two of the most vital senses since they allow us to easily communicate our thoughts and perceive the world around us. There has been a lot of interest in creating video-language understanding systems with human-like senses since a video-language pair can mimic both our linguistic medium and visual environment with temporal dynamics. In this survey, we review the key tasks of these systems and highlight the associated challenges. Based on the challenges, we summarize their methods from model architecture, model training, and data perspectives. We also conduct performance comparison among the methods, and discuss promising directions for future research.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。