arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1907.05092cs.CVcs.CLcs.LG

Activitynet 2019 Task 3: Exploring Contexts for Dense Captioning Events in Videos

Renmin University of China(中国人民大学);Microsoft Research Asia(微软亚洲研究院);Carnegie Mellon University(卡内基梅隆大学)

Shizhe Chen, Yuqing Song, Yida Zhao, Qin Jin, Zhaoyang Zeng, Bei Liu, Jianlong Fu, Alexander Hauptmann

英文摘要:

Contextual reasoning is essential to understand events in long untrimmed videos. In this work, we systematically explore different captioning models with various contexts for the dense-captioning events in video task, which aims to generate captions for different events in the untrimmed video. We propose five types of contexts as well as two categories of event captioning models, and evaluate their contributions for event captioning from both accuracy and diversity aspects. The proposed captioning models are plugged into our pipeline system for the dense video captioning challenge. The overall system achieves the state-of-the-art performance on the dense-captioning events in video task with 9.91 METEOR score on the challenge testing set.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑