arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.17005cs.CV
收藏

PVUW 2024 复杂视频理解挑战赛:方法与结果

PVUW 2024 Challenge on Complex Video Understanding: Methods and Results

Henghui Ding, Chang Liu, Yunchao Wei, Nikhila Ravi, Shuting He, Song Bai, Philip Torr, Deshui Miao, Xin Li, Zhenyu He, Yaowei Wang, Ming-Hsuan Yang, Zhensong Xu… 展开作者

Henghui Ding, Chang Liu, Yunchao Wei, Nikhila Ravi, Shuting He, Song Bai, Philip Torr, Deshui Miao, Xin Li, Zhenyu He, Yaowei Wang, Ming-Hsuan Yang, Zhensong Xu, Jiangtao Yao, Chengjing Wu, Ting Liu, Luoqi Liu, Xinyu Liu, Jing Zhang, Kexin Zhang, Yuting Yang, Licheng Jiao, Shuyuan Yang, Mingqi Gao, Jingnan Luo, Jinyu Yang, Jungong Han, Feng Zheng, Bin Cao, Yisi Zhang, Xuanxu Lin, Xingjian He, Bo Zhao, Jing Liu, Feiyu Pan, Hao Fang, Xiankai Lu

AI总结:

本文介绍了 CVPR 2024 野外像素级视频理解挑战赛(PVUW),新增基于 MOSE 和 MeViS 数据集的两个复杂视频分割赛道,并提供更具挑战性的数据以促进复杂环境下的像素级视频理解研究。

摘要:

野外像素级视频理解挑战赛(PVUW)专注于复杂视频理解。在本次 CVPR 2024 研讨会中,我们新增了两个新赛道:基于 MOSE 数据集的复杂视频目标分割赛道,以及基于 MeViS 数据集的运动表达引导视频分割赛道。在这两个新赛道中,我们提供了额外的视频和标注,包含具有挑战性的元素,例如 MOSE 中目标的消失与重现、不显眼的小目标、严重遮挡和拥挤环境。此外,我们提供了新的运动表达引导视频分割数据集 MeViS,以研究复杂环境中的自然语言引导视频理解。这些新的视频、句子和标注使我们能够促进在复杂环境和现实场景中对视频场景进行更全面和稳健的像素级理解的发展。MOSE 挑战赛共有 140 支注册队伍,65 支队伍参与了验证阶段,12 支队伍在最终挑战阶段提交了有效结果。MeViS 挑战赛共有 225 支注册队伍,50 支队伍参与了验证阶段,5 支队伍在最终挑战阶段提交了有效结果。

英文摘要:

Pixel-level Video Understanding in the Wild Challenge (PVUW) focus on complex video understanding. In this CVPR 2024 workshop, we add two new tracks, Complex Video Object Segmentation Track based on MOSE dataset and Motion Expression guided Video Segmentation track based on MeViS dataset. In the two new tracks, we provide additional videos and annotations that feature challenging elements, such as the disappearance and reappearance of objects, inconspicuous small objects, heavy occlusions, and crowded environments in MOSE. Moreover, we provide a new motion expression guided video segmentation dataset MeViS to study the natural language-guided video understanding in complex environments. These new videos, sentences, and annotations enable us to foster the development of a more comprehensive and robust pixel-level understanding of video scenes in complex environments and realistic scenarios. The MOSE challenge had 140 registered teams in total, 65 teams participated the validation phase and 12 teams made valid submissions in the final challenge phase. The MeViS challenge had 225 registered teams in total, 50 teams participated the validation phase and 5 teams made valid submissions in the final challenge phase.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑