We introduce TV show Retrieval (TVR), a new multimodal retrieval dataset. TVR requires systems to understand both videos and their associated subtitle (dialogue) texts, making it more realistic. The dataset contains 109K queries collected on 21.8K videos from 6 TV shows of diverse genres, where each query is associated with a tight temporal window. The queries are also labeled with query types that indicate whether each of them is more related to video or subtitle or both, allowing for in-depth analysis of the dataset and the methods that built on top of it. Strict qualification and post-annotation verification tests are applied to ensure the quality of the collected data. Further, we present several baselines and a novel Cross-modal Moment Localization (XML ) network for multimodal moment retrieval tasks. The proposed XML model uses a late fusion design with a novel Convolutional Start-End detector (ConvSE), surpassing baselines by a large margin and with better efficiency, providing a strong starting point for future work. We have also collected additional descriptions for each annotated moment in TVR to form a new multimodal captioning dataset with 262K captions, named TV show Caption (TVC). Both datasets are publicly available. TVR: https://tvr.cs.unc.edu, TVC: https://tvr.cs.unc.edu/tvc.html.
ViSeRet: A simple yet effective approach to moment retrieval via fine-grained video segmentation
Twelve Labs;KAIST(韩国科学技术院)
视频文本检索有许多现实世界的应用,如媒体分析,监控和机器人。本文介绍了ICCV Value Challenge 2021视频检索赛道的第一名解决方案。我们提出了一个简单而有效的方法来联合处理两个视频文本检索任务(视频检索和视频语料库矩检索),利用模型只训练视频检索任务。此外,我们还创建了一个集成模型,在Value Challenge中提出的所有四个数据集(TVr,How2r,YouCook2r和VATEXr)上实现了最先进的性能。
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale
Goethe University Frankfurt(法兰克福大学);SIC;University of Bonn(波恩大学);University of Oxford(牛津大学);MIT-IBM Watson AI Lab(麻省理工学院-IBM沃森人工智能实验室);Saarland University(萨尔大学)
RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adapter
School of Electronic and Computer Engineering, Peking University(北京大学电子与计算机工程学院);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Peng Cheng Laboratory(鹏城实验室);The Hong Kong University of Science and Technology(香港科技大学);Sun Yat-sen University(中山大学)
Dual Learning with Dynamic Knowledge Distillation and Soft Alignment for Partially Relevant Video Retrieval
College of Computer and Information Engineering, Zhejiang Gongshang University(浙江工商大学计算机与信息工程学院);Wangxuan Institute of Computer Technology, Peking University(北京大学王轩计算机技术研究所);School of Information Science and Technology, University of Science and Technology of China(中国科学技术大学信息科学与技术学院);Binjiang Institute of Zhejiang University(浙江大学滨江学院);School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机科学与信息工程学院)
Towards Explainable Bilingual Multimodal Misinformation Detection and Localization
University of Liverpool, United Kingdom(利物浦大学);National University of Singapore, Singapore(新加坡国立大学);The Chinese University of Hong Kong, Shenzhen, China(香港中文大学(深圳))
BiMa: Towards Biases Mitigation for Text-Video Retrieval via Scene Element Guidance
FPT Software AI Center(FPT软件AI中心);Aalborg University(奥尔堡大学);Pioneer Centre for AI(先锋人工智能中心);University of Liverpool(利物浦大学);AICV Lab, University of Arkansas(AICV实验室,阿肯色大学)
EVE: Towards End-to-End Video Subtitle Extraction with Vision-Language Models
College of Computer Science and Artificial Intelligence, Fudan University(复旦大学计算机科学与人工智能学院);ByteDance Inc.(字节跳动公司);College of Electronic and Information Engineering, Tongji University(同济大学电子与信息工程学院);School of Computing and Communications, Lancaster University(兰卡斯特大学计算机与通讯学院)
Towards Efficient Partially Relevant Video Retrieval with Active Moment Discovering
University of Science and Technology of China (USTC)(中国科学技术大学);National University of Defense Technology (NUDT)(国防科技大学);Hefei University of Technology (HFUT)(合肥工业大学);Hefei Comprehensive National Science Center(合肥综合性国家科学中心)
GUIDE: Resolving Domain Bias in GUI Agents through Real-Time Web Video Retrieval and Plug-and-Play Annotation
Shanghai Jiao Tong University(上海交通大学);State Key Laboratory for General Artificial Intelligence, BIGAI(通用人工智能国家重点实验室,北京通用人工智能研究院);Beijing Institute of Technology(北京理工大学)
Concentrate After Imagination: Text-Conditioned Evidence Grounding for Partially Relevant Video Retrieval
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));University of Electronic Science and Technology of China(电子科技大学);The Hong Kong University of Science and Technology(香港科技大学)
Overview of the NLPCC 2026 Shared Task 1: Difficulty-Aware Multilingual and Multimodal Medical Instructional Video Understanding Evaluation
School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与工程学院);Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算学系);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)