视频大模型

TSM: Temporal Shift Module for Efficient and Scalable Video Understanding on Edge Device

Ji Lin, Chuang Gan, Kuan Wang, Song Han

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments Journal preprint of arXiv:1811.08383 (TPAMI, 2020). arXiv admin note: substantial text overlap with arXiv:1910.00932

VLG-Net: Video-Language Graph Matching Network for Video Grounding

Mattia Soldan, Mengmeng Xu, Sisi Qu, Jesper Tegner, Bernard Ghanem

专题命中 视频理解 ：video-language(title,abstract)；分类 cs.CV

Comments 14 pages, 7 figures, In proceeding of the ICCV21 workshop: AI for Creative Video Editing and Understanding 2021

Towards Long-Form Video Understanding

Chao-Yuan Wu, Philipp Krähenbühl

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments CVPR 2021

Adaptive Intermediate Representations for Video Understanding

Juhana Kangaspunta, AJ Piergiovanni, Rico Jonschkowski, Michael Ryoo, Anelia Angelova

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Visual Semantic Role Labeling for Video Understanding

Arka Sadhu, Tanmay Gupta, Mark Yatskar, Ram Nevatia, Aniruddha Kembhavi

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments CVPR21 camera-ready including appendix. Project Page at https://vidsitu.org/

Unified Graph Structured Models for Video Understanding

Anurag Arnab, Chen Sun, Cordelia Schmid

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Large Scale Holistic Video Understanding

Ali Diba, Mohsen Fayyaz, Vivek Sharma, Manohar Paluri, Jurgen Gall, Rainer Stiefelhagen, Luc Van Gool

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments ECCV 2020

Towards Visually Explaining Video Understanding Networks with Perturbation

Zhenqiang Li, Weimin Wang, Zuoyue Li, Yifei Huang, Yoichi Sato

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments Accepted by WACV2021

Co-attentional Transformers for Story-Based Video Understanding

Björn Bebensee, Byoung-Tak Zhang

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments 10 pages, 2 figures, submitted to ICASSP 2021

Representation Learning on Visual-Symbolic Graphs for Video Understanding

Effrosyni Mavroudi, Benjamín Béjar Haro, René Vidal

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments ECCV 2020

Video Understanding as Machine Translation

Bruno Korbar, Fabio Petroni, Rohit Girdhar, Lorenzo Torresani

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments The authors have temporarily withdrawn this paper to reassess some of the experimental results

SoccerDB: A Large-Scale Database for Comprehensive Video Understanding

Yudong Jiang, Kaixu Cui, Leilei Chen, Canjin Wang, Changliang Xu

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments accepted by MM2020 sports workshop

MotionSqueeze: Neural Motion Feature Learning for Video Understanding

Heeseung Kwon, Manjin Kim, Suha Kwak, Minsu Cho

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments Accepted to ECCV 2020

TSM: Temporal Shift Module for Efficient Video Understanding

Ji Lin, Chuang Gan, Song Han

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments Accepted by ICCV 2019

Exploring Temporal Information for Improved Video Understanding

Yi Zhu

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments PhD dissertation. Posting here for easier access and update. Chapter 4, 6 and 7 are collaborative work

Constrained-size Tensorflow Models for YouTube-8M Video Understanding Challenge

Tianqi Liu, Bo Liu

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments Accepted paper at 2018 ECCV Youtube8M workshop: https://research.google.com/youtube8m/workshop2018/

Hierarchical Video Understanding

Farzaneh Mahdisoltani, Roland Memisevic, David Fleet

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Attend and Interact: Higher-Order Object Interactions for Video Understanding

Chih-Yao Ma, Asim Kadav, Iain Melvin, Zsolt Kira, Ghassan AlRegib, Hans Peter Graf

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments CVPR 2018

Temporal Modeling Approaches for Large-scale Youtube-8M Video Understanding

Fu Li, Chuang Gan, Xiao Liu, Yunlong Bian, Xiang Long, Yandong Li, Zhichao Li, Jie Zhou, Shilei Wen

专题命中 视频理解 ：video understanding(title,abstract)；分类 cs.CV

Comments To appear on CVPR 2017 YouTube-8M Workshop(Rank 3rd out of 650 teams)

SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning

SCOUT：面向超长时长自我中心视频推理的自检查与恢复感知工具思维智能体

Keyang Zhong, Kuo Wang, Peng Liu, Quanlong Zheng, Junlin Xie, Zhijia Liang, Yanhao Zhang, Guanbin Li

机构 * Sun Yat-sen University（中山大学） ； Shenzhen Loop Area Institute（深圳河套学院） ； Guangdong OPPO Mobile Telecommunications Corp., Ltd.（广东欧珀移动通信有限公司） ； OPPO AI Center（OPPO人工智能中心） ； The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳）） 纠错

专题命中 视频理解 ：video reasoning(title)；video understanding(abstract)

AI总结 本研究提出SCOUT智能体框架，结合自适应策略与UPS-GRPO方法，解决超长自我中心视频推理的错误传播及信用分配问题，在对应基准上达最优性能且短时长场景仍具竞争力。

Comments Accepted by ACM Multimedia 2026 (MM '26)

EgoEverything: A Benchmark for Human Behavior Inspired Long Context Egocentric Video Understanding in AR Environment

EgoEverything：一个受人类行为启发的长上下文第一人称视频理解AR环境基准

Qiance Tang, Ziqi Wang, Jieyu Lin, Ziyun Li, Barbara De Salvo, Sai Qian Zhang

机构 * New York University（纽约大学） ； Meta Reality Labs 纠错

专题命中 视频理解 ：video understanding(title,abstract)

AI总结 本文提出EgoEverything基准，通过利用人类注意力信号生成问题，更真实地捕捉自然人类行为，用于评估AR环境中长上下文第一人称视频理解。

Sink-Token-Aware Pruning for Fine-Grained Video Understanding in Efficient Video LLMs

面向高效视频大语言模型的sink-token感知剪枝：用于细粒度视频理解

Kibum Kim, Jiwan Kim, Kyle Min, Yueqi Wang, Jinyoung Moon, Julian McAuley, Chanyoung Park

机构 * Korea Advanced Institute of Science and Technology (KAIST)（韩国高级科学技术研究院） ； Oracle ； University of California, San Diego（加州大学圣地亚哥分校） ； Electronics and Telecommunications Research Institute (ETRI)（电子电信研究院） 纠错

专题命中 视频理解 ：video understanding(title,abstract)

AI总结 本文提出Sink-Token-aware Pruning方法，通过识别并抑制semantically uninformative tokens，提升细粒度视频理解性能，在多种基准测试中表现优异。

Comments ECCV 2026

VCIFBench: Evaluating Complex Instruction Following for Video Understanding

VCIFBench：评估视频理解中的复杂指令遵循能力

Huangchen Xu, Yuan Wu, Yi Chang

机构 * School of Artificial Intelligence, Jilin University（吉林大学人工智能学院） ； Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, Jilin University（知识驱动人机智能工程研究中心，吉林大学） ； International Center of Future Science, Jilin University（未来科学国际中心，吉林大学） 纠错

专题命中 视频理解 ：video understanding(title,abstract)

AI总结 提出VCIFBench基准，通过混合验证流水线评估多模态大模型在视频理解中遵循内容、格式、风格和结构约束的复杂指令能力，实验表明联合约束满足仍具挑战，DPO训练可提升性能。

HiCrew: Hierarchical Reasoning for Long-Form Video Understanding via Question-Aware Multi-Agent Collaboration

HiCrew：通过问题感知多智能体协作实现长视频理解的层次推理

Yuehan Zhu, Jingqi Zhao, Jiawen Zhao, Xudong Mao, Baoquan Zhao

机构 * School of Artificial Intelligence, Sun Yat-sen University, China（中山大学人工智能学院） 纠错

专题命中 视频理解 ：video understanding(title,abstract)

AI总结 本文提出HiCrew框架，通过混合树结构、问题感知描述生成和动态规划层，解决长视频中时空冗余和叙事依赖问题，提升时间与因果推理能力。

Multi-RAG: A Multimodal Retrieval-Augmented Generation System for Adaptive Video Understanding

Mingyang Mao, Mariela M. Perez-Cabarcas, Utteja Kallakuri, Nicholas R. Waytowich, Xiaomin Lin, Tinoosh Mohsenin

机构 * Johns Hopkins Whiting School of Engineering（约翰霍普金斯大学惠廷工程学院） ； DEVCOM Army Research Laboratory（国防部陆军研究实验室） 纠错

专题命中 视频理解 ：video understanding(title,abstract)

Automated Procedural Analysis via Video-Language Models for AI-assisted Nursing Skills Assessment

Shen Chang, Dennis Liu, Renran Tian, Kristen L. Swartzell, Stacie L. Klingler, Amy M. Nagle, Nan Kong

机构 * Weldon School of Biomedical Engineering, Purdue University（普渡大学生物医学工程学院） ； Department of Industrial and Operations Engineering, University of Michigan（密歇根大学工业与运作工程系） ； Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University（北卡罗来纳州立大学工业与系统工程系） ； School of Nursing, Purdue University（普渡大学护理学院） 纠错

专题命中 视频理解 ：video-language(title,abstract)

NoteIt: A System Converting Instructional Videos to Interactable Notes Through Multimodal Video Understanding

Running Zhao, Zhihan Jiang, Xinchen Zhang, Chirui Chang, Handi Chen, Weipeng Deng, Luyao Jin, Xiaojuan Qi, Xun Qian, Edith C. H. Ngai

机构 * The University of Hong Kong（香港大学） ； The Chinese University of Hong Kong（香港中文大学） ； Google（谷歌） 纠错

专题命中 视频理解 ：video understanding(title)；long video(abstract)

Comments Accepted to UIST 2025. Project website: https://zhaorunning.github.io/NoteIt/

Temporal Chain of Thought: Long-Video Understanding by Thinking in Frames

Anurag Arnab, Ahmet Iscen, Mathilde Caron, Alireza Fathi, Cordelia Schmid

机构 * Google DeepMind（谷歌DeepMind） 纠错

专题命中 视频理解 ：video understanding(title,abstract)

A SAT-centered XAI method for Deep Learning based Video Understanding

Hojer Key

专题命中 视频理解 ：video understanding(title,abstract)

Morph: Flexible Acceleration for 3D CNN-based Video Understanding

Kartik Hegde, Rohit Agrawal, Yulun Yao, Christopher W. Fletcher

专题命中 视频理解 ：video understanding(title,abstract)

Comments Appears in the proceedings of the 51st Annual IEEE/ACM International Symposium on Microarchitecture (MICRO), 2018