视频大模型

CLEVRER-Humans: Describing Physical and Causal Events the Human Way

Jiayuan Mao, Xuelin Yang, Xikun Zhang, Noah D. Goodman, Jiajun Wu

机构 * MIT（麻省理工学院） ； Stanford University（斯坦福大学） 纠错

专题命中 视频数据与评测 ：video reasoning(abstract)；分类 cs.CV

Comments Version 3. NeurIPS 2022 (Dataset and Benchmark Track). First two authors contributed equally. Project page: https://sites.google.com/stanford.edu/clevrer-humans/home

RTime-QA: A Benchmark for Atomic Temporal Event Understanding in Large Multi-modal Models

Yuqi Liu, Qin Jin, Tianyuan Qu, Xuan Liu, Yang Du, Bei Yu, Jiaya Jia

机构 * CUHK（香港中文大学） ； HKUST（香港理工大学） ； RUC（中国人民大学） 纠错

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV

How Well Can General Vision-Language Models Learn Medicine By Watching Public Educational Videos?

Rahul Thapa, Andrew Li, Qingyang Wu, Bryan He, Yuki Sahashi, Christina Binder, Angela Zhang, Ben Athiwaratkun, Shuaiwen Leon Song, David Ouyang, James Zou

机构 * Stanford University（斯坦福大学） ； Together AI ； University of California, Berkeley（加州大学伯克利分校） ； Cedars-Sinai Medical Center（西德斯-西奈医学中心） ； University of California, San Francisco（加州大学旧金山分校） 纠错

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

CineTechBench: A Benchmark for Cinematographic Technique Understanding and Generation

Xinran Wang, Songyu Xu, Xiangxuan Shan, Yuxuan Zhang, Muxi Diao, Xueyan Duan, Yanhua Huang, Kongming Liang, Zhanyu Ma

机构 * Beijing University of Posts and Telecommunications（北京邮电大学） ； China Mobile Research Institute（中国移动研究院） 纠错

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments Under review

UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learning

Sule Bai, Mingxing Li, Yong Liu, Jing Tang, Haoji Zhang, Lei Sun, Xiangxiang Chu, Yansong Tang

机构 * Tsinghua Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院） ； AMAP, Alibaba Group（阿里云研究院） 纠错

专题命中 视频数据与评测 ：video reasoning(abstract)；分类 cs.CV

FIOVA: A Multi-Annotator Benchmark for Human-Aligned Video Captioning

Shiyu Hu, Xuchen Li, Xuzhao Li, Jing Zhang, Yipei Wang, Xin Zhao, Kang Hao Cheong

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

RVTBench: A Benchmark for Visual Reasoning Tasks

Yiqing Shen, Chenjia Li, Chenxiao Fan, Mathias Unberath

机构 * Johns Hopkins University（约翰霍普金斯大学） 纠错

专题命中 视频数据与评测 ：video reasoning(abstract)；分类 cs.CV

SeriesBench: A Benchmark for Narrative-Driven Drama Series Understanding

Chenkai Zhang, Yiming Lei, Zeming Liu, Haitao Leng, Shaoguo Liu, Tingting Gao, Qingjie Liu, Yunhong Wang

机构 * State Key Laboratory of Virtual Reality Technology and Systems, Beihang University（虚拟现实技术与系统国家重点实验室，北京航空航天大学） ； School of Computer Science and Engineering, Beihang University（北京航空航天大学计算机科学与工程学院） ； Hangzhou Innovation Institute, Beihang University（杭州创新研究院） ； Kuaishou Technology（快手科技） 纠错

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments 29 pages, 15 figures, CVPR 2025

VideoLLM Benchmarks and Evaluation: A Survey

Yogesh Kumar

机构 * Indian Institute of Technology Jodhpur（印度理工学院朱达普尔） 纠错

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments 12 pages, 2 Tables

Simple Visual Artifact Detection in Sora-Generated Videos

Misora Sugiyama, Hirokatsu Kataoka

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Latent Video Dataset Distillation

Ning Li, Antai Andy Liu, Jingran Zhang, Justin Cui

机构 * University of California, Los Angeles（加州大学洛杉矶分校） 纠错

专题命中 视频数据与评测 ：text-to-video(abstract)；分类 cs.CV

Comments https://openreview.net/forum?id=i665TIHv92

Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Content

Qiuheng Wang, Yukai Shi, Jiarong Ou, Rui Chen, Ke Lin, Jiahao Wang, Boyuan Jiang, Haotian Yang, Mingwu Zheng, Xin Tao, Fei Yang, Pengfei Wan, Di Zhang

机构 * Shenzhen University（深圳大学） ； Tsinghua University（清华大学） ； Kuaishou Technology（快手科技） 纠错

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments Accepted by CVPR2025. Project page: https://koala36m.github.io/

TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videos

Linli Yao, Yicheng Li, Yuancheng Wei, Lei Li, Shuhuai Ren, Yuanxin Liu, Kun Ouyang, Lean Wang, Shicheng Li, Sida Li, Lingpeng Kong, Qi Liu, Yuanxing Zhang, Xu Sun

机构 * Peking University（北京大学） ； South China University of Technology（华南理工大学） ； The University of Hong Kong（香港大学） ； Kuaishou Technology（快手科技） 纠错

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

IV-Bench: A Benchmark for Image-Grounded Video Perception and Reasoning in Multimodal LLMs

David Ma, Yuanxing Zhang, Jincheng Ren, Jarvis Guo, Yifan Yao, Zhenlin Wei, Zhenzhu Yang, Zhongyuan Peng, Boyu Feng, Jun Ma, Xiao Gu, Zhoufutu Wen, King Zhu, Yancheng He, Meng Cao, Shiwen Ni, Jiaheng Liu, Wenhao Huang, Ge Zhang, Xiaojie Jin

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

ResNetVLLM-2: Addressing ResNetVLLM's Multi-Modal Hallucinations

Ahmad Khalil, Mahmoud Khalil, Alioune Ngom

机构 * University of Windsor（温莎大学） 纠错

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV

VACT: A Video Automatic Causal Testing System and a Benchmark

Haotong Yang, Qingyuan Zheng, Yunjian Gao, Yongkun Yang, Yangbo He, Zhouchen Lin, Muhan Zhang

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments A preliminary version of this paper has been accepted by workshop SCSL@ICLR 2025

FingER: Content Aware Fine-grained Evaluation with Reasoning for AI-Generated Videos

Rui Chen, Lei Sun, Jing Tang, Geng Li, Xiangxiang Chu

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments 10 pages, 4 figures

RealCam-Vid: High-resolution Video Dataset with Dynamic Scenes and Metric-scale Camera Movements

Guangcong Zheng, Teng Li, Xianpan Zhou, Xi Li

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning

Yukun Qi, Yiming Zhao, Yu Zeng, Xikun Bao, Wenxuan Huang, Lin Chen, Zehui Chen, Jie Zhao, Zhongang Qi, Feng Zhao

专题命中 视频数据与评测 ：video reasoning(abstract)；分类 cs.CV

SF2T: Self-supervised Fragment Finetuning of Video-LLMs for Fine-Grained Understanding

Yangliu Hu, Zikai Song, Na Feng, Yawei Luo, Junqing Yu, Yi-Ping Phoebe Chen, Wei Yang

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to CVPR2025

AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark

Wenhao Chai, Enxin Song, Yilun Du, Chenlin Meng, Vashisht Madhavan, Omer Bar-Tal, Jenq-Neng Hwang, Saining Xie, Christopher D. Manning

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to ICLR 2025. Code, docs, weight, benchmark and training data are all avaliable at https://rese1f.github.io/aurora-web/

OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts

Yuxuan Wang, Yueqian Wang, Bo Chen, Tong Wu, Dongyan Zhao, Zilong Zheng

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments To appear at CVPR 2025

VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM

Yuqian Yuan, Hang Zhang, Wentong Li, Zesen Cheng, Boqiang Zhang, Long Li, Xin Li, Deli Zhao, Wenqiao Zhang, Yueting Zhuang, Jianke Zhu, Lidong Bing

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments 17 pages, 14 figures, technical report

FAVOR-Bench: A Comprehensive Benchmark for Fine-Grained Video Motion Understanding

Chongjun Tu, Lin Zhang, Pengtao Chen, Peng Ye, Xianfang Zeng, Wei Cheng, Gang Yu, Tao Chen

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments FAVOR-Bench project page: https://favor-bench.github.io/

AIGVE-Tool: AI-Generated Video Evaluation Toolkit with Multifaceted Benchmark

Xinhao Xiang, Xiao Liu, Zizhong Li, Zhuosheng Liu, Jiawei Zhang

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

ViSpeak: Visual Instruction Feedback in Streaming Videos

Shenghao Fu, Qize Yang, Yuan-Ming Li, Yi-Xing Peng, Kun-Yu Lin, Xihan Wei, Jian-Fang Hu, Xiaohua Xie, Wei-Shi Zheng

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferences

Zhikai Li, Xuewen Liu, Dongrong Joe Fu, Jianquan Li, Qingyi Gu, Kurt Keutzer, Zhen Dong

专题命中 视频数据与评测 ：text-to-video(abstract)；分类 cs.CV

Comments CVPR 2025. Project page: https://huggingface.co/spaces/ksort/K-Sort-Arena

Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularity

Huaxin Zhang, Xiaohao Xu, Xiang Wang, Jialong Zuo, Xiaonan Huang, Changxin Gao, Shanjun Zhang, Li Yu, Nong Sang

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

Comments Accepted by CVPR2025

Infrared Small Target Detection in Satellite Videos: A New Dataset and A Novel Recurrent Feature Refinement Framework

Xinyi Ying, Li Liu, Zaipin Lin, Yangsi Shi, Yingqian Wang, Ruojing Li, Xu Cao, Boyang Li, Shilin Zhou, Wei An

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Shot2Story: A New Benchmark for Comprehensive Understanding of Multi-shot Videos

Mingfei Han, Linjie Yang, Xiaojun Chang, Lina Yao, Heng Wang

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments ICLR 2025. Extended annotation with 43K multi-shot videos in total. https://mingfei.info/shot2story for updates and more information