视频大模型

Localizing Events in Videos with Multimodal Queries

Gengyuan Zhang, Mang Ling Ada Fok, Jialu Ma, Yan Xia, Daniel Cremers, Philip Torr, Volker Tresp, Jindong Gu

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments 20 pages (including references and appendix); for the project homepage, see https://icq-benchmark.github.io/

VideoGLUE: Video General Understanding Evaluation of Foundation Models

Liangzhe Yuan, Nitesh Bharadwaj Gundavarapu, Long Zhao, Hao Zhou, Yin Cui, Lu Jiang, Xuan Yang, Menglin Jia, Tobias Weyand, Luke Friedman, Mikhail Sirotenko, Huisheng Wang, Florian Schroff, Hartwig Adam, Ming-Hsuan Yang, Ting Liu, Boqing Gong

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to TMLR

CAMEL-Bench: A Comprehensive Arabic LMM Benchmark

Sara Ghaboura, Ahmed Heakl, Omkar Thawakar, Ali Alharthi, Ines Riahi, Abduljalil Saif, Jorma Laaksonen, Fahad S. Khan, Salman Khan, Rao M. Anwer

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments 10 pages, 5 figures, NAACL

DTVLT: A Multi-modal Diverse Text Benchmark for Visual Language Tracking Based on LLM

Xuchen Li, Shiyu Hu, Xiaokun Feng, Dailing Zhang, Meiqi Wu, Jing Zhang, Kaiqi Huang

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Preprint, Under Review

AirLetters: An Open Video Dataset of Characters Drawn in the Air

Rishit Dagli, Guillaume Berger, Joanna Materzynska, Ingo Bax, Roland Memisevic

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments ECCV'24, HANDS workshop

Beyond Raw Videos: Understanding Edited Videos with Large Multimodal Model

Lu Xu, Sijie Zhu, Chunyuan Li, Chia-Wen Kuo, Fan Chen, Xinyao Wang, Guang Chen, Dawei Du, Ye Yuan, Longyin Wen

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Vision-Language Models Assisted Unsupervised Video Anomaly Detection

Yalong Jiang, Liquan Mao

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV

Visual Language Tracking with Multi-modal Interaction: A Robust Benchmark

Xuchen Li, Shiyu Hu, Xiaokun Feng, Dailing Zhang, Meiqi Wu, Jing Zhang, Kaiqi Huang

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV

Comments Under Review

Streamlining Forest Wildfire Surveillance: AI-Enhanced UAVs Utilizing the FLAME Aerial Video Dataset for Lightweight and Efficient Monitoring

Lemeng Zhao, Junjie Hu, Jianchao Bi, Yanbing Bai, Erick Mas, Shunichi Koshimura

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments accpeted by Proceedings of the International Conference on Intelligent Robots and Systems (2024 IROS)

DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmark

Haoxing Chen, Yan Hong, Zizheng Huang, Zhuoer Xu, Zhangxuan Gu, Yaohui Li, Jun Lan, Huijia Zhu, Jianfu Zhang, Weiqiang Wang, Huaxiong Li

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos

Xuehai He, Weixi Feng, Kaizhi Zheng, Yujie Lu, Wanrong Zhu, Jiachen Li, Yue Fan, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Kevin Lin, William Yang Wang, Lijuan Wang, Xin Eric Wang

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrieval

Thomas Hummel, Shyamgopal Karthik, Mariana-Iuliana Georgescu, Zeynep Akata

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments ECCV 2024

Fréchet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videos

Jiahe Liu, Youran Qu, Qi Yan, Xiaohui Zeng, Lele Wang, Renjie Liao

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Rethinking Video-Text Understanding: Retrieval from Counterfactually Augmented Data

Wufei Ma, Kai Li, Zhongshi Jiang, Moustafa Meshry, Qihao Liu, Huiyu Wang, Christian Häne, Alan Yuille

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments ECCV 2024. Project page: https://feint6k.github.io

VideoEval: Comprehensive Benchmark Suite for Low-Cost Evaluation of Video Foundation Model

Xinhao Li, Zhenpeng Huang, Jing Wang, Kunchang Li, Limin Wang

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captions

Xuan Ju, Yiming Gao, Zhaoyang Zhang, Ziyang Yuan, Xintao Wang, Ailing Zeng, Yu Xiong, Qiang Xu, Ying Shan

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

VRBiom: A New Periocular Dataset for Biometric Applications of HMD

Ketan Kotwal, Ibrahim Ulucan, Gokhan Ozbulak, Janani Selliah, Sebastien Marcel

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

video-SALMONN: Speech-Enhanced Audio-Visual Large Language Models

Guangzhi Sun, Wenyi Yu, Changli Tang, Xianzhao Chen, Tian Tan, Wei Li, Lu Lu, Zejun Ma, Yuxuan Wang, Chao Zhang

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted at ICML 2024. arXiv admin note: substantial text overlap with arXiv:2310.05863

Turns Out I'm Not Real: Towards Robust Detection of AI-Generated Videos

Qingyuan Liu, Pengyuan Shi, Yun-Yun Tsai, Chengzhi Mao, Junfeng Yang

专题命中 视频数据与评测 ：video diffusion(abstract)；分类 cs.CV

Semantic Segmentation on VSPW Dataset through Masked Video Consistency

Chen Liang, Qiang Guo, Chongkai Yu, Chengjing Wu, Ting Liu, Luoqi Liu

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

STAR: A Benchmark for Situated Reasoning in Real-World Videos

Bo Wu, Shoubin Yu, Zhenfang Chen, Joshua B Tenenbaum, Chuang Gan

专题命中 视频数据与评测 ：video reasoning(abstract)；分类 cs.CV

Comments NeurIPS

Exposing AI-generated Videos: A Benchmark Dataset and a Local-and-Global Temporal Defect Based Detection Method

Peisong He, Leyao Zhu, Jiaxing Li, Shiqi Wang, Haoliang Li

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

IPAD: Industrial Process Anomaly Detection Dataset

Jinfan Liu, Yichao Yan, Junjie Li, Weiming Zhao, Pengzhi Chu, Xingdong Sheng, Yunhui Liu, Xiaokang Yang

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

On the Content Bias in Fréchet Video Distance

Songwei Ge, Aniruddha Mahapatra, Gaurav Parmar, Jun-Yan Zhu, Jia-Bin Huang

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments CVPR 2024. Project webpage: https://content-debiased-fvd.github.io/

SportsHHI: A Dataset for Human-Human Interaction Detection in Sports Videos

Tao Wu, Runyu He, Gangshan Wu, Limin Wang

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by CVPR 2024

Learning Object State Changes in Videos: An Open-World Perspective

Zihui Xue, Kumar Ashutosh, Kristen Grauman

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by CVPR 2024, Project website: https://vision.cs.utexas.edu/projects/VidOSC/

Grounded Question-Answering in Long Egocentric Videos

Shangzhe Di, Weidi Xie

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024. Project website at https://dszdsz.cn/GroundVQA

MTMMC: A Large-Scale Real-World Multi-Modal Camera Tracking Benchmark

Sanghyun Woo, Kwanyong Park, Inkyu Shin, Myungchul Kim, In So Kweon

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

Comments Accepted on CVPR 2024

Video Annotator: A framework for efficiently building video classifiers using vision-language models and active learning

Amir Ziai, Aneesh Vartakavi

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Submitted for review to KDD '24 (ADS Track)

AIGCBench: Comprehensive Evaluation of Image-to-Video Content Generated by AI

Fanda Fan, Chunjie Luo, Wanling Gao, Jianfeng Zhan

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments Accepted to BenchCouncil Transactions on Benchmarks, Standards and Evaluations (TBench)