视频大模型

Temporal Contrastive Learning for Video Temporal Reasoning in Large Vision-Language Models

Rafael Souza, Jia-Hao Lim, Alexander Davis

专题命中 长视频与时序推理 ：video-language(abstract)；分类 cs.CV

InfinityDrive: Breaking Time Limits in Driving World Models

Xi Guo, Chenjing Ding, Haoxuan Dou, Xin Zhang, Weixuan Tang, Wei Wu

专题命中 长视频与时序推理 ：video generation(abstract)；分类 cs.CV

Comments project homepage: https://metadrivescape.github.io/papers_project/InfinityDrive/page.html

SEDMamba: Enhancing Selective State Space Modelling with Bottleneck Mechanism and Fine-to-Coarse Temporal Fusion for Efficient Error Detection in Robot-Assisted Surgery

Jialang Xu, Nazir Sirajudeen, Matthew Boal, Nader Francis, Danail Stoyanov, Evangelos Mazomenos

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments Accepted by IEEE RA-L

Journal ref IEEE Robotics and Automation Letters, vol. 10, no. 1, pp. 232-239, Jan. 2025

Det-SAM2:Technical Report on the Self-Prompting Segmentation Framework Based on Segment Anything Model 2

Zhiting Wang, Qiangong Zhou, Zongyang Liu

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Seq2Time: Sequential Knowledge Transfer for Video LLM Temporal Grounding

Andong Deng, Zhongpai Gao, Anwesa Choudhuri, Benjamin Planche, Meng Zheng, Bin Wang, Terrence Chen, Chen Chen, Ziyan Wu

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

LLaVA-MR: Large Language-and-Vision Assistant for Video Moment Retrieval

Weiheng Lu, Jian Li, An Yu, Ming-Ching Chang, Shengpeng Ji, Min Xia

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

ObjectNLQ @ Ego4D Episodic Memory Challenge 2024

Yisen Feng, Haoyu Zhang, Yuquan Xie, Zaijing Li, Meng Liu, Liqiang Nie

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments The solution for the Natural Language Query track and Goal Step track at CVPR EgoVis Workshop 2024

TeaserGen: Generating Teasers for Long Documentaries

Weihan Xu, Paul Pu Liang, Haven Kim, Julian McAuley, Taylor Berg-Kirkpatrick, Hao-Wen Dong

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiences

Yidong Huang, Jacob Sansom, Ziqiao Ma, Felix Gervits, Joyce Chai

专题命中 长视频与时序推理 ：video-language(abstract)；分类 cs.CV

Comments 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

A Simple LLM Framework for Long-Range Video Question-Answering

Ce Zhang, Taixi Lu, Md Mohaiminul Islam, Ziyang Wang, Shoubin Yu, Mohit Bansal, Gedas Bertasius

专题命中 长视频与时序推理 ：video understanding(abstract)；分类 cs.CV

Comments EMNLP 2024 main

Enhancing Temporal Modeling of Video LLMs via Time Gating

Zi-Yuan Hu, Yiwu Zhong, Shijia Huang, Michael R. Lyu, Liwei Wang

专题命中 长视频与时序推理 ：video understanding(abstract)；分类 cs.CV

Comments EMNLP 2024 Findings (Short)

CoTracker: It is Better to Track Together

Nikita Karaev, Ignacio Rocco, Benjamin Graham, Natalia Neverova, Andrea Vedaldi, Christian Rupprecht

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments Code and model weights are available at: https://co-tracker.github.io/

Efficient Video Object Segmentation via Modulated Cross-Attention Memory

Abdelrahman Shaker, Syed Talal Wasim, Martin Danelljan, Salman Khan, Ming-Hsuan Yang, Fahad Shahbaz Khan

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments WACV 2025

iRAG: Advancing RAG for Videos with an Incremental Approach

Md Adnan Arefeen, Biplob Debnath, Md Yusuf Sarwar Uddin, Srimat Chakradhar

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments Accepted in CIKM 2024

Autogenic Language Embedding for Coherent Point Tracking

Zikai Song, Ying Tang, Run Luo, Lintao Ma, Junqing Yu, Yi-Ping Phoebe Chen, Wei Yang

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments accepted by ACM MM 2024

An Inverse Partial Optimal Transport Framework for Music-guided Movie Trailer Generation

Yutong Wang, Sidan Zhu, Hongteng Xu, Dixin Luo

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.MM

Comments acmmm2024

EPD: Long-term Memory Extraction, Context-awared Planning and Multi-iteration Decision @ EgoPlan Challenge ICML 2024

Letian Shi, Qi Lv, Xiang Deng, Liqiang Nie

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Long Context Transfer from Language to Vision

Peiyuan Zhang, Kaichen Zhang, Bo Li, Guangtao Zeng, Jingkang Yang, Yuanhan Zhang, Ziyue Wang, Haoran Tan, Chunyuan Li, Ziwei Liu

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments Code, demo, and models are available at https://github.com/EvolvingLMMs-Lab/LongVA

MLLM as Video Narrator: Mitigating Modality Imbalance in Video Moment Retrieval

Weitong Cai, Jiabo Huang, Shaogang Gong, Hailin Jin, Yang Liu

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments Under review

Contrastive Language Video Time Pre-training

Hengyue Liu, Kyle Min, Hector A. Valdez, Subarna Tripathi

专题命中 长视频与时序推理 ：video understanding(abstract)；分类 cs.CV

Comments CVPR EgoVis Workshop 2024 extended abstract

Siamese Learning with Joint Alignment and Regression for Weakly-Supervised Video Paragraph Grounding

Chaolei Tan, Jianhuang Lai, Wei-Shi Zheng, Jian-Fang Hu

专题命中 长视频与时序推理 ：video-language(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024. v2: fix a typo in figure 1

Fast Training Data Acquisition for Object Detection and Segmentation using Black Screen Luminance Keying

Thomas Pöllabauer, Volker Knauthe, André Boller, Arjan Kuijper, Dieter Fellner

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments 32. International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision'2024

LoopAnimate: Loopable Salient Object Animation

Fanyi Wang, Peng Liu, Haotian Hu, Dan Meng, Jingwen Su, Jinjin Xu, Yanhao Zhang, Xiaoming Ren, Zhiwang Zhang

专题命中 长视频与时序推理 ：video generation(abstract)；分类 cs.CV

TAM-VT: Transformation-Aware Multi-scale Video Transformer for Segmentation and Tracking

Raghav Goyal, Wan-Cyuan Fan, Mennatullah Siam, Leonid Sigal

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

TIM: A Time Interval Machine for Audio-Visual Action Recognition

Jacob Chalk, Jaesung Huh, Evangelos Kazakos, Andrew Zisserman, Dima Damen

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024. Project Webpage: https://jacobchalk.github.io/TIM-Project

Dr$^2$Net: Dynamic Reversible Dual-Residual Networks for Memory-Efficient Finetuning

Chen Zhao, Shuming Liu, Karttikeya Mangalam, Guocheng Qian, Fatimah Zohra, Abdulmohsen Alghannam, Jitendra Malik, Bernard Ghanem

专题命中 长视频与时序推理 ：video understanding(abstract)；分类 cs.CV

Journal ref the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024

Time-series Initialization and Conditioning for Video-agnostic Stabilization of Video Super-Resolution using Recurrent Networks

Hiroshi Mori, Norimichi Ukita

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV

Comments Accepted to IJCNN 2024 (International Joint Conference on Neural Networks)

Explorative Inbetweening of Time and Space

Haiwen Feng, Zheng Ding, Zhihao Xia, Simon Niklaus, Victoria Abrevaya, Michael J. Black, Xuaner Zhang

专题命中 长视频与时序推理 ：video generation(abstract)；分类 cs.CV

Comments project page at https://time-reversal.github.io

BlazeBVD: Make Scale-Time Equalization Great Again for Blind Video Deflickering

Xinmin Qiu, Congying Han, Zicheng Zhang, Bonan Li, Tiande Guo, Pingyu Wang, Xuecheng Nie

专题命中 长视频与时序推理 ：video generation(abstract)；分类 cs.CV

Neural Video Fields Editing

Shuzhou Yang, Chong Mou, Jiwen Yu, Yuhan Wang, Xiandong Meng, Jian Zhang

专题命中 长视频与时序推理 ：long video(abstract)；分类 cs.CV