arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.09354cs.CV

Video-QTR: 一种基于查询的轻量级视频理解时序推理框架

Video-QTR: Query-Driven Temporal Reasoning Framework for Lightweight Video Understanding

School of Software Technology, Zhejiang University, Hangzhou, China(浙江大学软件技术学院);School of Computer Science, Zhejiang University, Hangzhou, China(浙江大学计算机科学学院);School of Software Engineering, Xidian University, Xi’an, China(西安电子科技大学软件工程学院)

Xinkui Zhao, Zuxin Wang, Yifan Zhang, Guanjie Cheng, Yueshen Xu, Shuiguang Deng, Chang Liu, Naibo Wang, Jianwei Yin

AI总结:

Video-QTR通过查询驱动的时序推理框架,实现轻量级视频理解,显著降低计算成本并提升效率。

摘要:

多模态大语言模型(MLLMs)的快速发展显著扩展了视觉语言推理的范围,使统一系统能够解释和描述复杂的视觉内容。然而,将这些模型应用于长视频理解仍然计算成本很高。密集帧编码生成过多的视觉标记,导致内存消耗高、计算冗余以及在实际应用中的可扩展性受限。这种低效性突显了传统

英文摘要:

The rapid development of multimodal large-language models (MLLMs) has significantly expanded the scope of visual language reasoning, enabling unified systems to interpret and describe complex visual content. However, applying these models to long-video understanding remains computationally intensive. Dense frame encoding generates excessive visual tokens, leading to high memory consumption, redundant computation, and limited scalability in real-world applications. This inefficiency highlights a key limitation of the traditional process-then-reason paradigm, which analyzes visual streams exhaustively before semantic reasoning. To address this challenge, we introduce Video-QTR (Query-Driven Temporal Reasoning), a lightweight framework that redefines video comprehension as a query-guided reasoning process. Instead of encoding every frame, Video-QTR dynamically allocates perceptual resources based on the semantic intent of the query, creating an adaptive feedback loop between reasoning and perception. Extensive experiments across five benchmarks: MSVD-QA, Activity Net-QA, Movie Chat, and Video MME demonstrate that Video-QTR achieves state-of-the-art performance while reducing input frame consumption by up to 73%. These results confirm that query-driven temporal reasoning provides an efficient and scalable solution for video understanding.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑