TimeThink:用于视频语言模型的时间推理
TimeThink: Reasoning with Time for Video LLMs
AI总结:
研究视频推理中模型发现时间证据的问题,提出TimeThink框架,将时间线索步骤作为优化原语,引入奖励和优化目标,构建数据集,实验表明该框架提升了时间定位和推理性能。
摘要:
视频推理要求模型在长视频序列中识别和验证时间局部证据。近期视频大语言模型与强化学习结合有推理能力,但现有方法依赖基于结果的奖励,对中间推理指导有限。本文提出TimeThink,明确指导视频语言模型中的时间证据发现,介绍相关奖励和目标,构建数据集,实验显示其提升了时间定位和推理性能。
英文摘要:
Video reasoning requires models to identify and verify temporally localized evidence within long video sequences. Recent Video Large Language Models (Video-LLMs) have shown promising reasoning abilities when aligned with reinforcement learning, yet existing approaches typically rely on outcome-based rewards that supervise only the final prediction. Such supervision provides limited guidance on how models should discover the relevant temporal evidence during intermediate reasoning. In this work, we propose TimeThink, a reinforcement learning framework that explicitly guides temporal evidence discovery in Video-LLMs. Our key idea is to treat temporal clue steps as the fundamental optimization primitive of video reasoning, where each reasoning step references a candidate time interval in the video. We introduce a step-wise temporal process reward that provides localized credit assignment for these clues and a joint process--outcome optimization objective that balances reasoning fidelity with task correctness. To enable scalable training, we construct TimeThink-RFT-20K, a dataset with automatically derived temporal evidence segments. Extensive experiments across video reasoning, temporal grounding, and general video understanding benchmarks show that TimeThink consistently improves both temporal localization and reasoning performance, achieving state-of-the-art results among open-source video RL models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。