Thinking with Frames: Generative Video Distortion Evaluation via Frame Reward Model
University of Science and Technology of China(中国科学技术大学);Kling Team, Kuaishou Technology(快手科技 Kling 团队);Institute of Software Chinese Academy of Sciences(中国科学院软件研究所)
Recent advances in video reward models and post-training strategies have improved text-to-video (T2V) generation. While these models typically assess visual quality, motion quality, and text alignment, they often overlook key structural distortions, such as abnormal object appearances and interactions, which can degrade the overall quality of the generative video. To address this gap, we introduce REACT, a frame-level reward model designed specifically for structural distortions evaluation in generative videos. REACT assigns point-wise scores and attribution labels by reasoning over video frames, focusing on recognizing distortions. To support this, we construct a large-scale human preference dataset, annotated based on our proposed taxonomy of structural distortions, and generate additional data using a efficient Chain-of-Thought (CoT) synthesis pipeline. REACT is trained with a two-stage framework: (1) supervised fine-tuning with masked loss for domain knowledge injection, followed by (2) reinforcement learning with Group Relative Policy Optimization (GRPO) and pairwise rewards to enhance reasoning capability and align output scores with human preferences. During inference, a dynamic sampling mechanism is introduced to focus on frames most likely to exhibit distortion. We also present REACT-Bench, a benchmark for generative video distortion evaluation. Experimental results demonstrate that REACT complements existing reward models in assessing structutal distortion, achieving both accurate quantitative evaluations and interpretable attribution analysis.
Thinking Without Images: Internalizing Visual Manipulation with On-Policy Self-Distillation
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(北京大学计算机学院多媒体信息处理国家重点实验室);Central South University(中南大学);University of Science and Technology of China(中国科学技术大学);Peking University(北京大学);Huawei Technologies(华为技术有限公司)
Aligning Thoughts with Answers: Probability Rewards to Tame Thinking Drift
National University of Singapore(新加坡国立大学);A*STAR Institute of Advanced Intelligence and Computing, Singapore(新加坡科技研究局先进智能与计算研究所);South China University of Technology(华南理工大学);University of Science and Technology of China(中国科学技术大学);Google DeepMind(谷歌DeepMind)
Sun Yat-sen University(中山大学);Lanzhou University(兰州大学);University of Hong Kong(香港大学);Hefei University of Technology(合肥工业大学);National University of Singapore(新加坡国立大学)
Q-DeepSight: Incentivizing Thinking with Images for Image Quality Assessment and Refinement
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University(中国教育部多媒体可信感知与高效计算重点实验室,厦门大学);Peking University(北京大学);Beijing Institute of Technology(北京理工大学)
Thinking With Bounding Boxes: Enhancing Spatio-Temporal Video Grounding via Reinforcement Fine-Tuning
ByteDance Intelligent Creation(字节跳动智能创作);Tsinghua University(清华大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Shanghai Jiao Tong University(上海交通大学);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所)
VideoTemp-o3: Harmonizing Temporal Grounding and Video Understanding in Agentic Thinking-with-Videos
Shandong University(山东大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beihang University(北航);Southern University of Science and Technology(南方科技大学)
4DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding
Tsinghua University, SIGS(清华大学 SIGS);Meituan(美团);The Chinese University of Hong Kong(香港中文大学);National University of Singapore(新加坡国立大学);LMMs-Lab(LMMs实验室);University of California, Los Angeles(加州大学洛杉矶分校)
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);OPPO AI Center, OPPO Inc.(OPPO人工智能中心,OPPO公司)