arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.19554cs.LGcs.AI
收藏

CARE:对比锚定反射用于可验证多模态推理

CARE What Fails: Contrastive Anchored-REflection for Verifiable Multimodal Reasoning

Yongxin Wang, Zhicheng Yang, Meng Cao, Mingfei Han, Haokun Lin, Yingying Zhu, Xiaojun Chang, Xiaodan Liang

AI总结:

CARE通过对比锚定反射框架,将错误转化为监督信号,提升多模态推理的准确性和训练平滑度,在六个可验证视觉推理基准上提升4.6个百分点。

摘要:

组相对强化学习与可验证奖励(RLVR)往往浪费其已拥有的最有信息量的数据,当所有回放都错误时,梯度停滞;当一个回放正确时,更新通常忽略其他接近但错误的原因,导致信用分配错误。我们提出CARE(对比锚定反射),一种以失败为中心的后训练框架,用于多模态推理,将错误转化为监督。CARE结合:(i)一个锚定对比目标,形成围绕最佳回放的紧凑子组和一组语义相近的难负样本,进行组内z分数归一化并仅使用负样本缩放,并包含一个全负救援以防止零信号批次;(ii)反射引导重采样(RGR),一种一次性结构化自我修复,重写代表性失败并用相同验证器重新评分,将近失转化为可用正样本,无需任何测试时间反思。CARE在Qwen2.5-VL-7B上,六个可验证视觉推理基准上提升宏平均准确率4.6个百分点;在Qwen3-VL-8B上,在相同评估协议下,在MathVista和MMMU-Pro上达到竞争或最先进结果。

英文摘要:

Group-relative reinforcement learning with verifiable rewards (RLVR) often wastes the most informative data it already has the failures. When all rollouts are wrong, gradients stall; when one happens to be correct, the update usually ignores why the others are close-but-wrong, and credit can be misassigned to spurious chains. We present CARE (Contrastive Anchored REflection), a failure-centric post-training framework for multimodal reasoning that turns errors into supervision. CARE combines: (i) an anchored-contrastive objective that forms a compact subgroup around the best rollout and a set of semantically proximate hard negatives, performs within-subgroup z-score normalization with negative-only scaling, and includes an all-negative rescue to prevent zero-signal batches; and (ii) Reflection-Guided Resampling (RGR), a one-shot structured self-repair that rewrites a representative failure and re-scores it with the same verifier, converting near-misses into usable positives without any test-time reflection. CARE improves accuracy and training smoothness while explicitly increasing the share of learning signal that comes from failures. On Qwen2.5-VL-7B, CARE lifts macro-averaged accuracy by 4.6 points over GRPO across six verifiable visual-reasoning benchmarks; with Qwen3-VL-8B it reaches competitive or state-of-the-art results on MathVista and MMMU-Pro under an identical evaluation protocol.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑