arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.11124cs.CV
收藏

PhyCritic:面向物理AI的多模态批评模型

PhyCritic: Multimodal Critic Models for Physical AI

Tianyi Xiong, Shihao Wang, Guilin Liu, Yi Dong, Ming Li, Heng Huang, Jan Kautz, Zhiding Yu

AI总结:

PhyCritic通过双阶段RLVR流程优化,提升物理AI任务中的感知和推理能力,实现对物理任务的高效评估和改进。

摘要:

随着大尺寸多模态模型的快速发展,可靠评判和批评模型已成为开放性评估和偏好对齐的关键,能够提供成对偏好、数值评分和解释性论证来评估模型生成的响应。然而,现有批评模型主要在通用视觉领域如描述生成或图像问答中训练,使涉及感知、因果推理和规划的物理AI任务仍处于探索阶段。我们引入PhyCritic,一种通过双阶段RLVR流程优化的多模态批评模型:一个物理技能预热阶段,增强以物理为导向的感知和推理,随后是自指批评微调,其中批评者生成自身的预测作为内部参考后再判断候选响应,从而提高判断稳定性和物理正确性。在物理和通用多模态评判基准上,PhyCritic在开源基线上实现了显著的性能提升,并当作为策略模型应用时,进一步提高了在物理基础任务中的感知和推理能力。

英文摘要:

With the rapid development of large multimodal models, reliable judge and critic models have become essential for open-ended evaluation and preference alignment, providing pairwise preferences, numerical scores, and explanatory justifications for assessing model-generated responses. However, existing critics are primarily trained in general visual domains such as captioning or image question answering, leaving physical AI tasks involving perception, causal reasoning, and planning largely underexplored. We introduce PhyCritic, a multimodal critic model optimized for physical AI through a two-stage RLVR pipeline: a physical skill warmup stage that enhances physically oriented perception and reasoning, followed by self-referential critic finetuning, where the critic generates its own prediction as an internal reference before judging candidate responses, improving judgment stability and physical correctness. Across both physical and general-purpose multimodal judge benchmarks, PhyCritic achieves strong performance gains over open-source baselines and, when applied as a policy model, further improves perception and reasoning in physically grounded tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑