Reinforcement Learning (RL) has emerged as a pivotal mechanism for enhancing the complex reasoning capabilities of Multimodal Large Language Models (MLLMs). However, prevailing paradigms typically rely on solitary rollout strategies where the model works alone. This lack of intermediate oversight renders the reasoning process susceptible to error propagation, where early logical deviations cascade into irreversible failures, resulting in noisy optimization signals. In this paper, we propose the \textbf{Guided Verifier} framework to address these structural limitations. Moving beyond passive terminal rewards, we introduce a dynamic verifier that actively co-solves tasks alongside the policy. During the rollout phase, this verifier interacts with the policy model in real-time, detecting inconsistencies and providing directional signals to steer the model toward valid trajectories. To facilitate this, we develop a specialized data synthesis pipeline targeting multimodal hallucinations, constructing \textbf{CoRe} dataset of process-level negatives and \textbf{Co}rrect-guide \textbf{Re}asoning trajectories to train the guided verifier. Extensive experiments on MathVista, MathVerse and MMMU indicate that by allocating compute to collaborative inference and dynamic verification, an 8B-parameter model can achieve strong performance.
A Verifier-Guided Explainable Reasoning Framework with Gold-Anchored QLoRA, Task-Aware Mixture-of-Experts, and Group-Relative RLVR
University of Information Technology (UIT)(信息科技大学);Ho Chi Minh City University of Technology (HCMUT)(胡志明市理工大学);Vietnam National University, Ho Chi Minh City(越南国家大学胡志明市分校);University of Economics Ho Chi Minh City (UEH)(胡志明市经济大学)
OpenSkill: Open-World Self-Evolution for LLM Agents
Lehigh University(莱维大学);University of Illinois Chicago(伊利诺伊大学芝加哥分校);University of British Columbia(不列颠哥伦比亚大学);Vector Institute(向量研究所);Salesforce AI Research(Salesforce人工智能研究);Massachusetts General Hospital and Harvard Medical School(麻省总医院和哈佛医学院)
Rewarding Novel Deductions: Solver-guided Process Supervision for Logical Reasoning
Information Technology University(信息技术大学);Huazhong Agricultural University(华中农业大学);Qatar Computing Research Institute, Hamad Bin Khalifa University(卡塔尔计算研究所,哈马德·本·哈利法大学)
Skill-Conditioned Gated Self-Distillation for LLM Reasoning
Tsinghua University(清华大学);Fudan University(复旦大学);City University of Hong Kong(香港城市大学);Huazhong University of Science and Technology(华中科技大学);University of Wisconsin-Madison(威斯康星大学麦迪逊分校)