Vision-Language Models (VLMs) show promise in medical image analysis, yet their capacity for structured reasoning in complex domains like dermatology is often limited by data scarcity and the high computational cost of advanced training techniques. To address these challenges, we introduce DermIQ-VLM, a VLM developed through a multi-stage, resource-efficient methodology designed to emulate a dermatologist's diagnostic process. Our primary contribution is a modified version of Grouped Relative Policy Optimization (GRPO), called GRPO++, which stabilizes the powerful but data-intensive GRPO framework. Our proposed training pipeline first employs GRPO++ for reasoning-oriented disease recognition, followed by supervised fine-tuning for conversational ability. To mitigate factual errors introduced during this step, we then align the model using Direct Preference Optimization (DPO), leveraging a Knowledge Graph-based system as a scalable proxy for expert preference. A preliminary evaluation on a curated dermatological dataset demonstrates that our proposed methodology yields notable performance gains over standard fine-tuning approaches. These findings validate the potential of our pipeline as a feasible pathway for developing specialized, reliable VLMs in resource-constrained environments.
DRA-GRPO: Your GRPO Needs to Know Diverse Reasoning Paths for Mathematical Reasoning
Morgan Stanley(摩根士丹利);Clemson University(克莱姆森大学);Arizona State University(亚利桑那州立大学);Washington University in St. Louis(圣路易斯华盛顿大学);University of Notre Dame(圣母大学);University of Arizona(亚利桑那大学)
Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Tasks
Huazhong University of Science and Technology(华中科技大学);Zhongguancun Academy(中关村学院);East China Normal University(华东师范大学);Zhengzhou University(郑州大学);Zhongguancun Institute of Artificial Intelligence(中关村人工智能研究院)
TemplateRL: Structured Template-Guided Reinforcement Learning for LLM Reasoning
Tsinghua University(清华大学);Nanyang Technological University(南洋理工大学);Princeton University(普林斯顿大学);Shanghai AI Lab(上海人工智能实验室);Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心)
M-GRPO: Stabilizing Self-Supervised Reinforcement Learning for Large Language Models with Momentum-Anchored Policy Optimization
Shanghai Innovation Institute(上海创新研究院);College of Future Information Technology, Fudan(复旦大学未来信息技术学院);Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学)
ProcessThinker: Enhancing Multi-modal Large Language Models Reasoning via Rollout-based Process Reward
LMU Munich(慕尼黑大学);Harvard University(哈佛大学);University of Cambridge(剑桥大学);Mina AI;Konrad Zuse School of Excellence in Reliable AI (relAI)(康拉德·楚泽可靠人工智能卓越学校(relAI))
Harder Is Better: Boosting Mathematical Reasoning via Difficulty-Aware GRPO and Multi-Aspect Question Reformulation
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);AMAP, Alibaba Group(阿里集团AMAP);Xiamen University(厦门大学);Dalian University of Technology(大连理工大学)
Train Long, Think Short: Curriculum Learning for Efficient Reasoning
King Abdullah University of Science and Technology (KAUST), Saudi Arabia(卡布尔大学科学与技术大学);Massachusetts Institute of Technology (MIT), Cambridge, MA, USA(麻省理工学院);Princeton University, Princeton, NJ, USA(普林斯顿大学)
Slow-Fast Policy Optimization: Reposition-Before-Update for LLM Reasoning
Georgia Institute of Technology(佐治亚理工学院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Manchester(曼彻斯特大学);NVIDIA;Independent(独立);Emory University(埃默里大学)
Plan Then Action:High-Level Planning Guidance Reinforcement Learning for LLM Reasoning
Case Western Reserve University, Cleveland, OH, USA(凯斯西储大学);Kean University, Union, NJ, USA(凯恩大学);The Ohio State University, Columbus, OH, USA(俄亥俄州立大学);Fudan University, Shanghai, China(复旦大学);Shanghai Artificial Intelligence Laboratory, Shanghai, China(上海人工智能实验室);The University of Hong Kong, Hong Kong, China(香港大学);North Carolina State University, Raleigh, NC, USA(北卡罗来纳州立大学)
Don't Tell the Answer, Truly Guide the Reasoning During RL Rollouts
School of Data Science, Fudan University(复旦大学数据科学学院);Shanghai Institute of Artificial Intelligence for Education, East China Normal University(华东师范大学教育人工智能研究所);College of Computer Science and Artificial Intelligence, Fudan University(复旦大学计算机科学与人工智能学院);Ant Group(蚂蚁集团)
Graph Reasoning Paradigm: Structured and Symbolic Reasoning with Topology-Aware Reinforcement Learning for Large Language Models
Harbin Institute of Technology(哈尔滨工业大学);State Key Laboratory of Cognitive Intelligence(认知智能国家重点实验室);Tianjin Normal University(天津师范大学);Pengcheng Laboratory(鹏城实验室)
Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning
Zhejiang University(浙江大学);Fudan University(复旦大学);Soochow University(苏州大学);Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学)