arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.03414cs.CVcs.AI
收藏

Socratic-Geo:通过多智能体交互实现合成数据生成与几何推理

Socratic-Geo: Synthetic Data Generation and Geometric Reasoning via Multi-Agent Interaction

AI DATA, Alibaba Group Holding Limited(阿里数据,阿里巴巴集团控股有限公司);EPIC Lab, Shanghai Jiao Tong University(上海交通大学EPIC实验室);Shanghai University of Finance(上海财经大学);Wuhan University(武汉大学)

Zhengbo Jiao, Shaobo Wang, Zifan Zhang, Wei Wang, Bing Zhao, Hu Wei, Linfeng Zhang

AI总结:

Socratic-Geo通过多智能体交互实现合成数据生成与几何推理,利用教师代理和求解代理动态耦合数据合成与模型学习,提升图像生成和推理能力。

摘要:

多模态大语言模型(MLLMs)在视觉-语言理解方面取得了显著进展。然而,即使是最先进的模型在几何推理上也面临挑战,暴露了一个关键瓶颈:高质量图像-文本对的极度稀缺。人工标注成本过高,而自动化方法无法保证准确性和训练效果。现有方法要么被动适应可用图像,要么采用低效的随机探索加过滤方法,将生成与学习需求脱节。我们提出Socratic-Geo,一个完全自动的框架,通过多智能体交互动态耦合数据合成与模型学习。教师代理生成带有反思反馈的参数化Python脚本(Reflect用于可解性,RePI用于视觉有效性),确保图像-文本对的纯净度。求解代理通过偏好学习优化推理,失败路径引导教师的定向增强。独立地,生成器在积累的

英文摘要:

Multimodal Large Language Models (MLLMs) have significantly advanced vision-language understanding. However, even state-of-the-art models struggle with geometric reasoning, revealing a critical bottleneck: the extreme scarcity of high-quality image-text pairs. Human annotation is prohibitively expensive, while automated methods fail to ensure fidelity and training effectiveness. Existing approaches either passively adapt to available images or employ inefficient random exploration with filtering, decoupling generation from learning needs. We propose Socratic-Geo, a fully autonomous framework that dynamically couples data synthesis with model learning through multi-agent interaction. The Teacher agent generates parameterized Python scripts with reflective feedback (Reflect for solvability, RePI for visual validity), ensuring image-text pair purity. The Solver agent optimizes reasoning through preference learning, with failure paths guiding Teacher's targeted augmentation. Independently, the Generator learns image generation capabilities on accumulated "image-code-instruction" triplets, distilling programmatic drawing intelligence into visual generation. Starting from only 108 seed problems, Socratic-Solver achieves 49.11 on six benchmarks using one-quarter of baseline data, surpassing strong baselines by 2.43 points. Socratic-Generator achieves 42.4% on GenExam, establishing new state-of-the-art for open-source models, surpassing Seedream-4.0 (39.8%) and approaching Gemini-2.5-Flash-Image (43.1%).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑