arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2410.17885cs.AIcs.CV

用于几何推理的定理验证逆向思维链问题生成

Theorem-Validated Reverse Chain-of-Thought Problem Generation for Geometric Reasoning

Huazhong University of Science and Technology(华中科技大学);Department of Computer Vision Technology, Baidu Inc(百度公司计算机视觉技术部门)

Linger Deng, Linghao Zhu, Yuliang Liu, Yu Wang, Qunyi Xie, Jingjing Wu, Gang Zhang, Yingying Zhu, Xiang Bai

AI总结:

针对大型多模态模型几何推理数据不足的问题,提出两阶段TR-CoT框架,通过定理验证的逆向思维链合成图文数据,显著提升了模型在MathVista和GeoQA等基准上的几何推理能力。

摘要:

大型多模态模型(LMMs)由于缺乏思维链(CoT)图文训练数据,在几何推理方面存在局限。现有方法利用基于模板或LLM辅助的方法创建几何CoT数据,但往往难以兼顾多样性与精确性。为弥补这一不足,我们提出了两阶段的定理验证逆向思维链推理合成(TR-CoT)框架。第一阶段TR-Engine合成具有结构化描述和属性的定理几何图形。第二阶段TR-Reasoner采用逆向推理,通过交叉验证几何属性和描述片段来迭代优化问答对。该方法扩展了定理类型覆盖范围,纠正了长期存在的误解,并增强了几何推理。细粒度CoT提升了定理理解,将逻辑一致性提高了24.5%。我们的最佳模型在MathVista和GeoQA上分别以10.1%和4.7%的优势超越基线,优于GPT-4o等先进闭源模型。

英文摘要:

Large Multimodal Models (LMMs) face limitations in geometric reasoning due to insufficient Chain of Thought (CoT) image-text training data. While existing approaches leverage template-based or LLM-assisted methods for geometric CoT data creation, they often face challenges in achieving both diversity and precision. To bridge this gap, we introduce a two-stage Theorem-Validated Reverse Chain-of-Thought Reasoning Synthesis (TR-CoT) framework. The first stage, TR-Engine, synthesizes theorem-grounded geometric diagrams with structured descriptions and properties. The second stage, TR-Reasoner, employs reverse reasoning to iteratively refine question-answer pairs by cross-validating geometric properties and description fragments. Our approach expands theorem-type coverage, corrects long-standing misunderstandings, and enhances geometric reasoning. Fine-grained CoT improves theorem understanding and increases logical consistency by 24.5%. Our best models surpass the baselines in MathVista and GeoQA by 10.1% and 4.7%, outperforming advanced closed-source models like GPT-4o.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑