arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.00092cs.AIcs.ETcs.GTcs.MA
收藏

多模态大语言模型(MLLMs)中的视觉推理与多智能体方法:求解TSP和mTSP组合挑战

Visual Reasoning and Multi-Agent Approach in Multimodal Large Language Models (MLLMs): Solving TSP and mTSP Combinatorial Challenges

Queensland University of Technology(昆士兰科技大学);Al-Ahliyya Amman University(安曼阿赫利亚大学);Budapest University of Technology and Economics(布达佩斯技术与经济大学);Arab American University(阿拉伯美国大学);Columbia University(哥伦比亚大学);Minia University(米尼亚大学)

Mohammed Elhenawy, Ahmad Abutahoun, Taqwa I. Alhadidi, Ahmed Jaber, Huthaifa I. Ashqar, Shadi Jaradat, Ahmed Abdelhay, Sebastien Glaser, Andry Rakotonirainy

AI总结:

本文研究多模态大语言模型利用视觉推理和多智能体方法求解TSP与mTSP组合优化问题,提出包含初始化器、批评者、评分者的多智能体框架,实验证明其能显著提升零样本场景下的解质量。

摘要:

多模态大语言模型(MLLMs)利用涵盖文本、图像和音频的全面知识,能够熟练地处理复杂问题,包括零样本上下文学习场景。本研究探讨了MLLMs在视觉上求解旅行商问题(TSP)和多旅行商问题(mTSP)的能力,使用描绘二维平面上点分布的图像。我们引入了一种新方法,在MLLM框架内采用多个专用智能体,每个智能体专门致力于优化这些组合挑战的解决方案。我们的实验研究包括在零样本设置下进行严格评估,并引入了创新的多智能体零样本上下文场景。结果表明,两种多智能体模型——多智能体1(包含初始化器、批评者和评分者智能体)和多智能体2(仅包含初始化器和批评者智能体)——都显著提高了TSP和mTSP问题的解质量。多智能体1在需要详细路线细化和评估的环境中表现出色,为复杂优化提供了稳健的框架。相比之下,多智能体2专注于初始化器和批评者的迭代细化,在快速决策场景中证明有效。这些实验产生了有前景的结果,展示了MLLMs在解决各种组合问题方面的强大视觉推理能力。研究结果强调了MLLMs作为计算优化中强大工具的潜力,提供了可能激发这一有前景领域进一步发展的见解。项目链接:https://github.com/ahmed-abdulhuy/Solving-TSP-and-mTSP-Combinatorial-Challenges-using-Visual-Reasoning-and-Multi-Agent-Approach-MLLMs-.git

英文摘要:

Multimodal Large Language Models (MLLMs) harness comprehensive knowledge spanning text, images, and audio to adeptly tackle complex problems, including zero-shot in-context learning scenarios. This study explores the ability of MLLMs in visually solving the Traveling Salesman Problem (TSP) and Multiple Traveling Salesman Problem (mTSP) using images that portray point distributions on a two-dimensional plane. We introduce a novel approach employing multiple specialized agents within the MLLM framework, each dedicated to optimizing solutions for these combinatorial challenges. Our experimental investigation includes rigorous evaluations across zero-shot settings and introduces innovative multi-agent zero-shot in-context scenarios. The results demonstrated that both multi-agent models. Multi-Agent 1, which includes the Initializer, Critic, and Scorer agents, and Multi-Agent 2, which comprises only the Initializer and Critic agents; significantly improved solution quality for TSP and mTSP problems. Multi-Agent 1 excelled in environments requiring detailed route refinement and evaluation, providing a robust framework for sophisticated optimizations. In contrast, Multi-Agent 2, focusing on iterative refinements by the Initializer and Critic, proved effective for rapid decision-making scenarios. These experiments yield promising outcomes, showcasing the robust visual reasoning capabilities of MLLMs in addressing diverse combinatorial problems. The findings underscore the potential of MLLMs as powerful tools in computational optimization, offering insights that could inspire further advancements in this promising field. Project link: https://github.com/ahmed-abdulhuy/Solving-TSP-and-mTSP-Combinatorial-Challenges-using-Visual-Reasoning-and-Multi-Agent-Approach-MLLMs-.git

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑