Large language model advancements have enabled the development of multi-agent frameworks to tackle complex, real-world problems such as to automate tasks that require interactions with diverse tools, reasoning, and human collaboration. We present MARCO, a Multi-Agent Real-time Chat Orchestration framework for automating tasks using LLMs. MARCO addresses key challenges in utilizing LLMs for complex, multi-step task execution. It incorporates robust guardrails to steer LLM behavior, validate outputs, and recover from errors that stem from inconsistent output formatting, function and parameter hallucination, and lack of domain knowledge. Through extensive experiments we demonstrate MARCO's superior performance with 94.48% and 92.74% accuracy on task execution for Digital Restaurant Service Platform conversations and Retail conversations datasets respectively along with 44.91% improved latency and 33.71% cost reduction. We also report effects of guardrails in performance gain along with comparisons of various LLM models, both open-source and proprietary. The modular and generic design of MARCO allows it to be adapted for automating tasks across domains and to execute complex usecases through multi-turn interactions.
From Single Chatbots to Governed Agent Ecosystems: An Agentic AI Pattern Catalogue and Orchestration Framework for Mission-Critical Hospital Information Management Systems
Multi-Agent Collaboration via Evolving Orchestration
Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);Beijing University of Posts and Telecommunications(北京邮电大学);Siemens(西门子);Tencent Robotics X(腾讯机器人研究院)
Multi-Agent Collaboration via Cross-Team Orchestration
State Key Lab of CAD & CG(CAD与CG国家重点实验室);Zhejiang Polytechnic Institute(浙江工业大学);Polytechnic Institute, Zhejiang University(浙江大学 polytechnic 院);Shanghai Jiao Tong University(上海交通大学);King’s College London(伦敦国王学院);Tsinghua University(清华大学);Beijing University of Posts and Telecommunications(北京邮电大学);Tencent Robotics X(腾讯机器人科技)
Beyond Scene Description: Multi-Agent Orchestration for Non-visual Access to Virtual Worlds
AI Center, Faculty of Computer and Information Systems, Islamic University of Madinah(麦地那伊斯兰大学计算机与信息系统学院AI中心);AI V&V Lab, King Fahd University of Petroleum and Minerals(法赫德国王石油矿产大学AI验证与确认实验室);Faculty of Computing and Information Technology, University of the Punjab(旁遮普大学计算与信息技术学院)
LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Robotics
Automation and Control Institute, Faculty of Electrical Engineering, TU Wien(自动化与控制研究所,电气工程学院,维也纳技术大学);AIT Austrian Institute of Technology GmbH, Center for Vision, Automation and Control(奥地利技术研究所(AIT)有限公司,视觉、自动化与控制中心)