We introduce a novel framework for automatic behavior tree (BT) construction in heterogeneous multi-robot systems, designed to address the challenges of adaptability and robustness in dynamic environments. Traditional robots are limited by fixed functional attributes and cannot efficiently reconfigure their strategies in response to task failures or environmental changes. To overcome this limitation, we leverage large language models (LLMs) to generate and extend BTs dynamically, combining the reasoning and generalization power of LLMs with the modularity and recovery capability of BTs. The proposed framework consists of four interconnected modules task initialization, task assignment, BT update, and failure node detection which operate in a closed loop. Robots tick their BTs during execution, and upon encountering a failure node, they can either extend the tree locally or invoke a centralized virtual coordinator (Alex) to reassign subtasks and synchronize BTs across peers. This design enables long-term cooperative execution in heterogeneous teams. We validate the framework on 60 tasks across three simulated scenarios and in a real-world cafe environment with a robotic arm and a wheeled-legged robot. Results show that our method consistently outperforms baseline approaches in task success rate, robustness, and scalability, demonstrating its effectiveness for multi-robot collaboration in complex scenarios.
MOSAIC: Modular Scalable Autonomy for Intelligent Coordination of Heterogeneous Robotic Teams
FZI Forschungszentrum für Informatik, Karlsruhe, Germany(弗赖堡信息研究中心,卡尔斯鲁厄,德国);Robotic Systems Lab (RSL), ETH Zürich, Zürich, Switzerland(机器人系统实验室(RSL),苏黎世联邦理工学院,苏黎世,瑞士);Machine Intelligence and Robotics Lab (MaiRo), Karlsruhe Institute for Technology (KIT), Karlsruhe, Germany(机器智能与机器人实验室(MaiRo),卡尔斯鲁厄技术学院(KIT),卡尔斯鲁厄,德国);European Space Agency (ESA), Noordwijk, Netherlands(欧洲航天局(ESA),诺德威克,荷兰)
Decentralised Intelligence, Surveillance, and Reconnaissance in Unknown Environments with Heterogeneous Multi-Robot Systems
University of Technology Sydney(悉尼科技大学);Defence Science and Technology Group, Department of Defence(国防部国防科学与技术集团);Mission Systems Pty. Ltd.(任务系统私人有限公司)
Structured interactions improve distributed coordination beyond model scaling in a real-world multi-robot system
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,自动化研究所,中国科学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院);Department of Automation, Tsinghua University(清华大学自动化系);Liupanshan Laboratory, Ningxia University(宁夏大学鲁班实验室)
Cooperative constrained motion coordination of networked heterogeneous vehicles
Eindhoven University of Technology(埃因霍温理工大学);Eindhoven Artificial Intelligence Systems Institute(埃因霍温人工智能系统研究所);Lund University(隆德大学);The Australian National University(澳大利亚国立大学)
Safety-Aware Optimal Scheduling for Autonomous Masonry Construction using Collaborative Heterogeneous Aerial Robots
Robotics and Artificial Intelligence Group, Department of Computer, Electrical and Space Engineering, Luleå University of Technology(机器人与人工智能组,计算机、电气与空间工程系,卢勒奥技术大学)
CoordField: Coordination Field for Agentic UAV Task Allocation In Low-altitude Urban Scenarios
Department of Engineering Science, Faculty of Innovation Engineering, Macau University of Science and Technology(工程科学系,创新工程学院,澳门科学技术大学);State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,自动化研究所,中国科学院);Doctoral School of Applied Informatics and Applied Mathematics, Óbuda University(应用信息与应用数学博士学院,奥布达大学);School of Artificial Intelligence, Anhui University(人工智能学院,安徽大学);State Key Laboratory for Management and Control of Complex Systems(复杂系统管理与控制国家重点实验室)
Learning and planning for optimal synergistic human-robot coordination in manufacturing contexts
Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, National Research Council of Italy(意大利国家研究委员会智能工业技术与先进制造研究所);Politecnico di Milano(米兰理工大学);Politecnico di Torino(都灵理工大学)