arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.09852cs.ROcs.LGcs.MA

通过短期分布式优化与长期强化学习实现无人机的策略协同

Strategic Coordination of Drones via Short-term Distributed Optimization and Long-term Reinforcement Learning

School of Computer Science, University of Leeds(利兹大学计算机科学学院)

Chuhao Qin, Evangelos Pournaras

AI总结:

针对大规模动态环境中无人机群自主任务分配的NP难问题,提出融合长期DRL与短期集体学习的混合优化方法,解决现有方案适应性、复杂度等局限,实验性能提升显著,实现高效交通监控。

摘要:

本文针对大规模动态时空环境中自主交互无人机群的自主任务分配问题展开研究。当每架无人机独立确定导航、感知和充电选项以满足系统级感知需求时,集体决策成为NP难的去中心化组合优化问题。现有解决方案存在显著局限:集体学习等分布式优化方法往往缺乏长期适应性,而集中式深度强化学习(DRL)则面临计算复杂度高、可扩展性差及隐私问题。为克服这些挑战,我们提出一种融合长期DRL与短期集体学习的新型混合优化方法。该方法中,每架无人机利用DRL主动确定飞行方向、充电行为等高层策略,同时借助集体学习以去中心化方式协同短期感知与导航任务。基于真实城市移动性数据集的大量实验表明,所提方案分别比独立的最先进集体学习和DRL方法性能提升27.83%和23.17%。我们的研究结果凸显了短期与长期决策的互补优势,可通过无人机群实现节能、精准且可持续的交通监控。

英文摘要:

This paper addresses the problem of autonomous task allocation by a swarm of autonomous, interactive drones in large-scale, dynamic spatio-temporal environments. When each drone independently determines navigation, sensing, and recharging options to choose from such that system-wide sensing requirements are met, the collective decision-making becomes an NP-hard decentralized combinatorial optimization problem. Existing solutions face significant limitations: distributed optimization methods such as collective learning often lack long-term adaptability, while centralized deep reinforcement learning (DRL) suffers from high computational complexity, scalability and privacy concerns. To overcome these challenges, we propose a novel hybrid optimization approach that combines long-term DRL with short-term collective learning. In this approach, each drone uses DRL methods to proactively determine high-level strategies, such as flight direction and recharging behavior, while leveraging collective learning to coordinate short-term sensing and navigation tasks with other drones in a decentralized manner. Extensive experiments using datasets derived from realistic urban mobility demonstrate that the proposed solution outperforms standalone state-of-the-art collective learning and DRL approaches by $27.83\%$ and $23.17\%$ respectively. Our findings highlight the complementary strengths of short-term and long-term decision-making, enabling energy-efficient, accurate, and sustainable traffic monitoring through swarms of drones.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑