To achieve global coverage and ubiquitous connectivity, the non-terrestrial network (NTN) has been regarded as a key enabler in the sixth generation (6G) network, which includes uncrewed aerial vehicles (UAVs), high-altitude platforms (HAPs), and satellites. Since the unique characteristics of various NTN platforms strongly affect their implementation and lead to a highly dynamic and heterogeneous NTN scenario, achieving distributed coordination remains an important research direction. However, the explicit and systematic analysis of the individual layers' challenges and corresponding distributed coordination solutions in heterogeneous NTNs has not been proposed yet. Therefore, in this paper, we summarize the unique characteristics of each NTN platform, identify communication challenges within individual layers, and propose potential delay-tolerant or delay-sensitive coordinated solutions accordingly. We further analyse the feasibility of leveraging multi-agent deep reinforcement learning (MADRL) algorithms to achieve the proposed coordinated solutions. Finally, we present a case study of the joint scheduling and trajectory optimization problem in heterogeneous NTN, where a two-timescale multi-agent deep deterministic policy gradient (TTS-MADDPG) algorithm is developed to validate the effectiveness of distributed coordination.
Cooperative constrained motion coordination of networked heterogeneous vehicles
Eindhoven University of Technology(埃因霍温理工大学);Eindhoven Artificial Intelligence Systems Institute(埃因霍温人工智能系统研究所);Lund University(隆德大学);The Australian National University(澳大利亚国立大学)
Sensor-Driven Mission Synthesis for UAV/UGV Swarms: A TB-CSPN Coordination Architecture with Hardware-Enforced Safety
Institute for Software Technology, University of the Bundeswehr Munich(慕尼黑联邦国防军大学软件技术研究所);Department of Computer Science, Sapienza University of Rome(罗马大学计算机科学系);SofTware And Knowledge Engineering Lab(软件与知识工程实验室)