arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.17443cs.RO
收藏

卫星追踪者:分歧对抗强化学习用于轨道上的智能对抗

Satellite Chasers: Divergent Adversarial Reinforcement Learning to Engage Intelligent Adversaries on Orbit

Sibley School of Mechanical and Aerospace Engineering(锡比利机械与航空航天工程学院)

Cameron Mehlman, Gregory Falco

AI总结:

本文提出DARL方法,通过双重阶段多智能体强化学习训练卫星对抗策略,验证了其在对抗性多智能体空间环境中的鲁棒性。

摘要:

随着空间日益拥挤和竞争加剧,多智能体环境中的鲁棒自主能力变得至关重要。当前空间自主系统主要依赖基于优化的路径规划或远程轨道机动,但在敌对场景中,其中一颗卫星主动追逐另一颗时尚未证明有效。我们引入了分歧对抗强化学习(DARL),一种双阶段多智能体强化学习(MARL)方法,旨在训练卫星与多个对抗航天器互动时的自主规避策略。我们的方法通过促进多样化的对抗策略来增强训练期间的探索,从而产生更加稳健和适应性强的逃避模型。我们通过猫鼠卫星场景验证DARL,该场景建模为一个部分可观测的多智能体捕获旗帜游戏,其中两个对抗性“猫”航天器追逐一个“鼠”逃避者。DARL的性能与包括基于优化的卫星路径规划器在内的几个基准进行比较,证明了其在对抗性多智能体空间环境中的能力。

英文摘要:

As space becomes increasingly crowded and contested, robust autonomous capabilities for multi-agent environments are gaining critical importance. Current autonomous systems in space primarily rely on optimization-based path planning or long-range orbital maneuvers, which have not yet proven effective in adversarial scenarios where one satellite is actively pursuing another. We introduce Divergent Adversarial Reinforcement Learning (DARL), a two-stage Multi-Agent Reinforcement Learning (MARL) approach designed to train autonomous evasion strategies for satellites engaged with multiple adversarial spacecraft. Our method enhances exploration during training by promoting diverse adversarial strategies, leading to more robust and adaptable evader models. We validate DARL through a cat-and-mouse satellite scenario, modeled as a partially observable multi-agent capture the flag game where two adversarial ``cat" spacecraft pursue a single ``mouse" evader. DARL's performance is compared against several benchmarks, including an optimization-based satellite path planner, demonstrating its ability to produce highly robust models for adversarial multi-agent space environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑