arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.02438cs.LG
收藏

利用物理信息深度生成模型缓解空间飞行应用中的数据稀缺问题

Mitigating Data Scarcity in Spaceflight Applications for Offline Reinforcement Learning Using Physics-Informed Deep Generative Models

Aerospace Engineering Department, Worcester Polytechnic Institute(沃斯彻斯特理工学院航空航天工程系);Aerospace Engineering Department(航空航天工程系)

Alex E. Ballentine, Nachiket U. Bapat, Raghvendra V. Cowlagi

AI总结:

本文提出基于互信息的分裂变分自编码器(MI-VAE),通过引入物理约束生成符合物理规律的合成数据集,提升空间飞行任务中离线强化学习的性能。

摘要:

强化学习(RL)基于控制器在物理系统中的部署通常受到对现实世界场景的泛化能力差的限制,即仿真到现实(sim-to-real)差距。在航天飞行中,由于成本高和行星探测数据有限,现实世界训练数据稀缺。传统方法如系统识别和合成数据生成依赖于足够的数据,往往因建模假设或缺乏基于物理的约束而失效。本文提出通过在生成模型中引入基于物理的学习偏差来解决数据稀缺问题。具体而言,我们开发了基于互信息的分裂变分自编码器(MI-VAE),一种具有物理约束的变分自编码器,学习观测系统轨迹与基于物理模型预测轨迹之间的差异。MI-VAE的潜在空间能够生成符合物理约束的合成数据集。我们评估了MI-VAE在行星着陆问题上的表现,重点是有限的现实数据和离线RL训练。结果表明,通过MI-VAE生成的数据集显著提高了下游RL性能,在统计保真度、样本多样性及策略成功率方面优于标准VAE。本文展示了一种可扩展的策略,以增强复杂、数据受限环境中的自主控制器鲁棒性。

英文摘要:

The deployment of reinforcement learning (RL)-based controllers on physical systems is often limited by poor generalization to real-world scenarios, known as the simulation-to-reality (sim-to-real) gap. This gap is particularly challenging in spaceflight, where real-world training data are scarce due to high cost and limited planetary exploration data. Traditional approaches, such as system identification and synthetic data generation, depend on sufficient data and often fail due to modeling assumptions or lack of physics-based constraints. We propose addressing this data scarcity by introducing physics-based learning bias in a generative model. Specifically, we develop the Mutual Information-based Split Variational Autoencoder (MI-VAE), a physics-informed VAE that learns differences between observed system trajectories and those predicted by physics-based models. The latent space of the MI-VAE enables generation of synthetic datasets that respect physical constraints. We evaluate MI-VAE on a planetary lander problem, focusing on limited real-world data and offline RL training. Results show that augmenting datasets with MI-VAE samples significantly improves downstream RL performance, outperforming standard VAEs in statistical fidelity, sample diversity, and policy success rate. This work demonstrates a scalable strategy for enhancing autonomous controller robustness in complex, data-constrained environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑