arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.09320cs.CVcs.AI
收藏

SpaceSense-Bench: 一个大规模多模态基准用于航天器感知与姿态估计

SpaceSense-Bench: A Large-Scale Multi-Modal Benchmark for Spacecraft Perception and Pose Estimation

University of Chinese Academy of Sciences(中国科学院大学);Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences(中国科学院空间利用技术与工程中心);Nanjing University of Aeronautics and Astronautics(南京航空航天大学)

Aodi Wu, Jianhong Zuo, Zeyuan Zhao, Xubo Luo, Ruisuo Wang, Xue Wan

AI总结:

SpaceSense-Bench通过大规模多模态数据集提升航天器感知与姿态估计的鲁棒性与准确性。

摘要:

自主空间操作如在轨服务和主动碎片清除需要鲁棒的部件级语义理解和目标航天器的精确相对导航,但收集大规模真实数据仍因成本和访问限制而不切实际。此外,现有合成数据集还存在目标多样性有限、单模态传感和地面真实标注不完整的问题。我们提出了SpaceSense-Bench,一个大规模多模态基准,包含136个卫星模型,数据量约70GB。每帧提供时间同步的1024×1024 RGB图像、毫米级精度深度图和256束LiDAR点云,以及密集的7类部件级语义标签,同时具有准确的6自由度姿态地面真实标注。该数据集通过Unreal Engine 5构建的高保真空间模拟和全覆盖的数据采集、多阶段质量控制及转换为主流格式的自动化流程生成。我们评估了五个代表性任务(目标检测、2D语义分割、基于RGB-LiDAR融合的3D点云分割、单目深度估计和姿态估计),并得出两个关键发现:(i)感知小规模部件(如推进器和全向天线)和在零样本设置下泛化到完全未见的航天器仍是当前方法的关键瓶颈;(ii)增加训练卫星数量在新型目标上带来显著性能提升,突显了大规模、多样化的数据集对空间感知研究的价值。数据集、代码和工具包可在https://github.com/wuaodi/SpaceSense-Bench公开获取。

英文摘要:

Autonomous space operations such as on-orbit servicing and active debris removal demand robust part-level semantic understanding and precise relative navigation of target spacecraft, yet collecting large-scale real data in orbit remains impractical due to cost and access constraints. Existing synthetic datasets, moreover, suffer from limited target diversity, single-modality sensing, and incomplete ground-truth annotations. We present \textbf{SpaceSense-Bench}, a large-scale multi-modal benchmark for spacecraft perception encompassing 136~satellite models with approximately 70~GB of data. Each frame provides time-synchronized 1024$\times$1024 RGB images, millimeter-precision depth maps, and 256-beam LiDAR point clouds, together with dense 7-class part-level semantic labels at both the pixel and point level as well as accurate 6-DoF pose ground truth. The dataset is generated through a high-fidelity space simulation built in Unreal Engine~5 and a fully automated pipeline covering data acquisition, multi-stage quality control, and conversion to mainstream formats. We benchmark five representative tasks (object detection, 2D semantic segmentation, RGB--LiDAR fusion-based 3D point cloud segmentation, monocular depth estimation, and orientation estimation) and identify two key findings: (i)~perceiving small-scale components (\emph{e.g.}, thrusters and omni-antennas) and generalizing to entirely unseen spacecraft in a zero-shot setting remain critical bottlenecks for current methods, and (ii)~scaling up the number of training satellites yields substantial performance gains on novel targets, underscoring the value of large-scale, diverse datasets for space perception research. The dataset, code, and toolkit are publicly available at https://github.com/wuaodi/SpaceSense-Bench.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑