arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.05095cs.CVcs.AI
收藏

以大规模预训练推进ALS应用:数据集开发与下游评估

Advancing ALS Applications with Large-Scale Pre-training: Dataset Development and Downstream Assessment

organization= National Institute of Advanced Industrial Science;Technology (AIST) Artificial Intelligence Research Center , city= Tokyo , country= Japan

Haoyi Xiu, Xin Liu, Taehoon Kim, Kyoung-Sook Kim

AI总结:

本文构建覆盖美国本土的大规模ALS点云预训练数据集,提出结合土地覆盖与地形的地理空间采样方法,并通过BEV-MAE验证其可显著提升多项下游任务性能。

摘要:

预训练与微调范式已经革新了卫星遥感应用。然而,对于机载激光扫描(ALS)这种服务于森林管理和城市规划等应用的重要技术,该方法在很大程度上仍未得到充分探索。本研究通过构建大规模ALS点云数据集并评估其对下游应用的影响来弥补这一空白。我们的数据集包含由美国地质调查局三维高程计划提供、覆盖美国本土的ALS点云。为了在高效收集数据的同时捕捉多样的土地覆盖和地形类型,我们提出一种地理空间采样方法,依据土地覆盖图和数字高程模型选择点云切片。作为基线自监督学习模型,我们采用BEV-MAE,这是一种面向3D户外点云的最先进掩码自编码器,并在所构建数据集上对其进行预训练。预训练模型随后被微调用于下游任务,包括树种分类、地形场景识别和点云语义分割。结果表明,预训练模型在所有下游任务上均显著优于从零开始训练的对应模型,证明了从所提数据集学习到的表征具有可迁移性。此外,我们观察到,使用该地理空间采样方法扩展数据集能够持续提升性能,而在以随机采样构建的数据集上进行预训练则无法取得类似改进。这些发现凸显了所构建数据集的实用性,以及我们的采样策略在预训练与微调范式中的有效性。源代码和预训练模型将公开发布于https://github.com/martianxiu/ALS_pretraining。

英文摘要:

The pre-training and fine-tuning paradigm has revolutionized satellite remote sensing applications. However, this approach remains largely underexplored for airborne laser scanning (ALS), an important technology for applications such as forest management and urban planning. In this study, we address this gap by constructing a large-scale ALS point cloud dataset and evaluating its impact on downstream applications. Our dataset comprises ALS point clouds collected across the contiguous United States, provided by the United States Geological Survey's 3D Elevation Program. To ensure efficient data collection while capturing diverse land cover and terrain types, we introduce a geospatial sampling method that selects point cloud tiles based on land cover maps and digital elevation models. As a baseline self-supervised learning model, we adopt BEV-MAE, a state-of-the-art masked autoencoder for 3D outdoor point clouds, and pre-train it on the constructed dataset. The pre-trained models are subsequently fine-tuned for downstream tasks, including tree species classification, terrain scene recognition, and point cloud semantic segmentation. Our results show that the pre-trained models significantly outperform their scratch counterparts across all downstream tasks, demonstrating the transferability of the representations learned from the proposed dataset. Furthermore, we observe that scaling the dataset using our geospatial sampling method consistently enhances performance, whereas pre-training on datasets constructed with random sampling fails to achieve similar improvements. These findings highlight the utility of the constructed dataset and the effectiveness of our sampling strategy in the pre-training and fine-tuning paradigm. The source code and pre-trained models will be made publicly available at \url{https://github.com/martianxiu/ALS_pretraining}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑