arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09907cs.CV
收藏

面向分割任务的地球观测基础模型快速适配

Rapid Adaptation of Earth Observation Foundation Models for Segmentation

University of Luxembourg(卢森堡大学);Universidad de Antioquia(安蒂奥基亚大学);University of Oxford(牛津大学)

Karthick Panner Selvam, Raul Ramos-Pollan, Freddie Kalaitzis

AI总结:

本研究将低秩适配(LoRA)用于微调地球观测基础模型以实现洪水分割,在提升分割精度的同时大幅降低计算成本,优于全量微调且分布外泛化性更好,为灾害管理快速响应提供高效方案。

摘要:

本研究探究了低秩适配(Low-Rank Adaptation, LoRA)在微调地球观测(Earth Observation, EO)基础模型以完成洪水分割任务时的效能。我们提出假设:LoRA作为一种参数高效技术,能够在保持高性能的同时,显著加速大规模EO模型适配这一关键任务的速度。我们将LoRA应用于微调一款在多类卫星影像上预训练的先进EO基础模型,使用经整理的洪水事件数据集开展训练。结果表明,基于LoRA的微调(秩r=256)相比冻结编码器的基线模型,F1分数提升6.66个点,交并比(IoU)提升0.11,同时大幅降低了计算成本。值得注意的是,LoRA的表现优于全量微调,后者在我们的硬件上计算上不可行。我们进一步通过在地理上不同的洪水事件进行分布外(out-of-distribution, OOD)测试评估了泛化能力,LoRA配置的OOD表现优于基线模型。本研究为基础模型适配专业EO任务的高效适配研究做出贡献,对灾害管理中的快速响应系统具有启示。研究结果表明,LoRA有望在资源受限、时间紧迫的场景中,推动准确的洪水分割模型更快部署。

英文摘要:

This study investigates the efficacy of Low-Rank Adaptation (LoRA) in fine-tuning Earth Observation (EO) foundation models for flood segmentation. We hypothesize that LoRA, a parameter-efficient technique, can significantly accelerate the adaptation of large-scale EO models to this critical task while maintaining high performance. We apply LoRA to fine-tune a state-of-the-art EO foundation model pre-trained on diverse satellite imagery, using a curated dataset of flood events. Our results demonstrate that LoRA-based fine-tuning (r-256) improves F1 score by 6.66 points and IoU by 0.11 compared to a frozen encoder baseline, while significantly reducing computational costs. Notably, LoRA outperforms full fine-tuning, which proves computationally infeasible on our hardware. We further assess generalization through out-of-distribution (OOD) testing on a geographically distinct flood event. While LoRA configurations show improved OOD performance over the baseline. This work contributes to research on efficient adaptation of foundation models for specialized EO tasks, with implications for rapid response systems in disaster management. Our findings demonstrate LoRA's potential for enabling faster deployment of accurate flood segmentation models in resource-constrained, time-critical scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑