arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.02479cs.CVcs.AI

通过掩码条件生成式AI生成卫星图像数据用于野火检测

Generating Satellite Imagery Data for Wildfire Detection through Mask-Conditioned Generative AI

Department of Intelligent Systems and Robotics, University of West Florida(西佛罗里达大学智能系统与机器人系);IHMC(人类与机器认知研究所)

Valeria Martin, K. Brent Venable, Derek Morgan

AI总结:

本文探讨了基于地球观测扩散模型EarthSynth生成野火后Sentinel-2 RGB图像的可能性,通过不同实验配置评估生成效果,发现修补生成优于全图生成,且VLM辅助修补与手工提示效果相当。

摘要:

标记不足的卫星图像仍是深度学习基于野火监测系统的根本瓶颈。本文研究了基于地球观测扩散模型EarthSynth能否在不进行特定任务再训练的情况下,根据现有烧毁掩码生成真实的野火后Sentinel-2 RGB图像。使用CalFireSeg-50数据集衍生的烧毁掩码,我们设计并评估了六个受控实验配置,系统地变化:(i) 管道架构(仅掩码全生成 vs. 修补带预火上下文)、(ii) 提示工程策略(三个手工提示和一个Qwen2-VL生成提示)、(iii) 区域-wise颜色匹配后处理步骤。定量评估在10个分层测试样本上使用四个互补指标:Burn IoU,烧毁区域颜色距离(ΔC_burn),黑暗对比度,和光谱合理性。结果表明,修补生成在所有指标上均优于全图生成,结构化修补提示在空间对齐(Burn IoU = 0.456)和烧毁显著性(Darkness Contrast = 20.44)方面表现最佳,而颜色匹配产生最低的颜色距离(ΔC_burn = 63.22)但牺牲了烧毁显著性。VLM辅助修补与手工提示效果相当。这些发现为将生成式数据增强纳入野火检测流程提供了基础。代码和实验可在:https://www.kaggle.com/code/valeriamartinh/genai-all-runned 获取。

英文摘要:

The scarcity of labeled satellite imagery remains a fundamental bottleneck for deep-learning (DL)-based wildfire monitoring systems. This paper investigates whether a diffusion-based foundation model for Earth Observation (EO), EarthSynth, can synthesize realistic post-wildfire Sentinel-2 RGB imagery conditioned on existing burn masks, without task-specific retraining. Using burn masks derived from the CalFireSeg-50 dataset (Martin et al., 2025), we design and evaluate six controlled experimental configurations that systematically vary: (i) pipeline architecture (mask-only full generation vs. inpainting with pre-fire context), (ii) prompt engineering strategy (three hand-crafted prompts and a VLM-generated prompt via Qwen2-VL), and (iii) a region-wise color-matching post-processing step. Quantitative assessment on 10 stratified test samples uses four complementary metrics: Burn IoU, burn-region color distance (ΔC_burn), Darkness Contrast, and Spectral Plausibility. Results show that inpainting-based pipelines consistently outperform full-tile generation across all metrics, with the structured inpainting prompt achieving the best spatial alignment (Burn IoU = 0.456) and burn saliency (Darkness Contrast = 20.44), while color matching produces the lowest color distance (ΔC_burn = 63.22) at the cost of reduced burn saliency. VLM-assisted inpainting is competitive with hand-crafted prompts. These findings provide a foundation for incorporating generative data augmentation into wildfire detection pipelines. Code and experiments are available at: https://www.kaggle.com/code/valeriamartinh/genai-all-runned

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑