arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.08116cs.CVcs.LG

基于扩散的数据增强与使用生成软标签的知识蒸馏:解决SAR溢油分割的数据稀缺问题

Diffusion-based Data Augmentation and Knowledge Distillation with Generated Soft Labels Solving Data Scarcity Problems of SAR Oil Spill Segmentation

Korea Advanced Institute of Science and Technology(韩国科学技术院);Kyungpook National University(庆北国立大学)

Jaeho Moon, Jeonghwan Yun, Jaehyun Kim, Jaehyup Lee, Munchurl Kim

AI总结:

针对SAR溢油分割标注稀缺问题,提出DAKTer扩散增强策略,联合生成SAR图像与对齐软标签并引入SNR平衡因子,显著提升多种分割模型性能。

摘要:

溢油会带来严重的环境风险,因此早期检测对于有效响应和缓解至关重要。由于合成孔径雷达(Synthetic Aperture Radar,SAR)图像可在全天候条件下工作,基于SAR的溢油分割能够实现快速且稳健的监测。然而,在使用深度学习模型时,SAR溢油分割往往因标注数据稀缺而难以训练。为解决这一局限,我们提出了一种基于扩散并结合知识迁移的数据增强策略(diffusion-based data augmentation with knowledge transfer,DAKTer)。我们的DAKTer策略使扩散模型能够生成SAR溢油图像以及软标签对;与分割掩码(即硬标签)相比,软标签可提供更丰富的类别概率分布。此外,为了可靠地联合生成高质量SAR图像和良好对齐的软标签,我们引入了一个基于SNR的平衡因子,用于对齐扩散模型中两种模态的噪声破坏过程。利用生成的SAR图像和软标签,学生分割模型无需经过相同任务训练的教师模型即可学习稳健的特征表示,从而提升其分割溢油区域的能力。大量实验表明,我们的DAKTer策略能够有效地将逐像素类别概率知识迁移给学生分割模型,使其在SAR图像中区分溢油区域与其他相似区域。与其他生成式数据增强方法相比,我们的DAKTer策略可推动多种分割模型以大幅优势取得更优性能。

英文摘要:

Oil spills pose severe environmental risks, making early detection crucial for effective response and mitigation. As Synthetic Aperture Radar (SAR) images operate under all-weather conditions, SAR-based oil spill segmentation enables fast and robust monitoring. However, when using deep learning models, SAR oil spill segmentation often struggles in training due to the scarcity of labeled data. To address this limitation, we propose a diffusion-based data augmentation with knowledge transfer (DAKTer) strategy. Our DAKTer strategy enables a diffusion model to generate SAR oil spill images along with soft label pairs, which offer richer class probability distributions than segmentation masks (i.e. hard labels). Also, for reliable joint generation of high-quality SAR images and well-aligned soft labels, we introduce an SNR-based balancing factor aligning the noise corruption process of both modalilties in diffusion models. By leveraging the generated SAR images and soft labels, a student segmentation model can learn robust feature representations without teacher models trained for the same task, improving its ability to segment oil spill regions. Extensive experiments demonstrate that our DAKTer strategy effectively transfers the knowledge of per-pixel class probabilities to the student segmentation model to distinguish the oil spill regions from other look-alike regions in the SAR images. Our DAKTer strategy boosts various segmentation models to achieve superior performance with large margins compared to other generative data augmentation methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑