arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.01165cs.CV
收藏

遥感图像多标签分类的深度主动学习

Deep Active Learning for Multi-Label Classification of Remote Sensing Images

Technische Universität Berlin(柏林工业大学);Berlin Institute for the Foundations of Learning and Data(柏林学习与数据基础研究所)

Lars Möllenbrok, Gencer Sumbul, Begüm Demir

AI总结:

本文针对遥感图像多标签分类提出深度主动学习框架,通过结合多标签不确定性与多样性的查询函数,首次系统研究并验证了其在两个基准数据集上能高效选择高信息量样本。

摘要:

本文引入面向遥感(RS)多标签分类(MLC)问题的深度主动学习(AL)。具体而言,我们研究了若干种主动学习查询函数在遥感图像多标签分类中的有效性。与现有的主动学习查询函数(针对单标签分类或语义分割问题定义)不同,本文中的每个查询函数都基于两个准则的评估:i)多标签不确定性;ii)多标签多样性。多标签不确定性准则与深度神经网络(DNNs)在正确为每幅图像分配多标签时的置信度相关。为评估该准则,我们研究了三种策略:i)学习多标签损失排序;ii)测量多标签预测的时间差异;iii)测量近似梯度嵌入的幅度。多标签多样性准则与选择一组彼此尽可能多样化的图像相关,从而防止它们之间的冗余。为评估该准则,我们采用了一种基于聚类的策略。我们将上述每种不确定性策略与基于聚类的多样性策略相结合,得到三种不同的查询函数。所有考虑的查询函数都是首次在遥感多标签分类问题框架中提出。在两个基准档案上获得的实验结果表明,这些查询函数能够在主动学习过程的每次迭代中选择出信息量极高的样本集。

英文摘要:

In this letter, we introduce deep active learning (AL) for multi-label classification (MLC) problems in remote sensing (RS). In particular, we investigate the effectiveness of several AL query functions for MLC of RS images. Unlike the existing AL query functions (which are defined for single-label classification or semantic segmentation problems), each query function in this paper is based on the evaluation of two criteria: i) multi-label uncertainty; and ii) multi-label diversity. The multi-label uncertainty criterion is associated to the confidence of the deep neural networks (DNNs) in correctly assigning multi-labels to each image. To assess this criterion, we investigate three strategies: i) learning multi-label loss ordering; ii) measuring temporal discrepancy of multi-label predictions; and iii) measuring magnitude of approximated gradient embeddings. The multi-label diversity criterion is associated to the selection of a set of images that are as diverse as possible to each other that prevents redundancy among them. To assess this criterion, we exploit a clustering based strategy. We combine each of the above-mentioned uncertainty strategies with the clustering based diversity strategy, resulting in three different query functions. All the considered query functions are introduced for the first time in the framework of MLC problems in RS. Experimental results obtained on two benchmark archives show that these query functions result in the selection of a highly informative set of samples at each iteration of the AL process.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑