arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.07803cs.CV
收藏

多模态遥感图像的半监督流形对齐

Semisupervised Manifold Alignment of Multimodal Remote Sensing Images

Ecole Polytechnique Fédérale de Lausanne (EPFL)(洛桑联邦理工学院);Université de Lausanne(洛桑大学);University of Edinburgh(爱丁堡大学);Universitat de València(瓦伦西亚大学)

Devis Tuia, Michele Volpi, Maxime Trolliet, Gustau Camps-Valls

摘要:

我们介绍了一种方法流形对齐的不同模态(或域)的遥感图像。这个问题是经常性的,当一组多时间,多分辨率,多传感器和多角度的图像是可用的。在这些情况下,理想情况下,图像应该在空间上配准,校正和补偿图像域中的差异。这样的程序需要用户的交互,涉及许多参数和算法的调整,并且通常单独应用。传感器和采集条件的变化转化为图像分布(或流形)的移位、扭曲、扭曲和折叠。所提出的半监督流形对齐(SS-MA)方法直接在其流形上对齐图像,因此不限于相同分辨率的图像,无论是光谱还是空间。SS-MA将同一类的样本拉近,同时将不同类的样本分开。同时,它保留了每个流形沿变换的几何形状。该方法建立了一个线性可逆变换的潜在空间,所有的图像是一样的,并减少到解决一个广义特征值问题的中等大小。我们研究的性能SS-MA在玩具的例子,并在真正的多角度,多时间,和multisbrands图像分类问题。该方法对于强变形表现良好,并对所有域进行准确分类。

英文摘要:

We introduce a method for manifold alignment of different modalities (or domains) of remote sensing images. The problem is recurrent when a set of multitemporal, multisource, multisensor and multiangular images is available. In these situations, images should ideally be spatially coregistred, corrected and compensated for differences in the image domains. Such procedures require the interaction of the user, involve tuning of many parameters and heuristics, and are usually applied separately. Changes of sensors and acquisition conditions translate into shifts, twists, warps and foldings of the image distributions (or manifolds). The proposed semisupervised manifold alignment (SS-MA) method aligns the images working directly on their manifolds, and is thus not restricted to images of the same resolutions, either spectral or spatial. SS-MA pulls close together samples of the same class while pushing those of different classes apart. At the same time, it preserves the geometry of each manifold along the transformation. The method builds a linear invertible transformation to a latent space where all images are alike, and reduces to solving a generalized eigenproblem of moderate size. We study the performance of SS-MA in toy examples and in real multiangular, multitemporal, and multisource image classification problems. The method performs well for strong deformations and leads to accurate classification for all domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑