云计算平台中基于深度学习的多源影像融合
Multi-source imagery fusion using deep learning in a cloud computing platform
AI总结:
本文提出基于Hadoop和Spark的遥感大数据云平台,并研究最优块大小以提升数据传输效率,同时开发基于LSTM的多光谱与高光谱影像融合超分辨率方法,在实验中取得高结构相似性指数。
摘要:
鉴于不同遥感仪器采集的数据具有高可用性,多光谱与高光谱图像(HSI)的数据融合是遥感领域的一个重要课题。特别是,超分辨率作为一种利用空间域和光谱域的数据融合应用受到了广泛研究,因为其融合图像可用于提高分类和目标跟踪的精度。另一方面,遥感仪器获取的海量数据在数据存储、管理和预处理方面是一个关键问题。本文提出了一种基于Hadoop和Spark的大数据云平台,用于存储、管理和处理遥感数据。同时,针对从Hadoop向Spark应用下载影像数据时参数“块大小(chunk size)”的取值进行了研究,并根据我们的数据格式给出了该参数的合适取值建议。我们还开发了一种基于长短期记忆(Long Short Term Memory)的替代方法,该方法使用不同图像块尺寸进行训练,用于超分辨率图像重建。该方法融合了高光谱图像和多光谱图像。结果,我们获得了具有高空间分辨率和高光谱分辨率的图像。实验结果表明,当块大小为64k时,从Hadoop向Spark应用下载数据平均需要3.5秒。所提出的超分辨率模型在所用数据集上提供了0.98和0.907的结构相似性指数。
英文摘要:
Given the high availability of data collected by different remote sensing instruments, the data fusion of multi-spectral and hyperspectral images (HSI) is an important topic in remote sensing. In particular, super-resolution as a data fusion application using spatial and spectral domains is highly investigated because its fused images is used to improve the classification and tracking objects accuracy. On the other hand, the huge amount of data obtained by remote sensing instruments represent a key concern in terms of data storage, management and pre-processing. This paper proposes a Big Data Cloud platform using Hadoop and Spark to store, manages, and process remote sensing data. Also, a study over the parameter \textit{chunk size} is presented to suggest the appropriate value for this parameter to download imagery data from Hadoop into a Spark application, based on the format of our data. We also developed an alternative approach based on Long Short Term Memory trained with different patch sizes for super-resolution image. This approach fuse hyperspectral and multispectral images. As a result, we obtain images with high-spatial and high-spectral resolution. The experimental results show that for a chunk size of 64k, an average of 3.5s was required to download data from Hadoop into a Spark application. The proposed model for super-resolution provides a structural similarity index of 0.98 and 0.907 for the used dataset.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。