arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2605.14239cs.CV

通过科莫戈罗夫-阿诺德网络实现超光谱与激光雷达数据的隐式空间频率融合

Implicit spatial-frequency fusion of hyperspectral and lidar data via kolmogorov-arnold networks

School of Information and Communication Technology(信息与通信技术学院);School of Computing, Engineering and Mathematical Sciences(计算、工程与数学科学学院)

Zekun Long, Judy X. Yang, Jing Wang, Ali Zia, Guanyiman Fu, Jun Zhou

AI总结:

本文提出IFGNet,利用可学习的样条函数KANs融合超光谱与激光雷达数据,提升几何感知的空间表示和全局结构模式,实验表明在准确率和Kappa值上优于现有方法。

摘要:

超光谱图像分类在复杂场景中面临光谱模糊、空间异质性和材料属性与几何结构强耦合的挑战。尽管激光雷达提供互补的高程信息,但大多数超光谱-激光雷达融合方法依赖于CNN或MLP,其固定激活函数和线性权重难以建模激光雷达数据中的结构不连续性、超光谱的复杂光谱特征及其相互作用。此外,利用激光雷达引导在空间和频率域融合两种模态仍处于探索阶段。为了解决这些问题,本文提出隐式频率-几何融合网络(IFGNet),利用可学习的样条函数KANs来适应性捕捉超光谱和激光雷达特征之间的高度非线性关系。此外,IFGNet引入了在空间和频率域中基于激光雷达引导的隐式聚合模块,增强几何感知的空间表示,同时捕捉全局结构模式。在休斯顿2013和MUUFL基准测试中,实验表明IFGNet在整体准确率、平均准确率和Cohen's Kappa值上始终优于现有融合方法,同时保持高效的架构。

英文摘要:

Hyperspectral image (HSI) classification is challenging in complex scenes due to spectral ambiguity, spatial heterogeneity, and the strong coupling between material properties and geometric structures. Although LiDAR provides complementary elevation information, most HSI-LiDAR fusion methods rely on CNNs or MLPs with fixed activation functions and linear weights. These methods struggle to model structural discontinuities in LiDAR data, intricate spectral features of HSI, and their interactions. In addition, fusion of the two modalities in both spatial and frequency domains with LiDAR guidance remains underexplored. To address these issues, we propose the Implicit Frequency-Geometry Fusion Network (IFGNet), which leverages Kolmogorov-Arnold Networks (KANs) with learnable spline-based functions to adaptively capture highly nonlinear relationships between hyperspectral and LiDAR features. Furthermore, IFGNet introduces a LiDAR-guided implicit aggregation module in both spatial and frequency domains, enhancing geometry-aware spatial representations while capturing global structural patterns. Experiments on the Houston 2013 and MUUFL benchmarks demonstrate that IFGNet consistently outperforms existing fusion methods in overall accuracy, average accuracy, and Cohen's Kappa, while maintaining an efficient architecture.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑