高分辨率SAR图像中定向输电塔检测的提示学习
Prompt Learning for Oriented Power Transmission Tower Detection in High-Resolution SAR Images
AI总结:
本文针对高分辨率SAR图像中输电塔检测易受背景杂波干扰的问题,提出引入提示学习的定向目标检测器P2Det,通过稀疏提示编码、双向融合和形状自适应细化实现多模态特征交互,有效提升了检测性能。
摘要:
从合成孔径雷达(SAR)图像中检测输电塔仍然是一项具有挑战性的任务,因为输电塔尺寸相对较小且存在侧视几何效应,背景杂波干扰经常阻碍塔体的识别。大量干扰信号叠加在来自塔体的回波信号上。我们发现,对输电塔的位置进行定位或提示有助于解决这一障碍。基于这一发现,本文将提示学习引入定向目标检测器(P2Det),用于多模态信息学习。P2Det包含稀疏提示编码和多模态数据之间的交叉注意力。具体而言,提出了稀疏提示编码器(SPE)来表示点位置,将提示转换为稀疏嵌入。图像嵌入通过Transformer层生成。然后提出了双向融合模块(TWFM)来计算两种不同嵌入之间的交叉注意力。利用图像级特征和提示级特征的交互来应对杂波干扰。提出了形状自适应细化模块(SARM)以降低长宽比的影响。大量实验证明了所提模型在高分辨率SAR图像上的有效性。P2Det凭借其具有竞争力的性能,为多模态目标检测提供了新的见解。
英文摘要:
Detecting transmission towers from synthetic aperture radar (SAR) images remains a challenging task due to the comparatively small size and side-looking geometry, with background clutter interference frequently hindering tower identification. A large number of interfering signals superimposes the return signal from the tower. We found that localizing or prompting positions of power transmission towers is beneficial to address this obstacle. Based on this revelation, this paper introduces prompt learning into the oriented object detector (P2Det) for multimodal information learning. P2Det contains the sparse prompt coding and cross-attention between the multimodal data. Specifically, the sparse prompt encoder (SPE) is proposed to represent point locations, converting prompts into sparse embeddings. The image embeddings are generated through the Transformer layers. Then a two-way fusion module (TWFM) is proposed to calculate the cross-attention of the two different embeddings. The interaction of image-level and prompt-level features is utilized to address the clutter interference. A shape-adaptive refinement module (SARM) is proposed to reduce the effect of aspect ratio. Extensive experiments demonstrated the effectiveness of the proposed model on high-resolution SAR images. P2Det provides a novel insight for multimodal object detection due to its competitive performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。