arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2605.15326cs.CV

多模态目标检测在稀疏森林冠层遮挡下的应用

Multimodal Object Detection Under Sparse Forest-Canopy Occlusion

Robotics & AI, Johns Hopkins University, USA(约翰霍普金斯大学机器人与人工智能系,美国);Department of Aerospace Engineering, IIT Kanpur(印度理工学院坎浦尔航空航天工程系);Senior Principal Flight Control Engineer, ADASI, EDGE Group, Abu Dhabi, UAE(阿布扎赫尔ADASI高级飞行控制系统工程师,EDGE集团)

Nitik Jain, Mangal Kothari

AI总结:

本文提出一种多模态管道,结合激光雷达、可见-热成像融合和合成孔径成像技术,以提高森林冠层下人类检测的可靠性,展示了改进的YOLOv5检测器在热成像和融合图像上的性能。

摘要:

可靠检测森林冠层下的人类仍是一个远程传感难题,由于遮挡稀疏、结构化且视点依赖。本文提出一个多模态的证明概念管道,整合三种互补方法:(i) 通过植被评估激光雷达回波的实验评估以评估主动传感的可行性;(ii) 使用多尺度变换和稀疏表示框架进行可见-热图像融合以增强人类显著性;(iii) 通过空中光学切片(AOS)合成孔径成像以抑制冠层杂波。在Teledyne FLIR热数据集上微调YOLOv5检测器,并在热图像和融合图像上进行评估。结果表明,测试的地面激光雷达配置对目标级检测的穿透有限,而可见-热融合在低对比度场景中提高了目标可见性,AOS在合成森林图像中增强了地面平面检测。微调的YOLOv5在FLIR前三个类别上实现了平均平均精度约为0.83。这些发现为在森林环境中部署的无人机搜索和救援及监视系统建立了初始基准,并推动了未来专门针对森林数据集和实时多模态整合的工作。

英文摘要:

Reliable detection of humans beneath forest canopy remains a difficult remote-sensing challenge due to sparse, structured, and viewpoint-dependent occlusion. This paper presents a multimodal proof-of-concept pipeline that integrates three complementary approaches: (i) experimental evaluation of LiDAR returns through vegetation to assess the feasibility of active sensing, (ii) visible--thermal image fusion using a multi-scale transform and sparse-representation framework to enhance human saliency, and (iii) synthetic-aperture image formation via Airborne Optical Sectioning (AOS) to suppress canopy clutter. A YOLOv5 detector is fine-tuned on the Teledyne FLIR thermal dataset and evaluated on thermal and fused imagery. Results show that the tested terrestrial LiDAR configuration provides limited penetration for object-level detection, while visible--thermal fusion improves target visibility in low-contrast scenes and AOS enhances ground-plane detection in synthetic forest imagery. The fine-tuned YOLOv5 achieves a mean average precision of $\sim$0.83 on the top three FLIR classes. These findings establish an initial baseline for UAV-deployable search-and-rescue and surveillance systems operating in forested environments, and motivate future work on dedicated forest datasets and real-time multimodal integration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑