arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.08686cs.CV
收藏

基于不确定性的多任务金字塔视觉Transformer的无人机目标重识别

Uncertainty Aware Multitask Pyramid Vision Transformer For UAV-Based Object Re-Identification

West Virginia University(西弗吉尼亚大学);State University of New York at Buffalo(纽约州立大学布法罗分校)

Syeda Nyma Ferdous, Xin Li, Siwei Lyu

摘要:

目标再识别(ReID)是生物特征识别和监控系统中最重要的问题之一,在过去的几十年里,已经被图像处理和计算机视觉界广泛研究。学习一个强大的和有区别的特征表示是对象ReID的一个关键挑战。在基于无人机(UAV)的ReID中,该问题甚至更具挑战性,因为图像的特征在于连续变化的相机参数(例如,视角、高度等)一架无人机为了应对这一挑战,多尺度特征表示已被认为是表征从无人机在不同高度飞行捕获的图像。在这项工作中,我们提出了一种多任务学习方法,它采用了一种新的多尺度架构,没有卷积,金字塔视觉Transformer(PVT),作为骨干无人机为基础的对象ReID。通过对类内变化的不确定性建模,我们提出的模型可以使用不确定性感知的对象ID和相机ID信息进行联合优化。在两个来自空中监视的ReID数据集PRAI和VRAI上的实验结果验证了我们提出的方法的有效性

英文摘要:

Object Re-IDentification (ReID), one of the most significant problems in biometrics and surveillance systems, has been extensively studied by image processing and computer vision communities in the past decades. Learning a robust and discriminative feature representation is a crucial challenge for object ReID. The problem is even more challenging in ReID based on Unmanned Aerial Vehicle (UAV) as the images are characterized by continuously varying camera parameters (e.g., view angle, altitude, etc.) of a flying drone. To address this challenge, multiscale feature representation has been considered to characterize images captured from UAV flying at different altitudes. In this work, we propose a multitask learning approach, which employs a new multiscale architecture without convolution, Pyramid Vision Transformer (PVT), as the backbone for UAV-based object ReID. By uncertainty modeling of intraclass variations, our proposed model can be jointly optimized using both uncertainty-aware object ID and camera ID information. Experimental results are reported on PRAI and VRAI, two ReID data sets from aerial surveillance, to verify the effectiveness of our proposed approach

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑