In recent years, deep learning-based visual object trackers have achieved state-of-the-art performance on several visual object tracking benchmarks. However, most tracking benchmarks are focused on ground level videos, whereas aerial tracking presents a new set of challenges. In this paper, we compare ten trackers based on deep learning techniques on four aerial datasets. We choose top performing trackers utilizing different approaches, specifically tracking by detection, discriminative correlation filters, Siamese networks and reinforcement learning. In our experiments, we use a subset of OTB2015 dataset with aerial style videos; the UAV123 dataset without synthetic sequences; the UAV20L dataset, which contains 20 long sequences; and DTB70 dataset as our benchmark datasets. We compare the advantages and disadvantages of different trackers in different tracking situations encountered in aerial data. Our findings indicate that the trackers perform significantly worse in aerial datasets compared to standard ground level videos. We attribute this effect to smaller target size, camera motion, significant camera rotation with respect to the target, out of view movement, and clutter in the form of occlusions or similar looking distractors near tracked object.
Towards Real-World Aerial Vision Guidance with Categorical 6D Pose Tracker
Hunan University(湖南大学);National Engineering Research Centre for Robot Visual Perception and Control(国家机器人视觉感知与控制技术工程研究中心);Nanyang Technological University(南洋理工大学)
Microsoft AI for Good Lab(微软人工智能公益实验室);Center for Research and Formation in Artificial Intelligence (Cinfonia), Universidad de los Andes(安第斯大学人工智能研究与培训中心);Conservation X Labs(保护X实验室);Kirk Larsen Consulting(Kirk Larsen咨询公司);Tanzania Wildlife Research Institute(坦桑尼亚野生动物研究所);Alaska Department of Fish and Game(阿拉斯加渔猎局)
Multimodal Mathematical Reasoning Embedded in Aerial Vehicle Imagery: Benchmarking, Analysis, and Exploration
Department of Physics, J.K. Institute of Science(J.K.科学研究院物理系);World Scientific University(世界科学大学);University of Intelligent Studies(智能研究大学);East China Normal University(华东师范大学);Nanyang Technological University(南洋理工大学);SenseTime Research(商汤科技研究院);Shanghai Jiao Tong University(上海交通大学);Harbin Institute of Technology(哈尔滨工业大学)
Tracking in Aerial Hyperspectral Videos using Deep Kernelized Correlation Filters
Rochester Institute of Technology(罗切斯特理工学院);Chester F. Carlson Center for Imaging Science(切斯特·F·卡尔森成像科学中心);School of Mathematical Sciences, Rochester Institute of Technology(罗切斯特理工学院数学科学学院)
Danish Airs and Grounds: A Dataset for Aerial-to-Street-Level Place Recognition and Localization
Dansk Drone Kompagni ApS(丹麦无人机公司);Technical University of Denmark(丹麦技术大学);Universidad de Zaragoza(萨拉戈萨大学)
地点识别和视觉定位在宽基线配置中特别具有挑战性。在本文中,我们的贡献与\emph{Danish Airs and Grounds}(DAG)数据集,一个大型的收集街道和航空图像针对这种情况。它的主要挑战在于查询和参考图像之间的极端视角差异,从而改变照明和透视。该数据集比目前公开的数据更大,更多样化,包括城市,郊区和农村地区50多公里的道路。所有图像都与精确的6-DoF元数据相关联,可以对视觉定位方法进行基准测试。我们还提出了一个地图到图像的重新定位管道,首先估计密集的3D重建从航空图像,然后匹配查询街道级图像的3D模型的街道级渲染。数据集可从以下网址下载:https://frederikwarburg.github.io/DAG
SurgT challenge: Benchmark of Soft-Tissue Trackers for Robotic Surgery
Imperial College London(伦敦帝国理工学院);Jmees(Jmees公司);Electronics and Telecommunications Research Institute (ETRI)(电子通信研究院);Ajou University(亚洲大学);University of Toronto(多伦多大学);University College London(伦敦大学学院)
WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Tracking
Shanghai Jiao Tong University(上海交通大学);CloudWalk Technology Co., Ltd(云从科技有限公司);Shenzhen Research Institute of Big Data, the Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)深圳大数据研究院);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);JD Explore Academy in JD.com(京东集团京东探索研究院);University of Sydney(悉尼大学)
Extended Agriculture-Vision: An Extension of a Large Aerial Image Dataset for Agricultural Pattern Analysis
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Intelinair
对于遥感和地球观测数据的大部分机器学习工作来说,一个关键的挑战是难以获得大量准确标记的数据。这对于语义分割任务来说尤其如此,因为在大规模收集精确、准确的像素级注释方面存在令人难以置信的困难,所以在遥感领域中不太常见。最近的努力通过创建监督数据集以及应用自我监督方法来解决这些挑战。我们继续在这两方面作出努力。首先,我们生成并发布了一个改进版本的视觉数据集(Chiu et al.,2020年b),以包括原始的,全视野的图像更大的实验灵活性。其次,我们扩展了这个数据集,发布了3600个大的,高分辨率(10厘米/像素),全场,红-绿-蓝和近红外图像进行预训练。第三,我们将最初构建在Simplified框架上的Pixel-to-Propagation Module Xie et al.(2021 b)并入MoCo-V2 Chen et al.(2020年b)。最后,我们通过对下游分类和语义分割任务的不同对比学习方法进行基准测试,证明了这些数据的有用性。我们在基于MoCo-V2的不同框架内探索了CNN和Swin Transformer Liu等人(2021 a)的架构。总之,这些方法使我们能够更好地从航空图像中检测整个领域的关键农业模式,以便农民可以及时提醒有问题的地区,为他们的管理决策提供信息。此外,这些数据集的发布将支持农业遥感中计算机视觉的多种研究途径。
Anti-UAV: A Large Multi-Modal Benchmark for UAV Tracking
University of Chinese Academic of Sciences(中国科学院大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Institute of North Electronic Equipment(北方电子设备研究所);Baidu Research(百度研究院)
Benchmarking Microsaccade Recognition with Event Cameras: A Novel Dataset and Evaluation
C3I Imaging Lab, School of Engineering, University of Galway, Ireland(C3I成像实验室,工程学院,Galway大学,爱尔兰);School of Computer Science, University of Galway, Ireland(计算机科学学院,Galway大学,爱尔兰);Department of Electronic and Electrical Engineering, Trinity College Dublin, Ireland(电子与电气工程系,Trinity College Dublin大学,爱尔兰)
How Far are Modern Trackers from UAV-Anti-UAV? A Million-Scale Benchmark and New Baseline
Shanghai Jiao Tong University(上海交通大学);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));CloudWalk Technology Co., Ltd(云walk科技有限公司);School of Artificial Intelligence, Shanghai Jiao Tong University(上海交通大学人工智能学院);School of Aeronautics and Astronautics, Sun Yat-sen University(中山大学航空宇航学院);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所)
Maize Seedling Detection Dataset (MSDD): A Curated High-Resolution RGB Dataset for Seedling Maize Detection and Benchmarking with YOLOv9, YOLO11, YOLOv12 and Faster-RCNN
Department of Electrical Engineering and Computer Science, University of Missouri(电气工程与计算机科学系,密苏里大学)
Benchmarking Deep Learning Models for Aerial LiDAR Point Cloud Semantic Segmentation under Real Acquisition Conditions: A Case Study in Navarre
Department of Statistics, Computer Science and Mathematics and Institute of Smart Cities (ISC), Public University of Navarre (UPNA)(统计、计算机科学与数学系和智能城市研究所(ISC),纳瓦拉公共大学(UPNA));Tracasa Instrumental
Search Multilayer Perceptron-Based Fusion for Efficient and Accurate Siamese Tracking
Institute of Mining Artificial Intelligence, Chinese Institute of Coal Science(采矿人工智能研究所,中国煤炭科学研究院);Department of Computer Science, City University of Hong Kong(计算机科学系,香港城市大学);Image Processing Center, School of Astronautics, Beihang University(图像处理中心,航天学院,北航);State Key Laboratory of Intelligent Coal Mining and Strata Control(智能煤炭开采与岩层控制国家重点实验室)
PVT++: A Simple End-to-End Latency-Aware Visual Tracking Framework
Carnegie Mellon University(卡内基梅隆大学);National University of Singapore(新加坡国立大学);Tongji University(同济大学);New York University(纽约大学);Tsinghua University(清华大学)
T-SiamTPN: Temporal Siamese Transformer Pyramid Networks for Robust and Efficient UAV Tracking
Department of Electrical Engineering, Amirkabir University of Technology (AUT)(电气工程系,阿米尔卡比尔技术大学);Qatar Computing Research Institute Hamad Bin Khalifa University(卡塔尔计算研究所,哈马德·本·卡西姆大学)
Learning Occlusion-Robust Vision Transformers for Real-Time UAV Tracking
College of Computer Science and Engineering, Guilin University of Technology(桂林理工大学计算机科学与工程学院);School of Computer Science, Fudan University(复旦大学计算机科学技术学院);School of Artificial Intelligence, Sun Yat-sen University(中山大学人工智能学院)