RT-OVAD: Real-Time Open-Vocabulary Aerial Object Detection via Image-Text Collaboration
Nanjing University of Science and Technology(南京理工大学);Northwestern Polytechnical University(西北工业大学);Zhejiang Lab(浙江实验室);Intellifusion Inc.(Intellifusion公司)
Aerial object detection plays a crucial role in numerous applications. However, most existing methods focus on detecting predefined object categories, limiting their applicability in real-world open scenarios. In this paper, we extend aerial object detection to open scenarios through image-text collaboration and propose RT-OVAD, the first real-time open-vocabulary detector for aerial scenes. Specifically, we first introduce an image-to-text alignment loss to replace the conventional category regression loss, thereby eliminating category constraints. Next, we propose a lightweight image-text collaboration strategy comprising an image-text collaboration encoder and a text-guided decoder. The encoder simultaneously enhances visual features and refines textual embeddings, while the decoder guides object queries to focus on class-relevant image features. This design further improves detection accuracy without incurring significant computational overhead. Extensive experiments demonstrate that RT-OVAD consistently outperforms existing state-of-the-art methods across open-vocabulary, zero-shot, and traditional closed-set detection tasks. For instance, on the open-vocabulary aerial detection benchmarks DIOR, DOTA-v2.0, and LAE-80C, RT-OVAD achieves 87.7 AP$_{50}$, 53.8 mAP, and 23.7 mAP, respectively, surpassing the previous state-of-the-art (LAE-DINO) by 2.2, 7.0, and 3.5 points. In addition, RT-OVAD achieves an inference speed of 34 FPS on an RTX 4090 GPU, approximately three times faster than LAE-DINO (10 FPS), meeting the real-time detection requirements of diverse applications. The code will be released at https://github.com/GT-Wei/RT-OVAD.
Open-Vocabulary vs Supervised Learning Methods for Post-Disaster Visual Scene Understanding
Department of Informatics and Telematics, Harokopio University of Athens(信息与电信学系,雅典哈罗科波斯大学);Department of Networks and Digital Media, Kingston University(网络与数字媒体系,金士顿大学);Department of Electrical and Computer Engineering, University of Western Macedonia(电子与计算机工程系,西马其顿大学);Archimedes, Athena Research Center(阿基米德,雅典研究中心)
SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentation
Nanyang Technological University(南洋理工大学);MoE Key Laboratory of Interdisciplinary Research of Computation and Economics, Shanghai University of Finance and Economics(上海财经大学经济与计算交叉研究重点实验室);Institute for Infocomm Research (I 2 R), A*STAR, Singapore(新加坡资讯与通讯研究院)
OS-W2S: An Automatic Labeling Engine for Language-Guided Open-Set Aerial Object Detection
Nanjing University of Science and Technology(南京理工大学);Intellifusion Inc.(Intellifusion公司);Northwestern Polytechnical University(西北工业大学);Zhejiang Lab(浙江实验室);Yan’an University(延安大学);Beijing University of Posts and Telecommunications(北京邮电大学)
COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts
Fujian Institute of Research on the Structure of Matter, Chinese Academy of Sciences(中国科学院福建物质结构研究所);Institute of Urban Environment, Chinese Academy of Sciences(中国科学院城市环境研究所);University of Chinese Academy of Sciences(中国科学院大学);School of Resource and Environmental Sciences, Wuhan University(武汉大学资源与环境科学学院)
AetherVision-Bench: An Open-Vocabulary RGB-Infrared Benchmark for Multi-Angle Segmentation across Aerial and Ground Perspectives
Robert Bosch Centre for Cyber Physical Systems, Indian Institute of Science, Bengaluru, India(罗伯特·博世协同物理系统中心,印度科学研究院,班加罗尔);Kotak IISc AI-ML Centre, Indian Institute of Science, Bengaluru, India(Kotak IISc AI-ML 中心,印度科学研究院,班加罗尔);Department of Aerospace Engineering, Indian Institute of Science, Bengaluru, India(航空航天工程系,印度科学研究院,班加罗尔)
WildBox: A Dataset and Benchmark for Aerial Monocular 3D Detection of African Savanna Wildlife
D Optical Metrology Unit, Fondazione Bruno Kessler(布鲁诺·凯斯勒基金会3D光学计量部);Computer Vision and Machine Learning Systems group, Institute for Geoinformatics, University of Muenster(明斯特大学地理信息学研究所计算机视觉与机器学习系统组);School of Civil, Aerospace and Design Engineering, University of Bristol(布里斯托大学土木、航空航天与设计工程学院);Department of Biology, University of Southern Denmark(南丹麦大学生物学系);The Ohio State University(俄亥俄州立大学);Department of Collective Behavior, Max Planck Institute of Animal Behavior(马克斯·普朗克动物行为研究所集体行为系);University of Konstanz(康斯坦茨大学);Centre for the Advanced Study of Collective Behaviour, University of Konstanz(康斯坦茨大学集体行为高级研究中心);Department of Biology, University of Konstanz(康斯坦茨大学生物学系);Environmental Computational Science and Earth Observation Laboratory, EPFL(瑞士联邦理工学院环境计算科学与地球观测实验室)
ViSA-Enhanced Aerial VLN: A Visual-Spatial Reasoning Enhanced Framework for Aerial Vision-Language Navigation
Tianmushan Laboratory, Beihang University(北航之梦实验室,北京航空航天大学);Hangzhou International Innovation Institute, Beihang University(杭州国际创新研究院,北京航空航天大学);Foshan Graduate School of Innovation, Northeastern University(佛山创新研究生学院,东北大学);School of Aeronautic Science and Engineering, Beihang University(航空科学与工程学院,北京航空航天大学);Faculty of Robot Science and Engineering, Northeastern University(机器人科学与工程学院,东北大学)
Memory-Augmented Multimodal Large Language Models for Small Object Understanding in Streaming Aerial Videos
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));University of Freiburg(弗莱堡大学);Hangzhou City University(杭州城市大学);XGRIDS(XGRIDS公司);Fudan University(复旦大学);Hong Kong Baptist University(香港浸会大学)
DroneFINE: Domain-Aware Parameter-Efficient Fine-Tuning of Vision-Language Detectors for Drone Images
National College for Excellent Engineers, Beihang University, Beijing, China(北京航空航天大学优秀工程师学院);School of Computer Science and Engineering, Beihang University, Beijing, China(北京航空航天大学计算机科学与工程学院);School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, China(合肥工业大学计算机科学与信息工程学院);State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China(虚拟现实技术与系统国家重点实验室);Innovation Center for Intelligent System Cognition and Decision-Making, Beijing, China(智能系统认知与决策创新中心);Information Science Academy of China Electronics Technology Group Corporation, Beijing, China(中国电子科技集团有限公司信息科学研究院)