Modern Unmanned Aerial Vehicles equipped with state of the art artificial intelligence (AI) technologies are opening to a wide plethora of novel and interesting applications. While this field received a strong impact from the recent AI breakthroughs, most of the provided solutions either entirely rely on commercial software or provide a weak integration interface which denies the development of additional techniques. This leads us to propose a novel and efficient framework for the UAV-AI joint technology. Intelligent UAV systems encounter complex challenges to be tackled without human control. One of these complex challenges is to be able to carry out computer vision tasks in real-time use cases. In this paper we focus on this challenge and introduce a multi-layer AI (MLAI) framework to allow easy integration of ad-hoc visual-based AI applications. To show its features and its advantages, we implemented and evaluated different modern visual-based deep learning models for object detection, target tracking and target handover.
UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility
The State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所多模态人工智能系统国家重点实验室);Macau University of Science and Technology(澳门科技大学);School of Automation, Beijing Institute of Technology(北京理工大学自动化学院);School of Software, Northwestern Polytechnical University(西北工业大学软件学院);College of Mechanical and Vehicle Engineering, Hunan University(湖南大学机械与运载工程学院);John von Neumann Faculty of Informatics, Obuda University(欧布达大学约翰·冯·诺依曼信息学院)
A Multi-UAV Formation Obstacle Avoidance Method Combined Improved Simulated Annealing and Adaptive Artificial Potential Field
School of Aeronautics and Astronautics, University of Electronic Science and Technology of China(电子科技大学航空航天学院);SDU-ANU Joint Science College, Shandong University(山东大学山东大学-澳大利亚国立大学联合科学学院);Yangtze Delta Region Institute (Huzhou), University of Electronic Science and Technology of China(电子科技大学长三角研究院(湖州));Aircraft Swarm Intelligent Sensing and Cooperative Control Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China(电子科技大学四川省飞行器集群智能感知与协同控制重点实验室);National Key Laboratory of Adaptive Optics, Chengdu(成都自适应光学全国重点实验室)
Multi-UAV Formation Cooperative Obstacle Avoidance and Adaptive Shape Deformation Control in Complex Environments Based on BI-APF-RRT and Affine Transformation
College of Marine Information Engineering(海洋信息工程学院)
AeroVerse: UAV-Agent Benchmark Suite for Simulating, Pre-training, Finetuning, and Evaluating Aerospace Embodied World Models
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院航空信息研究所);University of Chinese Academy of Sciences(中国科学院大学);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院);Key Laboratory of Target Cognition and Application Technology(TCAT), Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院航空信息研究所目标认知与应用技术重点实验室)
Large Language Models for UAVs: Current State and Pathways to the Future
Tongji University(同济大学);College of Electronics and Information Engineering, Tongji University(同济大学电子与信息工程学院);United Arab Emirates University (UAEU)(阿联酋大学)
Is your VLM Sky-Ready? A Comprehensive Spatial Intelligence Benchmark for UAV Navigation
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Peng Cheng Laboratory(鹏城实验室);Xiaomi EV(小米电动汽车);Georgia Institute of Technology(佐治亚理工学院);Institute of Automation, CAS(中国科学院自动化研究所);National University of Singapore(新加坡国立大学)
MM-UAVBench: How Well Do Multimodal Large Language Models See, Think, and Plan in Low-Altitude UAV Scenarios?
Tsinghua University(清华大学);Nankai University(南开大学);Northwest Polytechnical University(西北工业大学);Chinese Academy of Sciences(中国科学院);Harbin Institute of Technology(哈尔滨工业大学)