arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.15670cs.CV

PixDLM:一种用于无人机推理分割的双路径多模态语言模型

PixDLM: A Dual-Path Multimodal Language Model for UAV Reasoning Segmentation

Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University(中国教育部多媒体可信感知与高效计算重点实验室,厦门大学)

Shuyan Ke, Yifan Mei, Changli Wu, Yonghan Zheng, Jiayi Ji, Liujuan Cao, Rongrong Ji

AI总结:

本文提出PixDLM,一种用于无人机推理分割的多模态语言模型,通过构建DRSeg基准数据集,验证了该模型在处理高分辨率无人机图像中的有效性。

摘要:

推理分割最近从地面场景扩展到遥感图像,但无人机数据带来了独特的挑战,包括倾斜视角、超高清分辨率和极端尺度变化。为解决这些问题,我们正式定义了无人机推理分割任务,并将其语义需求组织为三个维度:空间、属性和场景级推理。基于此定义,我们构建了DRSeg大型基准数据集,包含10,000张高分辨率航拍图像,配以涵盖所有三种推理类型的链式思考QA监督。作为基准的补充,我们引入PixDLM,一种简单而有效的像素级多模态语言模型,作为该任务的统一基线。在DRSeg上的实验建立了强大的基线结果,并突显了无人机推理分割的独特挑战,为未来研究提供了坚实的基础。

英文摘要:

Reasoning segmentation has recently expanded from ground-level scenes to remote-sensing imagery, yet UAV data poses distinct challenges, including oblique viewpoints, ultra-high resolutions, and extreme scale variations. To address these issues, we formally define the UAV Reasoning Segmentation task and organize its semantic requirements into three dimensions: Spatial, Attribute, and Scene-level reasoning. Based on this formulation, we construct DRSeg, a large-scale benchmark for UAV reasoning segmentation, containing 10k high-resolution aerial images paired with Chain-of-Thought QA supervision across all three reasoning types. As a benchmark companion, we introduce PixDLM, a simple yet effective pixel-level multimodal language model that serves as a unified baseline for this task. Experiments on DRSeg establish strong baseline results and highlight the unique challenges of UAV reasoning segmentation, providing a solid foundation for future research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑