RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoning
School of Electrical and Electronic Engineering, Nanyang Technological University(电气电子工程学院,南洋理工大学);MoE Key Laboratory of Interdisciplinary Research of Computation and Economics, Shanghai University of Finance and Economics(教育部计算与经济交叉学科重点实验室,上海财经大学)
Remote Sensing Visual Grounding (RSVG) aims to localize target objects in large-scale aerial imagery based on natural language descriptions. Owing to the vast spatial scale and high semantic ambiguity of remote sensing scenes, these descriptions often rely heavily on positional cues, posing unique challenges for Multimodal Large Language Models (MLLMs) in spatial reasoning. To leverage this unique feature, we propose a reasoning-guided, position-aware post-training framework, dubbed \textbf{RSGround-R1}, to progressively enhance spatial understanding. Specifically, we first introduce Chain-of-Thought Supervised Fine-Tuning (CoT-SFT) using synthetically generated RSVG reasoning data to establish explicit position awareness. Reinforcement Fine-Tuning (RFT) is then applied, augmented by our newly designed positional reward that provides continuous and distance-aware guidance toward accurate localization. Moreover, to mitigate incoherent localization behaviors across rollouts, we introduce a spatial consistency guided optimization scheme that dynamically adjusts policy updates based on their spatial coherence, ensuring stable and robust convergence. Extensive experiments on RSVG benchmarks demonstrate superior performance and generalization of our model.
Hangzhou Dianzi University(杭州电子科技大学);Zhejiang University(浙江大学);University of Texas at San Antonio(德克萨斯大学圣安东尼奥分校);University of Sydney(悉尼大学)
Visual grounding aims to localize an object in an image referred to by a textual query phrase. Various visual grounding approaches have been proposed, and the problem can be modularized into a general framework: proposal generation, multi-modal feature representation, and proposal ranking. Of these three modules, most existing approaches focus on the latter two, with the importance of proposal generation generally neglected. In this paper, we rethink the problem of what properties make a good proposal generator. We introduce the diversity and discrimination simultaneously when generating propo…
Why Do VLMs Fail at Remote Physiological Measurement? Rethinking with Physiological Grounding and Numerical Alignment
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Sichuan University(四川大学);Nanyang Technological University(南洋理工大学);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)
Seeing the Trees for the Forest: Rethinking Weakly-Supervised Medical Visual Grounding
Australian Institute for Machine Learning, University of Adelaide(澳大利亚机器学习研究所,阿德莱德大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Macquarie University(麦考瑞大学);Hanoi University of Science and Technology(河内科学技术大学);University of Wollongong(沃林根大学);Flinders University(弗林德斯大学)
ProtagoLabs Inc(ProtagoLabs公司);Microsoft Research(微软研究院);Beijing Institute of Technology(北京理工大学);Huazhong University of Science and Technology(华中科技大学);Sichuan University(四川大学);Dalian University of Technology(大连理工大学);Lehigh University(利哈伊大学);Peking University(北京大学)
Temporal sentence grounding (TSG) aims to identify the temporal boundary of a specific segment from an untrimmed video by a sentence query. All existing works first utilize a sparse sampling strategy to extract a fixed number of video frames and then conduct multi-modal interactions with query sentence for reasoning. However, we argue that these methods have overlooked two indispensable issues: 1) Boundary-bias: The annotated target segment generally refers to two specific frames as corresponding start and end timestamps. The video downsampling process may lose these two frames and take the ad…
LatentOmni: Rethinking Omni-Modal Understanding via Unified Audio-Visual Latent Reasoning
School of AI, Shanghai Jiao Tong University(上海交通大学人工智能学院);Kling Team, Kuaishou Technology(快手科技 Kling 团队);Peking University(北京大学);HKUST(香港科技大学);CASIA(中国科学院自动化研究所);Nanjing University(南京大学);Renmin University of China(中国人民大学);Tsinghua University(清华大学)
本文提出LatentOmni框架,通过统一的音频-视觉潜在空间进行多模态推理,利用特征级监督和Omni-Sync Position Embedding保持时间一致性,从而在多个音频-视觉推理基准测试中取得最佳性能。
Rethinking Patient Education as Multi-turn Multi-modal Interaction
VA Bedford Health Care(VA贝德福德医疗中心);UMass Amherst(马萨诸塞大学阿默斯特分校);UMass Lowell(马萨诸塞大学洛厄尔分校);Yale University(耶鲁大学);National University of Singapore(新加坡国立大学);Yale School of Medicine(耶鲁医学院)
Rethinking Weakly-supervised Video Temporal Grounding From a Game Perspective
Hubei Key Laboratory of Distributed System Security(湖北分布式系统安全重点实验室);Hubei Engineering Research Center on Big Data Security(大数据安全工程研究中心);School of Cyber Science and Engineering(网络安全科学与工程学院);Huazhong University of Science and Technology(华中科技大学);University of Central Florida(佛罗里达中央大学);Zhejiang Gongshang University(浙江工商大学);Guangzhou University(广州大学);The Chinese University of Hong Kong(香港中文大学);Peking University(北京大学)
Not All Actions Are Equal: Rethinking Conditioning for Dexterous World Model
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Shenzhen University(深圳大学);Beijing University of Technology(北京工业大学);JD Explore Academy(京东探索研究院)