Cross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentation
School of Electronics and Information Engineering, Harbin Institute of Technology(电子信息工程学院,哈尔滨工业大学);Faculty of Computing, Harbin Institute of Technology(计算机学院,哈尔滨工业大学);Peng Cheng Laboratory, Shenzhen(鹏城实验室,深圳)
Given a natural language expression and a remote sensing image, the goal of referring remote sensing image segmentation (RRSIS) is to generate a pixel-level mask of the target object identified by the referring expression. In contrast to natural scenarios, expressions in RRSIS often involve complex geospatial relationships, with target objects of interest that vary significantly in scale and lack visual saliency, thereby increasing the difficulty of achieving precise segmentation. To address the aforementioned challenges, a novel RRSIS framework is proposed, termed the cross-modal bidirectional interaction model (CroBIM). Specifically, a context-aware prompt modulation (CAPM) module is designed to integrate spatial positional relationships and task-specific knowledge into the linguistic features, thereby enhancing the ability to capture the target object. Additionally, a language-guided feature aggregation (LGFA) module is introduced to integrate linguistic information into multi-scale visual features, incorporating an attention deficit compensation mechanism to enhance feature aggregation. Finally, a mutual-interaction decoder (MID) is designed to enhance cross-modal feature alignment through cascaded bidirectional cross-attention, thereby enabling precise segmentation mask prediction. To further forster the research of RRSIS, we also construct RISBench, a new large-scale benchmark dataset comprising 52,472 image-language-label triplets. Extensive benchmarking on RISBench and two other prevalent datasets demonstrates the superior performance of the proposed CroBIM over existing state-of-the-art (SOTA) methods. The source code for CroBIM and the RISBench dataset will be publicly available at https://github.com/HIT-SIRS/CroBIM
Understanding What Is Not Said:Referring Remote Sensing Image Segmentation with Scarce Expressions
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China(教育部多媒体可信感知与高效计算重点实验室);Institute of Artificial Intelligence, Xiamen University(厦门大学人工智能研究院);Xiamen University(厦门大学);School of Informatics, Xiamen University(厦门大学信息学院)
GeoSelect: Spatial-Program Execution for Training-Free Referring Remote Sensing Image Segmentation
School of Internet, Anhui University(安徽大学互联网学院);National Engineering Research Center for Agro-Ecological Big Data Analysis & Application, Anhui University(安徽大学农业生态大数据分析与应用国家工程研究中心);State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University(武汉大学测绘遥感信息工程国家重点实验室)
Exploring Fine-Grained Image-Text Alignment for Referring Remote Sensing Image Segmentation
School of Information Science and Technology, Southwest Jiaotong University(西南交通大学信息科学与技术学院);Ant Group(蚂蚁集团);Luoyang Institute of Electro-optical Equipment, AVIC(中国航空工业集团公司洛阳电光设备研究所);Faculty of Geosciences and Engineering, Southwest Jiaotong University(西南交通大学地球科学与环境工程学院)
Intra- and Cross-Scale Feature Interaction Network for Referring Remote Sensing Image Segmentation
School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University(人工智能、光学与电子学院(iOPEN),西北工业大学);School of Computer Science, Northwestern Polytechnical University(计算机科学学院,西北工业大学);department of Software, Northwest Institute of Nuclear Technology(软件系,西北核技术研究院)
Image-Conditioned Instance Prompt Network for Referring Remote Sensing Image Segmentation
School of Computer Science, Northwestern Polytechnical University, Xi'an, China(西北工业大学计算机科学学院,西安,中国);College of Intelligent Robotics and Advanced Manufacturing, Fudan University, Shanghai, China(复旦大学智能机器人与先进制造学院,上海,中国);Shenzhen Research Institute of Northwestern Polytechnical University, Shenzhen, China(西北工业大学深圳研究院,深圳,中国)
CADFormer: Fine-Grained Cross-modal Alignment and Decoding Transformer for Referring Remote Sensing Image Segmentation
School of Computer Science and Technology, Wuhan University of Science and Technology(武汉科技大学计算机科学与技术学院);School of Information Science and Engineering, Wuhan University of Science and Technology(武汉科技大学信息科学与工程学院)
DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentation
School of Information Science and Electronic Engineering, Shanghai Jiao Tong University(上海交通大学信息科学与工程学院);College of Computer Science, Nankai University(南开大学计算机学院);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Department of Electronic Engineering, Tsinghua University(清华大学电子工程系)
EarthMapper: Visual Autoregressive Models for Controllable Bidirectional Satellite-Map Translation
School of Electronics and Information Engineering, Harbin Institute of Technology(电子与信息工程学院,哈尔滨工业大学);Faculty of Computing, Harbin Institute of Technology(计算机学院,哈尔滨工业大学);Peng Cheng Lab(鹏城实验室)
Proxy-Embedding as an Adversarial Teacher: An Embedding-Guided Bidirectional Attack for Referring Expression Segmentation Models
National Pilot School of Software, Yunnan University(云南大学软件试点学校);School of Information Science and Engineering, Yunnan University(云南大学信息科学与工程学院);Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究所)
RIS-LAD: A Benchmark and Model for Referring Low-Altitude Drone Image Segmentation
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China(教育部多媒体可信感知与高效计算重点实验室);Institute of Artificial Intelligence, Xiamen University(厦门大学人工智能研究院);School of Informatics, Xiamen University(厦门大学信息学院)
RiFCN: Recurrent Network in Fully Convolutional Network for Semantic Segmentation of High Resolution Remote Sensing Images
Remote Sensing Technology Institute (IMF), German Aerospace Center (DLR)(德国航空航天中心(DLR)遥感技术研究所(IMF));Signal Processing in Earth Observation (SiPEO), Technical University of Munich (TUM)(慕尼黑工业大学(TUM)地球观测信号处理(SiPEO))
STARS: Shared-specific Translation and Alignment for missing-modality Remote Sensing Semantic Segmentation
State Key Laboratory of information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University(测绘遥感信息工程国家重点实验室,武汉大学);Electronic Information School, Wuhan University(电子信息学院,武汉大学);Hubei FreerTech Co. Ltd(湖北弗瑞特科技有限公司)
March in Chat: Interactive Prompting for Remote Embodied Referring Expression
Australian Institute for Machine Learning, The University of Adelaide(阿德莱德大学澳大利亚机器学习研究所);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
HiT: Building Mapping with Hierarchical Transformers
State Key Laboratory of Virtual Reality Technology and Systems, Beihang University(北京航空航天大学虚拟现实技术与系统国家重点实验室);Hangzhou Innovation Institute, Beihang University(北京航空航天大学杭州创新研究院)
Temporally Ordered Region-Token Mamba with Logit-Space Diffusion for Remote Sensing Change Detection
Georgia Institute of Technology(佐治亚理工学院);Indian Institute of Engineering Science and Technology (IIEST), Shibpur(印度工程科学与技术学院(IIEST),希布普尔);Nanyang Technological University(南洋理工大学);Indian Institute of Technology, Delhi(印度理工学院德里分校);Duke University(杜克大学)
Geo-R1: Improving Few-Shot Geospatial Referring Expression Understanding with Reinforcement Fine-Tuning
College of Computer Science and Technology of Zhejiang University(浙江大学计算机科学与技术学院);Polytechnic Institute of Zhejiang University(浙江大学Polytechnic学院);Om AI Research(Om AI研究机构);Binjiang Research Institute of Zhejiang University(浙江大学滨江研究机构);School of Software Engineering of Zhejiang University(浙江大学软件工程学院);School of Mathematical Sciences of Zhejiang University(浙江大学数学科学学院);China Academy of Space Technology(中国航天科技研究院);University of Bristol(布里斯托大学)
GeoChat: Grounded Large Vision-Language Model for Remote Sensing
Mohamed bin Zayed University of AI(穆罕默德·本·扎耶德人工智能大学);Birla Institute of Technology & Science, Hyderabad(海得拉巴贝拉理工学院);Australian National University(澳大利亚国立大学);Linköping University(林雪平大学)