3D Referring Expression Segmentation (3D-RES) aims to segment point cloud scenes based on a given expression. However, existing 3D-RES approaches face two major challenges: feature ambiguity and intent ambiguity. Feature ambiguity arises from information loss or distortion during point cloud acquisition due to limitations such as lighting and viewpoint. Intent ambiguity refers to the model's equal treatment of all queries during the decoding process, lacking top-down task-specific guidance. In this paper, we introduce an Image enhanced Prompt Decoding Network (IPDN), which leverages multi-view images and task-driven information to enhance the model's reasoning capabilities. To address feature ambiguity, we propose the Multi-view Semantic Embedding (MSE) module, which injects multi-view 2D image information into the 3D scene and compensates for potential spatial information loss. To tackle intent ambiguity, we designed a Prompt-Aware Decoder (PAD) that guides the decoding process by deriving task-driven signals from the interaction between the expression and visual features. Comprehensive experiments demonstrate that IPDN outperforms the state-ofthe-art by 1.9 and 4.2 points in mIoU metrics on the 3D-RES and 3D-GRES tasks, respectively.
CoHD: A Counting-Aware Hierarchical Decoding Framework for Generalized Referring Expression Segmentation
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);School of EIC, Huazhong University of Science and Technology(华中科技大学电子信息与工程学院);Tencent TEG(腾讯技术工程事业群)
REF-VLM: Triplet-Based Referring Paradigm for Unified Visual Decoding
School of Computer Science, Shanghai Jiao Tong University, Shanghai, 200240, China(上海交通大学计算机科学学院);Ningbo Institute of Digital Twin, Eastern Institute of Technology, Ningbo, China(宁波数字孪生研究院);School of Information Science and Electronic Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China(上海交通大学信息科学与电子工程学院)
ReferFlow: Beyond Final-Target Localization for Complex Referring Expressions
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人工智能与机器人研究所人机混合增强智能全国重点实验室);Xingchen AGI Lab, China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd.(中国电信人工智能技术(北京)有限公司星辰AGI实验室);Beijing Normal University(北京师范大学);Zhejiang University(浙江大学);University of the Chinese Academy of Sciences(中国科学院大学);University of Science and Technology Beijing(北京科技大学);Shanghai Jiao Tong University(上海交通大学)
EviRCOD: Evidence-Guided Probabilistic Decoding for Referring Camouflaged Object Detection
West China Hospital, Sichuan University(四川大学华西医院);Independent Researcher(独立研究员);Department of Data Science and Artificial Intelligence, Auckland University of Technology(奥克兰理工大学数据科学与人工智能系)
RefAerial: A Benchmark and Approach for Referring Detection in Aerial Images
School of Artificial Intelligence, Anhui University(安徽大学人工智能学院);School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院);State Key Laboratory of Opto-Electronic Information Acquisition and Protection Technology, Anhui University(安徽大学光电信息采集与防护技术国家重点实验室);Anhui Provincial Key Laboratory of Security Artificial Intelligence, Anhui University(安徽省安全人工智能重点实验室);Anhui Provincial Key Laboratory of Multimodal Cognitive Computation, Anhui University(安徽省多模态认知计算重点实验室)
CADFormer: Fine-Grained Cross-modal Alignment and Decoding Transformer for Referring Remote Sensing Image Segmentation
School of Computer Science and Technology, Wuhan University of Science and Technology(武汉科技大学计算机科学与技术学院);School of Information Science and Engineering, Wuhan University of Science and Technology(武汉科技大学信息科学与工程学院)
CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding
UMass Amherst(马萨诸塞大学阿默斯特分校);Wuhan University(武汉大学);University of California, Los Angeles(加州大学洛杉矶分校);MIT-IBM Watson AI Lab(MIT-IBM沃森人工智能实验室);South China University of Technology(华南理工大学)
Language-Bridged Spatial-Temporal Interaction for Referring Video Object Segmentation
Beihang University(北京航空航天大学);Meituan(美团);Hangzhou Innovation Institute, Beihang University(北京航空航天大学杭州创新研究院);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);University of Chinese Academy of Sciences(中国科学院大学)
University of Sydney(悉尼大学);OPPO Research Institute(OPPO研究院);Beijing University of Posts and Telecommunications(北京邮电大学);Kuaishou Technology(快手科技);University of Melbourne(墨尔本大学)
CausalCLIPSeg: Unlocking CLIP's Potential in Referring Medical Image Segmentation with Causal Intervention
Wuhan University of Technology(武汉理工大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);MedAI Technology (Wuxi) Co. Ltd.(MedAI科技(无锡)有限公司);Technical University of Munich(慕尼黑工业大学)
SetCon: Towards Open-Ended Referring Segmentation via Set-Level Concept Prediction
Shanghai Jiao Tong University(上海交通大学);Shanghai Innovation Institute(上海创新研究院);The Chinese University of Hong Kong(香港中文大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Fudan University(复旦大学);University of Science and Technology of China(中国科学技术大学)
Fuse & Calibrate: A bi-directional Vision-Language Guided Framework for Referring Image Segmentation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院)
FlowSeg: Dynamic Semantic Guidance for LLM-Conditioned Segmentation
School of Computer Science, Beijing Institute of Technology(北京理工大学计算机科学学院);School of Computer Science, University of Birmingham(伯明翰大学计算机科学学院);WEI Lab, Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学学院WEI实验室);Beijing Key Laboratory of Advanced Information Science(北京高级信息科学重点实验室)
Referencing Where to Focus: Improving VisualGrounding with Referential Query
National Engineering Research Center for Visual Information and Applications(视觉信息与应用国家工程研究中心);Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人工智能与机器人研究所);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));AntGroup(蚂蚁集团)