Linguistic Structure Guided Context Modeling for Referring Image Segmentation
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能研究院);Sun Yat-sen University(中山大学);Tencent Marketing Solution(腾讯营销解决方案)
Tianrui Hui, Si Liu, Shaofei Huang, Guanbin Li, Sansi Yu, Faxi Zhang, Jizhong Han
Referring image segmentation aims to predict the foreground mask of the object referred by a natural language sentence. Multimodal context of the sentence is crucial to distinguish the referent from the background. Existing methods either insufficiently or redundantly model the multimodal context. To tackle this problem, we propose a "gather-propagate-distribute" scheme to model multimodal context by cross-modal interaction and implement this scheme as a novel Linguistic Structure guided Context Modeling (LSCM) module. Our LSCM module builds a Dependency Parsing Tree suppressed Word Graph (DPT-WG) which guides all the words to include valid multimodal context of the sentence while excluding disturbing ones through three steps over the multimodal feature, i.e., gathering, constrained propagation and distributing. Extensive experiments on four benchmarks demonstrate that our method outperforms all the previous state-of-the-arts.
Progressive Prompt-Guided Cross-Modal Reasoning for Referring Image Segmentation
School of Computer Science and Artificial Intelligence, Wuhan University of Technology(武汉理工大学计算机科学与人工智能学院);School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院);University of Electronic Science and Technology of China(电子科技大学);Wuhan Vocational College of Software and Engineering(武汉软件工程职业学院)
EviRCOD: Evidence-Guided Probabilistic Decoding for Referring Camouflaged Object Detection
West China Hospital, Sichuan University(四川大学华西医院);Independent Researcher(独立研究员);Department of Data Science and Artificial Intelligence, Auckland University of Technology(奥克兰理工大学数据科学与人工智能系)
Fuse & Calibrate: A bi-directional Vision-Language Guided Framework for Referring Image Segmentation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院)
CMF: Cascaded Multi-model Fusion for Referring Image Segmentation
Beijing University of Posts and Telecommunications(北京邮电大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Artificial Intelligence Research, Chinese Academy of Sciences(中国科学院人工智能研究院);University of Chinese Academy of Sciences(中国科学院大学)
LAVT: Language-Aware Vision Transformer for Referring Image Segmentation
University of Oxford(牛津大学);Shanghai AI Laboratory(上海人工智能实验室);Tsinghua-Berkeley Shenzhen Institute, Tsinghua University(清华大学清华-伯克利深圳学院);SenseTime Research(商汤科技研究院);The University of Hong Kong(香港大学)
Referring Image Segmentation via Cross-Modal Progressive Comprehension
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机学院);Sun Yat-sen University(中山大学);University of Technology Sydney(悉尼科技大学);AI Institute(360人工智能研究院)
Referring Segmentation in Images and Videos with Cross-Modal Self-Attention Network
Wenzhou University(温州大学);University of Manitoba(曼尼托巴大学);Shanghai Institute for Advanced Communication and Data Science(上海先进通信与数据科学研究院);Shanghai University(上海大学)
OneRef: Unified One-tower Expression Grounding and Segmentation with Mask Referring Modeling
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Pengcheng Laboratory(鹏城实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
University of Sydney(悉尼大学);OPPO Research Institute(OPPO研究院);Beijing University of Posts and Telecommunications(北京邮电大学);Kuaishou Technology(快手科技);University of Melbourne(墨尔本大学)
Cross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentation
School of Electronics and Information Engineering, Harbin Institute of Technology(电子信息工程学院,哈尔滨工业大学);Faculty of Computing, Harbin Institute of Technology(计算机学院,哈尔滨工业大学);Peng Cheng Laboratory, Shenzhen(鹏城实验室,深圳)
RIS-LAD: A Benchmark and Model for Referring Low-Altitude Drone Image Segmentation
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China(教育部多媒体可信感知与高效计算重点实验室);Institute of Artificial Intelligence, Xiamen University(厦门大学人工智能研究院);School of Informatics, Xiamen University(厦门大学信息学院)
Image-Conditioned Instance Prompt Network for Referring Remote Sensing Image Segmentation
School of Computer Science, Northwestern Polytechnical University, Xi'an, China(西北工业大学计算机科学学院,西安,中国);College of Intelligent Robotics and Advanced Manufacturing, Fudan University, Shanghai, China(复旦大学智能机器人与先进制造学院,上海,中国);Shenzhen Research Institute of Northwestern Polytechnical University, Shenzhen, China(西北工业大学深圳研究院,深圳,中国)
PTQ4RIS: Post-Training Quantization for Referring Image Segmentation
School of Electronic and Electrical Engineering, Shanghai University of Engineering Science(上海工程技术大学电子与电气工程学院);SenseTime(商汤科技);Carnegie Mellon University(卡内基梅隆大学)
Exploring Fine-Grained Image-Text Alignment for Referring Remote Sensing Image Segmentation
School of Information Science and Technology, Southwest Jiaotong University(西南交通大学信息科学与技术学院);Ant Group(蚂蚁集团);Luoyang Institute of Electro-optical Equipment, AVIC(中国航空工业集团公司洛阳电光设备研究所);Faculty of Geosciences and Engineering, Southwest Jiaotong University(西南交通大学地球科学与环境工程学院)
Cross-Modal Progressive Comprehension for Referring Segmentation
Beihang University(北京航空航天大学);Chinese Academy of Sciences(中国科学院);University of Chinese Academy of Sciences(中国科学院大学);Beijing Jiaotong University(北京交通大学);Sun Yat-sen University(中山大学);Pazhou Lab(琶洲实验室)
An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation
University of Science and Technology of China(中国科学技术大学);Institute of Artificial Intelligence (TeleAI)(人工智能研究所);China Telecom(中国电信);School of Artificial Intelligence, Optics and Electronics (iOPEN)(人工智能、光学与电子学院);Northwestern Polytechnical University(西北工业大学)
A Text-Image Fusion Method with Data Augmentation Capabilities for Referring Medical Image Segmentation
College of Information Science and Engineering(信息科学与工程学院);Ritsumeikan University(立命馆大学);Tiwaki Co., Ltd.(Tiwaki公司);Dalian University of Technology(大连理工大学);School of Software(软件学院);Zhejiang University(浙江大学)
Calibration & Reconstruction: Deep Integrated Language for Referring Image Segmentation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentation
School of Information Science and Electronic Engineering, Shanghai Jiao Tong University(上海交通大学信息科学与工程学院);College of Computer Science, Nankai University(南开大学计算机学院);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Department of Electronic Engineering, Tsinghua University(清华大学电子工程系)
Soft Prompt Guided Joint Learning for Cross-Domain Sentiment Analysis
Auckland University of Technology(奥克兰理工大学);University of Tasmania(塔斯马尼亚大学);Hefei University of Technology(合肥工业大学);Jilin University of Finance and Economics(吉林财经大学)