MMNet: Multi-Mask Network for Referring Image Segmentation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Science and Technology Beijing(北京科技大学);University of Chinese Academy of Sciences(中国科学院大学)
Referring image segmentation aims to segment an object referred to by natural language expression from an image. However, this task is challenging due to the distinct data properties between text and image, and the randomness introduced by diverse objects and unrestricted language expression. Most of previous work focus on improving cross-modal feature fusion while not fully addressing the inherent uncertainty caused by diverse objects and unrestricted language. To tackle these problems, we propose an end-to-end Multi-Mask Network for referring image segmentation(MMNet). we first combine picture and language and then employ an attention mechanism to generate multiple queries that represent different aspects of the language expression. We then utilize these queries to produce a series of corresponding segmentation masks, assigning a score to each mask that reflects its importance. The final result is obtained through the weighted sum of all masks, which greatly reduces the randomness of the language expression. Our proposed framework demonstrates superior performance compared to state-of-the-art approaches on the two most commonly used datasets, RefCOCO, RefCOCO+ and G-Ref, without the need for any post-processing. This further validates the efficacy of our proposed framework.
OneRef: Unified One-tower Expression Grounding and Segmentation with Mask Referring Modeling
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Pengcheng Laboratory(鹏城实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
CM-MaskSD: Cross-Modality Masked Self-Distillation for Referring Image Segmentation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Science(中国科学院大学人工智能学院);University of Science and Technology Beijing(北京科技大学)
School of Computer Science, Nankai University(南开大学计算机学院);BNRist, Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系BNRist(注:BNRist为北京信息科学与技术国家研究中心的英文缩写))
DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentation
School of Information Science and Electronic Engineering, Shanghai Jiao Tong University(上海交通大学信息科学与工程学院);College of Computer Science, Nankai University(南开大学计算机学院);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Department of Electronic Engineering, Tsinghua University(清华大学电子工程系)
SetCon: Towards Open-Ended Referring Segmentation via Set-Level Concept Prediction
Shanghai Jiao Tong University(上海交通大学);Shanghai Innovation Institute(上海创新研究院);The Chinese University of Hong Kong(香港中文大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Fudan University(复旦大学);University of Science and Technology of China(中国科学技术大学)
EAVL: Explicitly Align Vision and Language for Referring Image Segmentation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Science(中国科学院大学人工智能学院)
CMF: Cascaded Multi-model Fusion for Referring Image Segmentation
Beijing University of Posts and Telecommunications(北京邮电大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Artificial Intelligence Research, Chinese Academy of Sciences(中国科学院人工智能研究院);University of Chinese Academy of Sciences(中国科学院大学)
An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation
University of Science and Technology of China(中国科学技术大学);Institute of Artificial Intelligence (TeleAI)(人工智能研究所);China Telecom(中国电信);School of Artificial Intelligence, Optics and Electronics (iOPEN)(人工智能、光学与电子学院);Northwestern Polytechnical University(西北工业大学)
GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning
Central South University(中南大学);Jiangxi Normal University(江西师范大学);Hohai University(河海大学);Renmin University of China(中国人民大学);The Chinese University of Hong Kong(香港中文大学)
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University(中国教育部多媒体可信感知与高效计算重点实验室,厦门大学);Youtu Lab, Tencent, P.R. China(腾讯视频实验室,中国);OpenGVLab, Shanghai AI Laboratory(上海AI实验室)
Semantics-Aware Dynamic Localization and Refinement for Referring Image Segmentation
University of Oxford(牛津大学);Shanghai AI Laboratory(上海人工智能实验室);Tsinghua-Berkeley Shenzhen Institute, Tsinghua University(清华大学深圳国际研究生院(清华-伯克利深圳学院));The University of Hong Kong(香港大学)
Vision-Aware Text Features in Referring Image Segmentation: From Object Understanding to Context Understanding
The Hong Kong University of Science and Technology(香港科技大学);Stony Brook University(石溪大学);University of Science, VNU-HCM(胡志明市国家大学科学大学);Vietnam National University, Ho Chi Minh City(胡志明市国家大学);Trinity College Dublin(都柏林大学学院)
Video-Instrument Synergistic Network for Referring Video Instrument Segmentation in Robotic Surgery
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Imperial College London(帝国理工学院);Hong Kong University of Science and Technology(香港科技大学);The General Hospital of Southern Theatre Command of PLA(中国人民解放军南部战区总医院);National University of Singapore(新加坡国立大学)