Bridging Vision and Language Encoders: Parameter-Efficient Tuning for Referring Image Segmentation
Sun Yat-sen University(中山大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shenzhen Research Institute of Big Data(深圳大数据研究院);AI Institute, Fudan University(复旦大学人工智能研究院);Tencent AI Lab(腾讯人工智能实验室)
Parameter Efficient Tuning (PET) has gained attention for reducing the number of parameters while maintaining performance and providing better hardware resource savings, but few studies investigate dense prediction tasks and interaction between modalities. In this paper, we do an investigation of efficient tuning problems on referring image segmentation. We propose a novel adapter called Bridger to facilitate cross-modal information exchange and inject task-specific information into the pre-trained model. We also design a lightweight decoder for image segmentation. Our approach achieves comparable or superior performance with only 1.61\% to 3.38\% backbone parameter updates, evaluated on challenging benchmarks. The code is available at \url{https://github.com/kkakkkka/ETRIS}.
LAVT: Language-Aware Vision Transformer for Referring Image Segmentation
University of Oxford(牛津大学);Shanghai AI Laboratory(上海人工智能实验室);Tsinghua-Berkeley Shenzhen Institute, Tsinghua University(清华大学清华-伯克利深圳学院);SenseTime Research(商汤科技研究院);The University of Hong Kong(香港大学)
Progressive Prompt-Guided Cross-Modal Reasoning for Referring Image Segmentation
School of Computer Science and Artificial Intelligence, Wuhan University of Technology(武汉理工大学计算机科学与人工智能学院);School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院);University of Electronic Science and Technology of China(电子科技大学);Wuhan Vocational College of Software and Engineering(武汉软件工程职业学院)
A Text-Image Fusion Method with Data Augmentation Capabilities for Referring Medical Image Segmentation
College of Information Science and Engineering(信息科学与工程学院);Ritsumeikan University(立命馆大学);Tiwaki Co., Ltd.(Tiwaki公司);Dalian University of Technology(大连理工大学);School of Software(软件学院);Zhejiang University(浙江大学)
EviRCOD: Evidence-Guided Probabilistic Decoding for Referring Camouflaged Object Detection
West China Hospital, Sichuan University(四川大学华西医院);Independent Researcher(独立研究员);Department of Data Science and Artificial Intelligence, Auckland University of Technology(奥克兰理工大学数据科学与人工智能系)
Semantics-Aware Dynamic Localization and Refinement for Referring Image Segmentation
University of Oxford(牛津大学);Shanghai AI Laboratory(上海人工智能实验室);Tsinghua-Berkeley Shenzhen Institute, Tsinghua University(清华大学深圳国际研究生院(清华-伯克利深圳学院));The University of Hong Kong(香港大学)
PTQ4RIS: Post-Training Quantization for Referring Image Segmentation
School of Electronic and Electrical Engineering, Shanghai University of Engineering Science(上海工程技术大学电子与电气工程学院);SenseTime(商汤科技);Carnegie Mellon University(卡内基梅隆大学)
Intra- and Cross-Scale Feature Interaction Network for Referring Remote Sensing Image Segmentation
School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University(人工智能、光学与电子学院(iOPEN),西北工业大学);School of Computer Science, Northwestern Polytechnical University(计算机科学学院,西北工业大学);department of Software, Northwest Institute of Nuclear Technology(软件系,西北核技术研究院)
Talk2Radar: Bridging Natural Language with 4D mmWave Radar for 3D Referring Expression Comprehension
Institute of Deep Perception Technology, JITRI(JITRI深度感知技术研究所);University of Liverpool(利物浦大学);University of Southampton(南安普顿大学);Momoni AI(Momoni人工智能公司);Xi’an Jiaotong-Liverpool University(西交利物浦大学);Thrust of Artificial Intelligence, HKUST (GZ)(香港科技大学(广州)人工智能学域);Thrust of Intelligent Transportation, HKUST (GZ)(香港科技大学(广州)智能交通学域)
Towards Unsupervised Domain Bridging via Image Degradation in Semantic Segmentation
MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, University of Science and Technology of China(脑启发智能感知与认知联合实验室,中国科学技术大学);National Key Laboratory of Deep Space Exploration, Deep Space Exploration Laboratory(国家深空探测重点实验室,深空探测实验室)
Bridging Supervision Gaps: A Unified Framework for Remote Sensing Change Detection
State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan, China(测绘遥感信息工程国家重点实验室,武汉大学,中国);The University of Tokyo, Tokyo, Japan(东京大学,日本)
Language-Bridged Spatial-Temporal Interaction for Referring Video Object Segmentation
Beihang University(北京航空航天大学);Meituan(美团);Hangzhou Innovation Institute, Beihang University(北京航空航天大学杭州创新研究院);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);University of Chinese Academy of Sciences(中国科学院大学)
Bridging Modalities and Tasks: A Unified Hierarchical ViT for SAR-to-Optical Translation and Semantic Segmentation
School of Automation, Northwestern Polytechnical University(西北工业大学自动化学院);School of Cybersecurity, Northwestern Polytechnical University(西北工业大学网络空间安全学院)
MedGround: Bridging the Evidence Gap in Medical Vision-Language Models with Verified Grounding Data
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);DAMO Academy, Alibaba Group(阿里巴巴集团 DAMO 院);Hupan Lab, Zhejiang Province(浙江省 Hupan 实验室)
Category-level Text-to-Image Retrieval Improved: Bridging the Domain Gap with Diffusion Models and Vision Encoders
King Abdullah University of Science and Technology(国王阿卜杜勒-阿齐兹大学科学与技术大学);Visual Recognition Group(视觉识别组);Faculty of Electrical Engineering(电气工程学院);Czech Technical University in Prague(布拉格捷克技术大学)
SSP-SAM: SAM with Semantic-Spatial Prompt for Referring Expression Segmentation
School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);NExT++ Lab, School of Computing, National University of Singapore(新加坡国立大学计算机学院NExT++实验室);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
VLM-FO1: Bridging the Gap Between High-Level Reasoning and Fine-Grained Perception in VLMs
Om AI Research(Om AI研究机构);Binjiang Institute of Zhejiang University(浙江大学滨江研究院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
MPG-SAM 2: Adapting SAM 2 with Mask Priors and Global Context for Referring Video Object Segmentation
National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University(国家多媒体软件工程研究中心,计算机学院,武汉大学);Hong Kong University of Science and Technology(香港科学与技术大学);Horizon Robotics
Self-paced Multi-grained Cross-modal Interaction Modeling for Referring Expression Comprehension
School of Software Technology, Zhejiang University(浙江大学软件学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Zhejiang University-University of Illinois at Urbana-Champaign Institute, Zhejiang University(浙江大学-伊利诺伊大学厄巴纳-香槟分校研究院)