It has been widely recognized that the success of deep learning in image segmentation relies overwhelmingly on a myriad amount of densely annotated training data, which, however, are difficult to obtain due to the tremendous labor and expertise required, particularly for annotating 3D medical images. Although self-supervised learning (SSL) has shown great potential to address this issue, most SSL approaches focus only on image-level global consistency, but ignore the local consistency which plays a pivotal role in capturing structural information for dense prediction tasks such as segmentation. In this paper, we propose a PriorGuided Local (PGL) self-supervised model that learns the region-wise local consistency in the latent feature space. Specifically, we use the spatial transformations, which produce different augmented views of the same image, as a prior to deduce the location relation between two views, which is then used to align the feature maps of the same local region but being extracted on two views. Next, we construct a local consistency loss to minimize the voxel-wise discrepancy between the aligned feature maps. Thus, our PGL model learns the distinctive representations of local regions, and hence is able to retain structural information. This ability is conducive to downstream segmentation tasks. We conducted an extensive evaluation on four public computerized tomography (CT) datasets that cover 11 kinds of major human organs and two tumors. The results indicate that using pre-trained PGL model to initialize a downstream network leads to a substantial performance improvement over both random initialization and the initialization with global consistency-based models. Code and pre-trained weights will be made available at: https://git.io/PGL.
Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignments
School of Computer Science, The University of Sydney(悉尼大学计算机科学学院);Institute of Translational Medicine, Shanghai Jiao Tong University(上海交通大学转化医学研究院);Zhongguancun Academy & Zhongguancun Institute of Artificial Intelligence, Beijing, China(北京中关村学院及中关村人工智能研究院);Department of Molecular Imaging, Royal Prince Alfred Hospital(皇家珀斯阿尔弗雷德医院分子成像部)
SEG-SAM: Semantic-Guided SAM for Unified Medical Image Segmentation
School of Electronic and Information Engineering, South China University of Technology(华南理工大学电子与信息工程学院);Pazhou Lab(琶洲实验室);College of Electronic and Information Engineering, Tongji University(同济大学电子与信息工程学院)
UCAD: Uncertainty-guided Contour-aware Displacement for semi-supervised medical image segmentation
University of Science and Technology of China(科学技术大学);Suzhou Institute for Advanced Research(苏州先进研究院);State Key Laboratory of Precision and Intelligent Chemistry(精密与智能化学国家重点实验室)
Cross-Modal Conditioned Reconstruction for Language-guided Medical Image Segmentation
College of Information and Electrical Engineering, China Agricultural University(中国农业大学信息与电气工程学院);Beijing Engineering and Technology Research Center for Internet of Things in Agriculture, China Agricultural University(中国农业大学北京农业物联网工程技术研究中心);School of Electronic and Computer Engineering, Peking University(北京大学电子与计算机工程学院);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);School of Engineering, The Hong Kong University of Science and Technology(香港科技大学工程学院);Department of Electrical Engineering, Yale University(耶鲁大学电气工程系)
SPENet: Self-guided Prototype Enhancement Network for Few-shot Medical Image Segmentation
School of Computer Science, Beijing University of Technology, Beijing, China(北京理工大学计算机科学学院);Institute of Automation Chinese Academy of Sciences, Beijing, China(中国科学院自动化研究所);Multimedia Department Xiaomi Inc, Beijing, China(小米公司多媒体部门);Capital Medical University Affiliated Beijing Friendship Hospital, Beijing, China(首都医科大学附属北京友谊医院)
Localization-Infused Vision-Language Semantic Fusion for Text-Guided Medical Image Segmentation
Air Force Engineering University(空军工程大学);Harbin Institute of Technology(哈尔滨工业大学);University of Sydney(悉尼大学);Institute of Translational Medicine, Shanghai Jiao Tong University(上海交通大学转化医学研究院);Zhongguancun Institute of Artificial Intelligence(中关村人工智能研究院)
Frequency-domain Multi-modal Fusion for Language-guided Medical Image Segmentation
School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院);NLPR, MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);School of Artificial Intelligence, Anhui University(安徽大学人工智能学院)
Principle-Guided Supervision for Interpretable Uncertainty in Medical Image Segmentation
School of Data Science, Fudan University(复旦大学数据科学学院);Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University(复旦大学脑启发智能科学研究院);National Heart and Lung Institute, Imperial College London(伦敦帝国理工学院国家心脏和肺研究所)
Foundation Model-guided Iteratively Prompting and Pseudo-Labeling for Partially Labeled Medical Image Segmentation
Department of Biomedical Engineering, Columbia University(哥伦比亚大学生物医学工程系);Department of Radiation Oncology, Columbia University Irving Medical Center(哥伦比亚大学欧文医学中心放射肿瘤科);Data Science Institute, Columbia University(哥伦比亚大学数据科学研究所);Herbert Irving Comprehensive Cancer Center, Columbia University(哥伦比亚大学赫伯特·欧文综合癌症中心);Department of Radiation Oncology, Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院放射肿瘤科)
Co-Seg++: Mutual Prompt-Guided Collaborative Learning for Versatile Medical Segmentation
School of Computer Science, University of Nottingham Ningbo China(诺丁汉大学宁波校区计算机科学学院);University of Nottingham, UK(诺丁汉大学(英国));Graduate School of Information, Production and Systems, Waseda University, Japan(早稻田大学信息、生产与系统研究生院);Yale University(耶鲁大学)
A Chebyshev Confidence Guided Source-Free Domain Adaptation Framework for Medical Image Segmentation
Harbin Institute of Technology at Shenzhen(哈尔滨工业大学(深圳));The Peng Cheng Laboratory(鹏城实验室);Guangdong Provincial Key Laboratory of Aerospace Communication and Networking Technology(广东省航空航天通信与网络技术重点实验室)
Mind the Context: Attention-Guided Weak-to-Strong Consistency for Enhanced Semi-Supervised Medical Image Segmentation
College of Engineering Huazhong Agricultural University Wuhan, China(华中农业大学工程学院);College of Informatics Huazhong Agricultural University Wuhan, China(华中农业大学信息学院)
Uncertainty-Guided Mutual Consistency Learning for Semi-Supervised Medical Image Segmentation
Beihang University(北京航空航天大学);Hefei Innovation Research Institute, Beihang University(北京航空航天大学合肥创新研究院);Beijing Advanced Innovation Centre for Biomedical Engineering(北京生物医学工程高精尖创新中心)
TG-LMM: Enhancing Medical Image Segmentation Accuracy through Text-Guided Large Multi-Modal Model
Sun Yat-sen University(中山大学);National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院北京协和医学院国家癌症中心/国家肿瘤临床医学研究中心/肿瘤医院&深圳医院);University of Macau(澳门大学)
EDUE: Expert Disagreement-Guided One-Pass Uncertainty Estimation for Medical Image Segmentation
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Applied Sciences Western Switzerland (HES-SO)(瑞士西部应用科学大学(HES-SO))
Dual-Decoder Consistency via Pseudo-Labels Guided Data Augmentation for Semi-Supervised Medical Image Segmentation
Fuzhou University(福州大学);Fujian Medical University Union Hospital(福建医科大学附属协和医院);Fujian Medical Ultrasound Research Institute(福建省医学超声研究所);Macao Polytechnic University(澳门理工大学)
PG-SAM: Prior-Guided SAM with Medical for Multi-organ Segmentation
Mohamed bin Zayed University of AI(穆罕默德·本·扎耶德人工智能大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);University of Liverpool(利物浦大学);Monash University(莫纳什大学);Shanghai Jiao Tong University(上海交通大学)
DoubleU-NetPlus: A Novel Attention and Context Guided Dual U-Net with Multi-Scale Residual Feature Fusion Network for Semantic Segmentation of Medical Images
United International University(联合国际大学);Stamford University Bangladesh(孟加拉国斯坦福大学)
SAM-Fed: SAM-Guided Federated Semi-Supervised Learning for Medical Image Segmentation
Institute of Information Technology (ITEC), University of Klagenfurt, Austria(信息科技研究所(ITEC),克莱芬福特大学,奥地利);Center for Artificial Intelligence in Medicine, University of Bern, Switzerland(医学人工智能中心,伯恩大学,瑞士);Department of Biomedical Engineering, Eindhoven University of Technology, Netherlands(生物医学工程系,埃因霍温理工大学,荷兰)
Layer-wise Noise Guided Selective Wavelet Reconstruction for Robust Medical Image Segmentation
Big Data and Software College, Chongqing University(重庆大学大数据与软件学院);Office of Scientific Research, Peking University(北京大学科研办公室);Key Lab of High Confidence Software Technology, Ministry of Education (Peking University)(教育部高可信软件技术重点实验室(北京大学));School of Computer Science, Peking University(北京大学计算机学院);Department of Cardiology and Institute of Vascular Medicine, Peking University Third Hospital(北京大学第三医院心内科和血管医学研究院)
DiM: $f$-Divergence Minimization Guided Sharpness-Aware Optimization for Semi-supervised Medical Image Segmentation
Tsinghua University(SZ)(清华大学(深圳));University of Macau(澳门大学);Zayed University of Artificial Intelligence(扎耶德人工智能大学);Hebei University of Technology(河北工业大学);Sun Yat-sen University(中山大学)
Pseudo Label-Guided Data Fusion and Output Consistency for Semi-Supervised Medical Image Segmentation
college of physics and information engineering, University of Fuzhou University(福州大学物理与信息工程学院);Faculty of Applied Science, University of Macao Polytechnic University(澳门理工大学应用科学学院);University of Toronto University(多伦多大学)