UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentation
Mohamed bin Zayed University of AI(穆罕默德·本·扎耶德人工智能大学);Australian National University(澳大利亚国立大学);University of California, Merced(加州大学默塞德分校);Yonsei University(延世大学);Google Research(谷歌研究院);Linköping University(林雪平大学)
Abdelrahman Shaker, Muhammad Maaz, Hanoona Rasheed, Salman Khan, Ming-Hsuan Yang, Fahad Shahbaz Khan
Owing to the success of transformer models, recent works study their applicability in 3D medical segmentation tasks. Within the transformer models, the self-attention mechanism is one of the main building blocks that strives to capture long-range dependencies. However, the self-attention operation has quadratic complexity which proves to be a computational bottleneck, especially in volumetric medical imaging, where the inputs are 3D with numerous slices. In this paper, we propose a 3D medical image segmentation approach, named UNETR++, that offers both high-quality segmentation masks as well as efficiency in terms of parameters, compute cost, and inference speed. The core of our design is the introduction of a novel efficient paired attention (EPA) block that efficiently learns spatial and channel-wise discriminative features using a pair of inter-dependent branches based on spatial and channel attention. Our spatial attention formulation is efficient having linear complexity with respect to the input sequence length. To enable communication between spatial and channel-focused branches, we share the weights of query and key mapping functions that provide a complimentary benefit (paired attention), while also reducing the overall network parameters. Our extensive evaluations on five benchmarks, Synapse, BTCV, ACDC, BRaTs, and Decathlon-Lung, reveal the effectiveness of our contributions in terms of both efficiency and accuracy. On Synapse, our UNETR++ sets a new state-of-the-art with a Dice Score of 87.2%, while being significantly efficient with a reduction of over 71% in terms of both parameters and FLOPs, compared to the best method in the literature. Code: https://github.com/Amshaker/unetr_plus_plus.
MLRU++: Multiscale Lightweight Residual UNETR++ with Attention for Efficient 3D Medical Image Segmentation
AI Research Lab, Department of Computer Science(人工智能研究实验室、计算机科学系);Biomedical & Translational Sciences, Sanford School of Medicine(生物医学与转化科学、桑福德医学院);University Of South Dakota(南达科他大学)
DB-SAM: Delving into High Quality Universal Medical Image Segmentation
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Tianjin University(天津大学);Institute of High Performance Computing(高性能计算研究所);Agency for Science, Technology and Research(科学、技术与研究局);Linköping University(林雪平大学)
Harnessing Lightweight Transformer with Contextual Synergic Enhancement for Efficient 3D Medical Image Segmentation
Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR(电子工程系,香港中文大学(深圳)Hong Kong SAR);Centre for Artificial Intelligence and Robotics (CAIR), Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences, Hong Kong SAR(人工智能与机器人中心(CAIR),香港科学与创新研究院,中国科学院,Hong Kong SAR)
SwinMM: Masked Multi-view with Swin Transformers for 3D Medical Image Segmentation
Shanghai Jiao Tong University(上海交通大学);University of Washington(华盛顿大学);The Johns Hopkins University(约翰斯·霍普金斯大学);University of Michigan, Ann Arbor(密歇根大学安娜堡分校);University of California, Santa Cruz(加利福尼亚大学圣克鲁兹分校);Tsinghua University(清华大学);Stanford University(斯坦福大学)
Advances in Medical Image Segmentation: A Comprehensive Survey with a Focus on Lumbar Spine Applications
Center for Informatics Science, School of Information Technology and Computer Science, Nile University(信息科学中心,信息科技与计算机科学学院,尼罗大学);Graduate School of Information Science, University of Hyogo(信息科学研究生院,兵库大学);Advanced Medical Engineering Research Institute, University of Hyogo(先进医学工程研究所,兵库大学)
Weakly Supervised Intracranial Hemorrhage Segmentation using Head-Wise Gradient-Infused Self-Attention Maps from a Swin Transformer in Categorical Learning
UNetVL: Enhancing 3D Medical Image Segmentation with Chebyshev KAN Powered Vision-LSTM
Electrical Engineering and Computer Science Department, University of Michigan, Ann Arbor, USA(密歇根大学电气工程与计算机科学系);Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, USA(佐治亚理工学院和埃默里大学沃森·霍尔生物医学工程系);Computer Science Department, University of Michigan, Ann Arbor, USA(密歇根大学计算机科学系);Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology(佐治亚理工学院沃森·霍尔生物医学工程系);Emory University, Atlanta, USA(埃默里大学)
MedSAM3: Delving into Segment Anything with Medical Concepts
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Southeast University(东南大学);The Hong Kong University of Science and Technology(香港科技大学)
Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification
Johns Hopkins University(约翰斯·霍普金斯大学)
视觉Transformer(ViT)由于其在许多视觉任务中的巨大可扩展性、计算效率和令人信服的性能而成为最流行的神经架构之一。然而,ViT在医疗任务上表现出不如卷积神经网络(CNN)的性能,这是由于其数据饥渴的性质和缺乏注释的医疗数据。在本文中,我们使用掩码自编码器(MAE)对266,340张胸部X光片进行了预训练ViT,MAE从每张图像的一小部分中重建丢失的像素。为了进行比较,CNN也使用先进的自监督方法(例如,MoCo v2)。结果表明,我们的预训练ViT在多标签胸部疾病分类方面表现优于(有时更好)最先进的CNN(DenseNet-121)。这一表现归功于从我们的经验研究中提取的用于预训练和微调ViT的强大配方。预训练配方表明,与自然成像相比,医学重建需要更小比例的图像(10% vs. 25%)和更适度的随机调整大小的裁剪范围(0.5~1.0 vs. 0.2~1.0)。此外,我们注意到,只要可能,域内迁移学习是优选的。微调配方公开了逐层LR衰减、RandAug幅度和DropPath速率是要考虑的重要因素。我们希望这项研究可以指导未来的研究应用Transformers到更大的各种医学成像任务。
SwinCross: Cross-modal Swin Transformer for Head-and-Neck Tumor Segmentation in PET/CT Images
Philips Research North America(飞利浦北美研究院);Massachusetts General Hospital/Harvard Medical School(麻省总医院/哈佛医学院);The Center for Advanced Medical Computing and Analysis, Massachusetts General Hospital/Harvard Medical School(麻省总医院/哈佛医学院高级医学计算与分析中心)
HWA-UNETR: Hierarchical Window Aggregate UNETR for 3D Multimodal Gastric Lesion Segmentation
School of Computer Science and Engineering(计算机科学与工程学院);School of Future Technology(未来技术学院);South China University of Technology(华南理工大学);Department of Medical Imaging(医学影像科);Guangzhou Institute of Cancer Research(广州癌症研究所);the Affiliated Cancer Hospital(附属肿瘤医院);Guangzhou Medical University(广州医学院);Department of Radiology(放射科);Meizhou People’s Hospital(梅州市人民医院);School of Computer Science and Technology(计算机科学与技术学院);Hainan University(海南大学);Department of Oncology Institute(肿瘤研究所)
Progressive Growing of Patch Size: Curriculum Learning for Accelerated and Improved Medical Image Segmentation
School of Computation, Information and Technology, Technical University Munich(技术大学慕尼黑计算、信息与技术学院);Department of Radiation Oncology, TUM School of Medicine, TUM University Hospital rechts der Isar, Technical University of Munich(肿瘤放射治疗科,TUM医学院,TUM大学医院rechts der Isar,技术大学慕尼黑);Institute of Machine Learning in Biomedical Imaging, Helmholtz Munich(生物医学影像中的机器学习研究所,海德堡慕尼黑);Institute of Radiation Medicine, Helmholtz Center Munich(放射医学研究所,海德堡慕尼黑);Munich Center of Machine Learning (MCML)(慕尼黑机器学习中心);School of Biomedical Engineering and Imaging Sciences, King’s College London(生物医学工程与成像科学学院,伦敦国王学院);Departament de Matemàtiques i Informàtica, Barcelona Artificial Intelligence in Medicine Lab (BCN-AIM), Universitat de Barcelona(数学与计算机科学系,巴塞罗那人工智能在医学实验室(BCN-AIM),巴塞罗那大学)
MOSMOS: Multi-organ segmentation facilitated by medical report supervision
Academy for Engineering and Technology, Fudan University(复旦大学工程技术研究院);Shanghai Collaborative Innovation Center of Intelligent Visual Computing(上海智能视觉计算协同创新中心);Changhai Hospital, Second Military Medical University (Naval Medical University)(海军军医大学长海医院);Department of Computer Science and Engineering, The Hong Kong University of Science and Technology(香港科技大学计算机科学与工程学系)
Efficient Parameter Adaptation for Multi-Modal Medical Image Segmentation and Prognosis
Department of Computer Vision, Mohamed bin Zayed University of Artificial Intelligence(计算机视觉系,Mohamed bin Zayed人工智能大学);Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence(机器学习系,Mohamed bin Zayed人工智能大学);Michigan State University(密歇根州立大学);M42 Health(M42健康)
Here Comes the Explanation: A Shapley Perspective on Multi-contrast Medical Image Segmentation
University of Washington(华盛顿大学);Paul G. Allen School of Computer Science, University of Washington(华盛顿大学保罗·G·艾伦计算机科学学院);Department of Neurological Surgery, University of Washington(华盛顿大学神经外科(注:此处按要求提取到学院/大学级别,实际原文该机构属于华盛顿大学,故提取为华盛顿大学))
Dimensionality Reduction and Nearest Neighbors for Improving Out-of-Distribution Detection in Medical Image Segmentation
The University of Texas MD Anderson Cancer Center(德克萨斯大学MD安德森癌症中心);Rice University(莱斯大学);Houston Methodist Hospital(休斯顿卫理公会医院);Baylor College of Medicine(贝勒医学院)
DeepEdit: Deep Editable Learning for Interactive Segmentation of 3D Medical Images
School of Biomedical Engineering & Imaging Sciences, King’s College London(伦敦国王学院生物医学工程与影像科学学院);NVIDIA(英伟达);Semmelweis University(塞麦尔维斯大学);EBATINCA, S.L.(EBATINCA有限公司);Beth Israel Deaconess Medical Center(贝斯以色列女执事医疗中心);Isomics, Inc.(Isomics公司)
Cyclic 2.5D Perceptual Loss for Cross-Modal 3D Medical Image Synthesis: T1w MRI to Tau PET
Department of Artificial Intelligence, Hanyang University, Seoul, South Korea(人工智能系,翰阳大学,首尔,韩国);Department of Electronic Engineering, Hanyang University, Seoul, South Korea(电子工程系,翰阳大学,首尔,韩国);Division of Computer Engineering, Hankuk University of Foreign Studies, Yongin, South Korea(计算机工程系,韩国外语大学, Yongin,韩国);Division of AI Data Convergence, Hankuk University of Foreign Studies, Yongin, South Korea(AI数据融合系,韩国外语大学, Yongin,韩国);Division of Language & AI, Hankuk University of Foreign Studies, Seoul, South Korea(语言与AI系,韩国外语大学,首尔,韩国)