Deep learning (DL) models for medical image segmentation are highly influenced by intensity variations of input images and lack generalization due to primarily utilizing pixels' intensity information for inference. Acquiring sufficient training data is another challenge limiting models' applications. We proposed to leverage the consistency of organs' anatomical shape and position information in medical images. We introduced a framework leveraging recurring anatomical patterns through global binary masks for organ segmentation. Two scenarios were studied.1) Global binary masks were the only model's (i.e. U-Net) input, forcing exclusively encoding organs' position and shape information for segmentation/localization.2) Global binary masks were incorporated as an additional channel functioning as position/shape clues to mitigate training data scarcity. Two datasets of the brain and heart CT images with their ground-truth were split into (26:10:10) and (12:3:5) for training, validation, and test respectively. Training exclusively on global binary masks led to Dice scores of 0.77(0.06) and 0.85(0.04), with the average Euclidian distance of 3.12(1.43)mm and 2.5(0.93)mm relative to the center of mass of the ground truth for the brain and heart structures respectively. The outcomes indicate that a surprising degree of position and shape information is encoded through global binary masks. Incorporating global binary masks led to significantly higher accuracy relative to the model trained on only CT images in small subsets of training data; the performance improved by 4.3-125.3% and 1.3-48.1% for 1-8 training cases of the brain and heart datasets respectively. The findings imply the advantages of utilizing global binary masks for building generalizable models and to compensate for training data scarcity.
MedFLIP: Medical Vision-and-Language Self-supervised Fast Pre-Training with Masked Autoencoder
University of Copenhagen(哥本哈根大学);Tsinghua University(清华大学);Shanghai Medical Image Insights(上海医学影像洞察);Harvard University(哈佛大学);University of Waterloo(滑铁卢大学)
M$^3$HL: Mutual Mask Mix with High-Low Level Feature Consistency for Semi-Supervised Medical Image Segmentation
Shanghai Key Laboratory of Intelligent Sensing and Recognition(上海智能感知与识别重点实验室);Shanghai Jiao Tong University(上海交通大学);Department of Endocrinology and Metabolism, Renji Hospital, School of Medicine, Shanghai Jiao Tong University(内分泌与代谢科,仁济医院,医学院,上海交通大学);Center for Digital Innovation, Tongji University(同济大学数字创新中心)
MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation
Imperial College London(伦敦帝国学院);Royal Brompton Hospital(皇家布朗普顿医院);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);University of Cambridge(剑桥大学)
Less is More: Unsupervised Mask-guided Annotated CT Image Synthesis with Minimum Manual Segmentations
National Heart and Lung Institute, Imperial College London(帝国理工学院国家心肺研究所);Royal Brompton Hospital(皇家布朗普顿医院);Centre for Cardiovascular Science, University of Edinburgh(爱丁堡大学心血管科学中心);School of Computer Science and Electronic Engineering, University of Essex(埃塞克斯大学计算机科学与电子工程学院)
Mask-Enhanced Segment Anything Model for Tumor Lesion Semantic Segmentation
Beihang University(北京航空航天大学);Hangzhou Innovation Institute, Beihang University(北京航空航天大学杭州创新研究院);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);The Chinese University of Hong Kong(香港中文大学);Sun Yat-sen University(中山大学);Peking University Cancer Hospital & Institute(北京大学肿瘤医院暨研究所);Nanjing University(南京大学)
Enhancing Global Sensitivity and Uncertainty Quantification in Medical Image Reconstruction with Monte Carlo Arbitrary-Masked Mamba
Imperial College London(帝国理工学院);Royal Brompton Hospital(皇家布朗普顿医院);College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区生物医学工程学院);Human Phenome Institute, Fudan University(复旦大学人类表型组研究院);Inselspital, University of Bern(伯尔尼大学因塞尔医院);Technical University of Munich(慕尼黑工业大学)
DeSAM: Decoupled Segment Anything Model for Generalizable Medical Image Segmentation
Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences(中国科学院苏州生物医学工程技术研究所);The Hong Kong Polytechnic University(香港理工大学)
Unsupervised Anomaly Detection in Medical Images with a Memory-augmented Multi-level Cross-attentional Masked Autoencoder
Harvard University(哈佛大学);Singapore Management University(新加坡管理大学);Australian Institute for Machine Learning(澳大利亚机器学习研究所);University of Adelaide(阿德莱德大学);South Australian Health and Medical Research Institute(南澳大利亚健康与医学研究所);University of Surrey(萨里大学)
StructDiff: Structure-aware Diffusion Model for 3D Fine-grained Medical Image Synthesis
Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(新一代人工智能技术及跨学科应用关键实验室(东南大学),中华人民共和国教育部,中国);Jiangsu Province Joint International Research Laboratory of Medical Information Processing, Southeast University, Nanjing, China(江苏省医疗信息处理联合国际研究实验室(东南大学),南京市,中国);Univ Rennes, CHU Rennes, Inserm, LTSI– UMR 1099, F-35000 Rennes, France(里昂大学,里昂大学医院,Inserm,LTSI– UMR 1099,法国里昂,法国);Shanghai AI Laboratory(上海人工智能实验室);School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China(计算机科学与技术学院,北京理工大学,北京,中国);Department of Radiology, Jinling Hospital, Affiliated Hospital of Medical School, Nanjing University, Nanjing, China(放射科,南京大学附属医院,南京大学,南京,中国)
SimulaMet(西穆拉梅特研究所);UIT The Arctic University of Norway(挪威北极大学);Augere Medical AS(奥热医疗公司);University of Oslo(奥斯陆大学);Kristiania University College(克里斯蒂安尼亚大学学院);Oslo Metropolitan University(奥斯陆城市大学);Oslo University Hospital(奥斯陆大学医院)