We introduce a fast Self-adapting Forward-Forward Network (SaFF-Net) for medical imaging analysis, mitigating power consumption and resource limitations, which currently primarily stem from the prevalent reliance on back-propagation for model training and fine-tuning. Building upon the recently proposed Forward-Forward Algorithm (FFA), we introduce the Convolutional Forward-Forward Algorithm (CFFA), a parameter-efficient reformulation that is suitable for advanced image analysis and overcomes the speed and generalisation constraints of the original FFA. To address hyper-parameter sensitivity of FFAs we are also introducing a self-adapting framework SaFF-Net fine-tuning parameters during warmup and training in parallel. Our approach enables more effective model training and eliminates the previously essential requirement for an arbitrarily chosen Goodness function in FFA. We evaluate our approach on several benchmarking datasets in comparison with standard Back-Propagation (BP) neural networks showing that FFA-based networks with notably fewer parameters and function evaluations can compete with standard models, especially, in one-shot scenarios and large batch sizes. The code will be available at the time of the conference.
MediCLIP: Adapting CLIP for Few-shot Medical Image Anomaly Detection
College of Information and Engineering, Capital Normal University(首都师范大学信息工程学院);Peking University Third Hospital(北京大学第三医院);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院)
Adapting a Segmentation Foundation Model for Medical Image Classification
Department of Computer Science, University of Texas Rio Grande Valley(德克萨斯理工大学里奥格兰德分校计算机科学系);Department of Computer Science, Texas Woman’s University(德克萨斯女性大学计算机科学系);Sewickley Academy(塞维克利学院);Department of Mathematical Sciences, The University of Texas at Dallas(德克萨斯大学达拉斯分校数学科学系);Department of Computer Science and Engineering, University of Notre Dame(诺特丹大学计算机科学与工程系)
本文提出将 SAM 图像编码器作为冻结特征提取器,并设计空间局部化通道注意力机制 SLCA,将其集成到深度学习分类模型中,以增强对关键区域的关注,在三个公开医学图像分类数据集上验证了方法的有效性和数据高效性。
Med-LEGO: Editing and Adapting toward Generalist Medical Image Diagnosis
School of Biomedical Engineering \& State Key Laboratory of Advanced Medical Materials;Devices, ShanghaiTech University, Shanghai, 201210, China Shanghai Clinical Research;Trial Center, Shanghai, 201210, China
Adapting Segment Anything Model 3 for Concept-Driven Lesion Segmentation in Medical Images: An Experimental Study
The Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center(德克萨斯大学西南医学中心放射肿瘤学系医学人工智能与自动化(MAIA)实验室);Medical Image Processing Group, Department of Radiology, University of Pennsylvania(宾夕法尼亚大学放射学系医学图像处理组);Division of Digestive and Liver Diseases, Department of Internal Medicine, University of Texas Southwestern Medical Center(德克萨斯大学西南医学中心内科学系消化与肝脏疾病科)
MM-DINOv2: Adapting Foundation Models for Multi-Modal Medical Image Analysis
Chair for AI for Image-Guided Diagnosis and Therapy, Technical University of Munich (TUM)(人工智能辅助影像诊断与治疗研究所,慕尼黑技术大学);TUM University Hospital, Munich, Germany(慕尼黑技术大学医院);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM)(人工智能在医疗与健康领域研究所,慕尼黑技术大学);Department of Radiation Oncology, TUM University Hospital, Munich, Germany(放射肿瘤科,慕尼黑技术大学医院);Chair for Computer Vision and Artificial Intelligence, Technical University of Munich (TUM)(计算机视觉与人工智能研究所,慕尼黑技术大学);Department of Scientific Computing, Florida State University(科学计算系,佛罗里达州立大学);Deutsches Konsortium für Translationale Krebsforschung (DKTK), Partner Site Munich(德国转化癌症研究联盟(DKTK)慕尼黑分部);Institute of Radiation Medicine (IRM), Department of Radiation Sciences (DRS), Helmholtz Center Munich(放射医学研究所(IRM),辐射科学部门(DRS),海德堡中心慕尼黑);Institute for Advanced Study, Technical University of Munich (TUM)(高级研究所,慕尼黑技术大学)
From Specialist to Generalist: Unlocking SAM's Learning Potential on Unlabeled Medical Images
Carnegie Mellon University(卡内基梅隆大学);Industrial University of Ho Chi Minh City(胡志明市工业大学);University of North Carolina at Charlotte(北卡罗来纳州夏洛特大学);University of Alabama at Birmingham(阿拉巴马大学伯明翰分校)
SAMRI-3D: Adapting SAM2 for 3D MRI Segmentation with Global Volume Tokens
School of Electrical Engineering and Computer Science, The University of Queensland(电气工程与计算机科学学院,昆士兰大学);School of Engineering, College of Engineering, Science and Environment, University of Newcastle(工程学院,工程、科学与环境学院,纽卡斯尔大学);School of Human Movement and Nutrition Sciences, The University of Queensland(人类运动与营养科学学院,昆士兰大学)
Block Expanded DINORET: Adapting Natural Domain Foundation Models for Retinal Imaging Without Catastrophic Forgetting
Stadtspital Zürich(苏黎世市立医院);Spross Research Institute(斯普罗斯研究所);Gutblick Research(古特布里克研究公司);Balgrist University Hospital(巴尔格里斯特大学医院);Moorfields Eye Hospital NHS Foundation Trust(摩尔菲尔德眼科医院国民保健服务基金会信托);Institute of Ophthalmology, University College London(伦敦大学学院眼科研究所);University College London(伦敦大学学院);National University of Singapore(新加坡国立大学);Singapore Eye Research Institute, Singapore National Eye Centre(新加坡国家眼科中心新加坡眼科研究所);Duke-NUS Medical School(杜克-新加坡国立大学医学院);iScreen 2 Prevent LLC(iScreen 2 Prevent有限责任公司);Bascom Palmer Eye Institute, University of Miami(迈阿密大学巴斯康帕默眼科研究所);University of Heidelberg(海德堡大学);Semmelweis University(塞梅尔魏斯大学)
A Context-Aware Middleware for Medical Image Based Reports: An approach based on image feature extraction and association rules
Department of Computer Science(计算机科学系);Departament of Mathematics & Statistics(数学与统计学系);Universidade Federal Fluminense(联邦Fluminense大学);York University(约克大学)
MedAtlas: Evaluating LLMs for Multi-Round, Multi-Task Medical Reasoning Across Diverse Imaging Modalities and Clinical Text
University of Science and Technology of China(中国科学技术大学);Eastern Institute of Technology(东方理工大学);Shanghai Jiao Tong University(上海交通大学);Hefei Comprehensive National Science Center(合肥综合性国家科学中心)
MetaLR: Meta-tuning of Learning Rates for Transfer Learning in Medical Imaging
The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));Shenzhen Research Institute of Big Data(深圳大数据研究院);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Fudan University(复旦大学);Johns Hopkins University(约翰斯·霍普金斯大学)
Adapting 2D Multi-Modal Large Language Model for 3D CT Image Analysis
Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology(香港科技大学电子及计算机工程学系);Department of Computer Science and Engineering, The Chinese University of Hong Kong(香港中文大学计算机科学与工程学系);Institute of Medical Intelligence and XR, The Chinese University of Hong Kong(香港中文大学医学智能与扩展现实研究所);Center for Artificial Intelligence and Robotics, Hong Kong Institute of Science and Innovation, Chinese Academy of Sciences(中国科学院香港创新研究院人工智能与机器人创新中心)
Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentation
University of Oxford(牛津大学);National University of Singapore(新加坡国立大学);University of Alberta(阿尔伯塔大学);A*STAR(新加坡科技研究局);Carnegie Mellon University(卡内基梅隆大学);Singapore Eye Research Institute(新加坡眼科研究所);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Hongkong(香港大学)
本文提出Medical SAM Adapter(Med-SA),通过轻量适配技术将医学知识融入SAM,利用SD-Trans和HyP-Adpt适配2D模型至3D医学图像,在17个任务上以仅2%参数更新超越SOTA方法。
Efficient Parameter Adaptation for Multi-Modal Medical Image Segmentation and Prognosis
Department of Computer Vision, Mohamed bin Zayed University of Artificial Intelligence(计算机视觉系,Mohamed bin Zayed人工智能大学);Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence(机器学习系,Mohamed bin Zayed人工智能大学);Michigan State University(密歇根州立大学);M42 Health(M42健康)
Efficient Medical Vision-Language Alignment Through Adapting Masked Vision Models
School of Informatics, Xiamen University(厦门大学信息学院);Center for Smart Health, School of Nursing, The Hong Kong Polytechnic University(香港理工大学护理学院智能健康中心);Department of Biomedical Informatics, Harvard Medical School(哈佛医学院生物医学信息学系);Department of Radiology, Zhongshan Hospital (Xiamen), Fudan University(复旦大学中山医院放射科);National Institute for Data Science in Health and Medicine(医学与数据科学国家研究院);Department of Computer Science, School of Informatics, Xiamen University(厦门大学信息学院计算机科学系)
Adapting Medical Vision Foundation Models for Volumetric Medical Image Segmentation via Active Learning and Selective Semi-supervised Fine-tuning
Mallinckrodt Institute of Radiology(马林克罗德放射医学研究所);Institute for Informatics, Data Science and Biostatistics(信息学、数据科学与生物统计学研究所);Department of Radiology, Perelman School of Medicine(放射科,佩尔曼医学院);Center for AI and Data Science for Integrated Diagnostics (AI2D)(集成诊断人工智能与数据科学中心(AI2D))
SAM Fails to Segment Anything? -- SAM-Adapter: Adapting SAM in Underperformed Scenes: Camouflage, Shadow, Medical Image Segmentation, and More
KOKONI, Moxin (Huzhou) Tech. Co., LTD(莫西(湖州)科技有限公司KOKONI);Beihang University(北京航空航天大学);Zhejiang University(浙江大学);Huzhou University(湖州师范学院);Singapore University of Technology and Design(新加坡科技设计大学)
Enhancing and Adapting in the Clinic: Source-free Unsupervised Domain Adaptation for Medical Image Enhancement
Southern University of Science and Technology(南方科技大学);Agency for Science, Technology and Research(新加坡科技研究局);Beijing Information Science and Technology University(北京信息科技大学);University of Science and Technology Beijing(北京科技大学)