从磁共振图像（MRI）中提取大脑并去除颅骨伪影是神经影像分析中重要的预处理步骤。目前已有许多处理人类fMRI图像的工具，但这些工具可能包含验证脑分割结果的手动步骤，使得过程耗时且低效。在本研究中，我们使用Segment Anything Model (SAM)，这是Meta[4]发布的免费神经网络，已在许多通用分割应用中展现出良好效果。我们通过去除颅骨伪影来分析SAM在神经影像脑部分割中的效率。实验结果显示出良好前景，表明无需在自定义医学影像数据集上训练即可探索将自动分割算法用于神经影像。
英文摘要：
Brain extraction and removal of skull artifacts from magnetic resonance images (MRI) is an important preprocessing step in neuroimaging analysis. There are many tools developed to handle human fMRI images, which could involve manual steps for verifying results from brain segmentation that makes it time consuming and inefficient. In this study, we will use the segment anything model (SAM), a freely available neural network released by Meta[4], which has shown promising results in many generic segmentation applications. We will analyze the efficiency of SAM for neuroimaging brain segmentation by removing skull artifacts. The results of the experiments showed promising results that explore using automated segmentation algorithms for neuroimaging without the need to train on custom medical imaging dataset.
SAM3D: Segment Anything Model in Volumetric Medical Images
University of Arkansas（阿肯色大学）；University of Science, Vietnam National University（越南国家大学科学大学）；John von Neumann Institute, Vietnam National University（越南国家大学约翰·冯·诺依曼研究所）；West Virginia University（西弗吉尼亚大学）；University of Arkansas for Medical Sciences（阿肯色医科大学）
Segment Anything in Medical Images and Videos: Benchmark and Deployment
Peter Munk Cardiac Centre, University Health Network（彼得·芒克心脏中心，大学健康网络）；Vector Institute for Artificial Intelligence（向量人工智能研究所）；AI Hub, University Health Network（人工智能中心，大学健康网络）；University of Toronto（多伦多大学）
本文对 SAM2 在 11 种医学图像模态和视频上进行了全面基准测试，并通过微调迁移学习及 3D Slicer 插件和 Gradio API 部署，验证了其快速适应医学领域并实现高效 3D 分割的能力。
Segment Anything Model (SAM) for Radiation Oncology
Mayo Clinic（梅奥诊所）；University of Georgia（佐治亚大学）；The University of Texas at Arlington（德克萨斯大学阿灵顿分校）；Massachusetts General Hospital（麻省总医院）；Harvard Medical School（哈佛医学院）
SQA-SAM: Segmentation Quality Assessment for Medical Images Utilizing the Segment Anything Model
Nanjing University of Science and Technology（南京理工大学）；Digital Medical Research Center, School of Basic Medical Sciences, Fudan University（复旦大学基础医学院数字医学研究中心）；The Chinese University of Hong Kong（香港中文大学）；University of Notre Dame（圣母大学）
University of Minnesota（明尼苏达大学）；Center for Magnetic Resonance Research（磁共振研究中心）
Functional MRI (fMRI) is commonly used for interpreting neural activities across the brain. Numerous accelerated fMRI techniques aim to provide improved spatiotemporal resolutions. Among these, simultaneous multi-slice (SMS) imaging has emerged as a powerful strategy, becoming a part of large-scale studies, such as the Human Connectome Project. However, when SMS imaging is combined with in-plane acceleration for higher acceleration rates, conventional SMS reconstruction methods may suffer from noise amplification and other artifacts. Recently, deep learning (DL) techniques have gained interest…
Encoding Structural Constraints into Segment Anything Models via Probabilistic Graphical Models
The George Washington University（乔治·华盛顿大学）；Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（深圳先进技术研究所，中国科学院）；University of Alabama at Birmingham（阿拉巴马大学伯明翰分校）
Visualizing the perceptual content by analyzing human functional magnetic resonance imaging (fMRI) has been an active research area. However, due to its high dimensionality, complex dimensional structure, and small number of samples available, reconstructing realistic images from fMRI remains challenging. Recently with the development of convolutional neural network (CNN) and generative adversarial network (GAN), mapping multi-voxel fMRI data to complex, realistic images has been made possible. In this paper, we propose a model, DCNN-GAN, by combining a reconstruction network and GAN. We utili…
Chinese PLA General Hospital（中国人民解放军总医院）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；Peng Cheng Laboratory（鹏城实验室）；Beijing Jiaotong University（北京交通大学）；Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）
In neuroimaging analysis, fMRI can well assess the function changes for brain diseases with no obvious structural lesions. To date, most deep-learning-based fMRI studies have employed functional connectivity (FC) as the basic feature for disease classification. However, FC is calculated on time series of predefined regions of interest and neglects detailed information contained in each voxel. Another drawback of using FC is the limited sample size for the training of deep models. The low representation ability of FC leads to poor performance in clinical practice, especially when dealing with m…
Whole-brain Transferable Representations from Large-Scale fMRI Data Improve Task-Evoked Brain Activity Decoding
Gamania Digital Entertainment Co., Ltd.（Gamania数字娱乐有限公司）；Institute of Information Science, Academia Sinica（Academia Sinica信息科学研究所）；Sony Computer Science Laboratories, Inc.（索尼计算机科学实验室有限公司）
Technische Universität Berlin（柏林工业大学）；Max Planck School of Cognition（马克斯·普朗克认知学院）；Korea University（高丽大学）；Max Planck Institute for Informatics（马克斯·普朗克信息学研究所）；Fraunhofer Heinrich Hertz Institute（弗劳恩霍夫海因里希·赫兹研究所）
The application of deep learning (DL) models to the decoding of cognitive states from whole-brain functional Magnetic Resonance Imaging (fMRI) data is often hindered by the small sample size and high dimensionality of these datasets. Especially, in clinical settings, where patient data are scarce. In this work, we demonstrate that transfer learning represents a solution to this problem. Particularly, we show that a DL model, which has been previously trained on a large openly available fMRI dataset of the Human Connectome Project, outperforms a model variant with the same architecture, but whi…
University of Amsterdam（阿姆斯特丹大学）；Amsterdam Neuroscience（阿姆斯特丹神经科学研究所）
Single-subject mapping of resting-state brain functional activity to non-imaging phenotypes is a major goal of neuroimaging. The large majority of learning approaches applied today rely either on static representations or on short-term temporal correlations. This is at odds with the nature of brain activity which is dynamic and exhibit both short- and long-range dependencies. Further, new sophisticated deep learning approaches have been developed and validated on single tasks/datasets. The application of these models for the study of a different targets typically require exhaustive hyperparame…
Reconstructing perceived natural images from fMRI signals is one of the most engaging topics of neural decoding research. Prior studies had success in reconstructing either the low-level image features or the semantic/high-level aspects, but rarely both. In this study, we utilized an Instance-Conditioned GAN (IC-GAN) model to reconstruct images from fMRI patterns with both accurate semantic attributes and preserved low-level details. The IC-GAN model takes as input a 119-dim noise vector and a 2048-dim instance feature vector extracted from a target image via a self-supervised learning model (…
Ariel University（阿里尔大学）；University of Haifa（海法大学）；Technion Faculty of Medicine（以色列理工学院医学院）；National Institute of Information and Communications Technology (NICT)（日本信息通信研究机构）；Osaka University（大阪大学）
We show that fMRI analysis using machine learning tools are sufficient to distinguish valence (i.e., positive or negative) of freely retrieved autobiographical memories in a cross-participant setting. Our methodology uses feature selection (ReliefF) in combination with boosting methods, both applied directly to data represented in voxel space. In previous work using the same data set, Nawa and Ando showed that whole-brain based classification could achieve above-chance classification accuracy only when both training and testing data came from the same individual. In a cross-participant setting…
ETH Zurich（苏黎世联邦理工学院）；Yale University（耶鲁大学）；Mila（米拉研究所）
Functional magnetic resonance imaging (fMRI) is a crucial technology for gaining insights into cognitive processes in humans. Data amassed from fMRI measurements result in volumetric data sets that vary over time. However, analysing such data presents a challenge due to the large degree of noise and person-to-person variation in how information is represented in the brain. To address this challenge, we present a novel topological approach that encodes each time point in an fMRI data set as a persistence diagram of topological features, i.e. high-dimensional voids present in the data. This repr…
