White Matter Tracts are Point Clouds: Neuropsychological Score Prediction and Critical Region Localization via Geometric Deep Learning
Harvard Medical School(哈佛医学院);The University of Sydney(悉尼大学);Zhejiang University of Technology(浙江工业大学);The University of New South Wales(新南威尔士大学)
Yuqian Chen, Fan Zhang, Chaoyi Zhang, Tengfei Xue, Leo R. Zekelman, Jianzhong He, Yang Song, Nikos Makris, Yogesh Rathi, Alexandra J. Golby, Weidong Cai, Lauren J. O'Donnell
White matter tract microstructure has been shown to influence neuropsychological scores of cognitive performance. However, prediction of these scores from white matter tract data has not been attempted. In this paper, we propose a deep-learning-based framework for neuropsychological score prediction using microstructure measurements estimated from diffusion magnetic resonance imaging (dMRI) tractography, focusing on predicting performance on a receptive vocabulary assessment task based on a critical fiber tract for language, the arcuate fasciculus (AF). We directly utilize information from all points in a fiber tract, without the need to average data along the fiber as is traditionally required by diffusion MRI tractometry methods. Specifically, we represent the AF as a point cloud with microstructure measurements at each point, enabling adoption of point-based neural networks. We improve prediction performance with the proposed Paired-Siamese Loss that utilizes information about differences between continuous neuropsychological scores. Finally, we propose a Critical Region Localization (CRL) algorithm to localize informative anatomical regions containing points with strong contributions to the prediction results. Our method is evaluated on data from 806 subjects from the Human Connectome Project dataset. Results demonstrate superior neuropsychological score prediction performance compared to baseline methods. We discover that critical regions in the AF are strikingly consistent across subjects, with the highest number of strongly contributing points located in frontal cortical regions (i.e., the rostral middle frontal, pars opercularis, and pars triangularis), which are strongly implicated as critical areas for language processes.
SupWMA: Consistent and Efficient Tractography Parcellation of Superficial White Matter with Deep Learning
School of Computer Science, University of Sydney(悉尼大学计算机科学学院);School of Computer Science and Engineering, University of New South Wales(新南威尔士大学计算机科学与工程学院);Center for Morphometric Analysis, Massachusetts General Hospital(麻省总医院形态测量分析中心)
TractGeoNet: A geometric deep learning framework for pointwise analysis of tract microstructure to predict language assessment performance
Brigham and Women's Hospital, Harvard Medical School(哈佛医学院布莱根妇女医院);The University of Sydney(悉尼大学);University of New South Wales(新南威尔士大学);Massachusetts General Hospital, Harvard Medical School(哈佛医学院麻省总医院);University of Electronic Science and Technology of China(电子科技大学)
Superficial White Matter Analysis: An Efficient Point-cloud-based Deep Learning Framework with Supervised Contrastive Learning for Consistent Tractography Parcellation across Populations and dMRI Acquisitions
Brigham and Women’s Hospital(布莱根妇女医院);Harvard Medical School(哈佛医学院);University of Sydney(悉尼大学);University of New South Wales(新南威尔士大学);Massachusetts General Hospital(麻省总医院)
A Multimodal Deep Learning Approach for White Matter Shape Prediction in Diffusion MRI Tractography
Harvard Medical School(哈佛医学院);The University of Sydney(悉尼大学);Harvard University(哈佛大学);Massachusetts General Hospital(麻省总医院);Boston University(波士顿大学);Harvard-MIT Health Sciences and Technology(哈佛-麻省理工学院健康科学与技术)
TractShapeNet: Efficient Multi-Shape Learning with 3D Tractography Point Clouds
Harvard Medical School(哈佛医学院);Brigham and Women’s Hospital(布莱根妇女医院);Massachusetts General Hospital(麻省总医院);The University of Sydney(悉尼大学);University of Electronic Science and Technology of China(电子科技大学);Boston University(波士顿大学);Harvard University(哈佛大学)
ConSEAL: Connectivity-Informed Streamline Endpoint Alignment for Diffeomorphic Cortical Registration
Department of Statistics and Operations Research, The University of North Carolina at Chapel Hill(统计与运筹学系,北卡罗来纳大学教堂山分校);Department of Psychiatry, University of Rochester(精神病学系,罗切斯特大学)
TractGraphFormer: Anatomically Informed Hybrid Graph CNN-Transformer Network for Interpretable Sex and Age Prediction from Diffusion MRI Tractography
Brigham and Women's Hospital, Harvard Medical School(哈佛医学院布莱根妇女医院);University of Electronic Science and Technology of China(电子科技大学);Beth Israel Deaconess Medical Center, Harvard Medical School(哈佛医学院贝斯以色列女执事医疗中心);The University of Sydney(悉尼大学);University of New South Wales(新南威尔士大学);Boston University School of Medicine(波士顿大学医学院);Massachusetts General Hospital, Harvard Medical School(哈佛医学院麻省总医院)
TractoEmbed: Modular Multi-level Embedding framework for white matter tract segmentation
Indian Institute of Technology (IIT) Mandi(印度理工大学曼迪分校);Indian Institute of Technology (IIT) Patna(印度理工大学巴特那分校);Post-Graduate Inst. of Medical Edu. and Research (PGIMER)(医学教育与研究生学院)
TractoSCR: A Novel Supervised Contrastive Regression Framework for Prediction of Neurocognitive Measures Using Multi-Site Harmonized Diffusion MRI Tractography
Brigham and Women’s Hospital(布莱根妇女医院);Harvard Medical School(哈佛医学院);University of Sydney(悉尼大学)
White Matter Geometry-Guided Score-Based Diffusion Model for Tissue Microstructure Imputation in Tractography Imaging
Harvard Medical School(哈佛医学院);School of Computer Science, The University of Sydney(悉尼大学计算机学院);Brigham and Women’s Hospital(布里格姆妇女医院);University of Electronic Science and Technology of China(电子科技大学)
TractoGPT: A GPT architecture for White Matter Segmentation
School of Computing and Electrical Engineering, Indian Institute of Technology Mandi(印度理工大学曼迪分校计算与电气工程学院);Department of Mathematics, Indian Institute of Technology Patna(印度理工大学巴特那分校数学系);Post Graduate Institute of Medical Education Research, Chandigarh(昌迪加尔医学教育与研究研究生院)
TrackletGPT: A Language-like GPT Framework for White Matter Tract Segmentation
School of Computing and Electrical Engineering, Indian Institute of Technology Mandi(计算机与电气工程学院,印度理工学院曼迪);Department of Mathematics, Indian Institute of Technology Patna(数学系,印度理工学院帕纳瓦);Post Graduate Institute of Medical Education Research, Chandigarh(医学教育研究研究生学院,昌迪加尔);SCEE, IIT Mandi(计算机与电气工程学院,印度理工学院曼迪);Department of Mathematics, IIT Patna(数学系,印度理工学院帕纳瓦);PGIMER, Chandigarh(昌迪加尔医学教育研究生院)
Fiber-Flux Diffusion Density for White Matter Tracts Analysis: Application to Mild Anomalies Localization in Contact Sports Players
Ben-Gurion University of the Negev(内盖夫本-古里安大学);The Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev(内盖夫本-古里安大学兹洛托夫斯基神经科学中心);Dalhousie University(达尔豪斯大学)
atTRACTive: Semi-automatic white matter tract segmentation using active learning
German Cancer Research Center (DKFZ)(德国癌症研究中心);Heidelberg University(海德堡大学);German Cancer Consortium (DKTK)(德国癌症联盟);National Center for Tumor Diseases (NCT)(国家肿瘤疾病中心);Heidelberg University Hospital(海德堡大学医院);Helmholtz Information and Data Science School for Health(亥姆霍兹健康信息与数据科学学院)
GeoLab: Geometry-based Tractography Parcellation of Superficial White Matter
Université Paris-Saclay, CEA, Neurospin(巴黎-萨克雷大学,法国原子能委员会,神经自旋);Harvard Medical School(哈佛医学院);University of Sydney(悉尼大学);University College London (UCL)(伦敦大学学院)
A Novel Deep Learning Tractography Fiber Clustering Framework for Functionally Consistent White Matter Parcellation Using Multimodal Diffusion MRI and Functional MRI
University of Electronic Science and Technology of China(电子科技大学);Harvard Medical School(哈佛医学院);Boston University(波士顿大学)
Deep Learning-Based Diffusion MRI Tractography: Integrating Spatial and Anatomical Information
School of Biomedical Engineering, Southern Medical University(南方医科大学生物医学工程学院);School of Computer Science and Technology, Nanjing University of Science and Technology(南京理工大学计算机科学与技术学院);Shunde Hospital, Southern Medical University(南方医科大学顺德医院)
Supervised Tractogram Filtering using Geometric Deep Learning
Fondazione Bruno Kessler(布鲁诺·凯塞勒基金会);Istituto Italiano di Tecnologia(意大利技术研究院);University of Trento(特伦托大学);CNRS(法国国家科学研究中心);CEA(法国原子能和替代能源委员会);Université de Bordeaux(波尔多大学);Azienda Provinciale per i Servizi Sanitari(省卫生服务局);NNAISENSE
BundleSeg: A versatile, reliable and reproducible approach to white matter bundle segmentation
Université du Québec en Outaouais(魁北克大学乌塔韦校区);Vanderbilt University Medical Center(范德堡大学医学中心);Vanderbilt University(范德堡大学);Université de Sherbrooke(舍布鲁克大学)
FIESTA: Autoencoders for accurate fiber segmentation in tractography
Université de Sherbrooke, Canada(舍布鲁克大学,加拿大);Sherbrooke Connectivity Imaging Lab (SCIL)(舍布鲁克连接成像实验室(SCIL));Videos & Images Theory and Analytics Lab (VITAL)(视频与图像理论及分析实验室(VITAL));Department of Computer Science(计算机科学系);Department of Radiology(放射科);Brigham and Women’s Hospital(布莱根妇女医院);Mass General Brigham/Harvard Medical School, USA(麻省总医院布莱根联合/哈佛医学院,美国);Centre de Calcul Scientifique(科学计算中心);Medical Imaging and Neuroinformatic (MINi) Lab(医学成像与神经信息学(MINi)实验室);Groupe d’Imagerie Neurofonctionnelle (GIN)(神经功能成像小组(GIN));CNRS, CEA, IMN, GIN, UMR 5293, F-33000 Bordeaux(法国国家科学研究中心、法国原子能委员会、神经影像研究所、神经功能成像小组、5293号联合研究单位,波尔多);Université de Bordeaux, France(波尔多大学,法国);Pharma Research and Early Development(制药研究与早期开发);Neuroscience and Rare Diseases(神经科学与罕见病);Roche Innovation Center Basel(巴塞尔罗氏创新中心);F. Hoffmann-La Roche Ltd., Basel, Switzerland(F.霍夫曼-罗氏有限公司,巴塞尔,瑞士)
Detailed delineation of the fetal brain in diffusion MRI via multi-task learning
Harvard Medical School(哈佛医学院);Elmhurst Hospital Center(埃尔姆赫斯特医院中心);Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院);Massachusetts General Hospital(麻省总医院);University of California Irvine(加州大学欧文分校)
Fiber Tract Shape Measures Inform Prediction of Non-Imaging Phenotypes
School of Integrated Circuits and Electronics, Beijing Institute of Technology(北京理工大学集成电路与电子学院);Harvard Medical School(哈佛医学院);The University of Sydney(悉尼大学)
White Matter Fiber Segmentation Using Functional Varifolds
Télécom ParisTech(巴黎高等电信学院);Université de Montpellier(蒙彼利埃大学);École de technologie supérieure (ÉTS)(高等技术学院);Inria Paris(法国国家信息与自动化研究所巴黎中心);Sorbonne Universités, UPMC Univ Paris 06(索邦大学,巴黎第六大学);Inserm(法国国家健康与医学研究院);CNRS(法国国家科学研究中心);Institut du cerveau et la moelle (ICM)(脑与脊髓研究所)
From Diagnostic CT to DTI Tractography labels: Using Deep Learning for Corticospinal Tract Injury Assessment and Outcome Prediction in Intracerebral Haemorrhage
University of Manchester(曼彻斯特大学);Johns Hopkins(约翰斯·霍普金斯大学);Salford Royal NHS Foundation Trust(索尔福德皇家国民保健信托基金会);Brainomix(布雷诺米克斯公司);Leiden University(莱顿大学);Isala Zwolle(伊萨拉兹沃勒医疗中心);Radboud University Medical Centre(拉德堡德大学医学中心);King’s College London(伦敦国王学院)