In this work we propose HAMLET, a novel tract learning algorithm, which, after training, maps raw diffusion weighted MRI directly onto an image which simultaneously indicates tract direction and tract presence. The automatic learning of fiber tracts based on diffusion MRI data is a rather new idea, which tries to overcome limitations of atlas-based techniques. HAMLET takes a such an approach. Unlike the current trend in machine learning, HAMLET has only a small number of free parameters HAMLET is based on spherical tensor algebra which allows a translation and rotation covariant treatment of the problem. HAMLET is based on a repeated application of convolutions and non-linearities, which all respect the rotation covariance. The intrinsic treatment of such basic image transformations in HAMLET allows the training and generalization of the algorithm without any additional data augmentation. We demonstrate the performance of our approach for twelve prominent bundles, and show that the obtained tract estimates are robust and reliable. It is also shown that the learned models are portable from one sequence to another.
TractCloud-FOV: Deep Learning-based Robust Tractography Parcellation in Diffusion MRI with Incomplete Field of View
Harvard Medical School(哈佛医学院);Harvard University(哈佛大学);The University of Sydney(悉尼大学);Massachusetts General Hospital(麻省总医院);University of Electronic Science and Technology of China(电子科技大学);Harvard-MIT Health Sciences and Technology(哈佛-麻省理工健康科学与技术部)
Open-Source Manually Annotated Vocal Tract Database for Automatic Segmentation from 3D MRI Using Deep Learning: Benchmarking 2D and 3D Convolutional and Transformer Networks
University of Iowa(爱荷华大学);Shenandoah University(谢南多厄大学)
TractoSCR: A Novel Supervised Contrastive Regression Framework for Prediction of Neurocognitive Measures Using Multi-Site Harmonized Diffusion MRI Tractography
Brigham and Women’s Hospital(布莱根妇女医院);Harvard Medical School(哈佛医学院);University of Sydney(悉尼大学)
TractGraphFormer: Anatomically Informed Hybrid Graph CNN-Transformer Network for Interpretable Sex and Age Prediction from Diffusion MRI Tractography
Brigham and Women's Hospital, Harvard Medical School(哈佛医学院布莱根妇女医院);University of Electronic Science and Technology of China(电子科技大学);Beth Israel Deaconess Medical Center, Harvard Medical School(哈佛医学院贝斯以色列女执事医疗中心);The University of Sydney(悉尼大学);University of New South Wales(新南威尔士大学);Boston University School of Medicine(波士顿大学医学院);Massachusetts General Hospital, Harvard Medical School(哈佛医学院麻省总医院)
A Novel Deep Learning Tractography Fiber Clustering Framework for Functionally Consistent White Matter Parcellation Using Multimodal Diffusion MRI and Functional MRI
University of Electronic Science and Technology of China(电子科技大学);Harvard Medical School(哈佛医学院);Boston University(波士顿大学)
VocSegMRI: Multimodal Learning for Precise Vocal Tract Segmentation in Real-time MRI
Friedrich-Alexander-Universität Erlangen-Nürnberg(弗里德里希-亚历山大-埃朗根-纽伦堡大学);University of Maryland School of Dentistry(马里兰大学牙科学院);Harvard Medical School/Massachusetts General Hospital(哈佛医学院/麻省总医院);Universidad de Antioquia UdeA(安蒂奥基亚大学 UdeA);Johns Hopkins University(约翰霍普金斯大学);Leibniz University Hannover(汉诺威莱布尼茨大学)
Deep Learning-Based Diffusion MRI Tractography: Integrating Spatial and Anatomical Information
School of Biomedical Engineering, Southern Medical University(南方医科大学生物医学工程学院);School of Computer Science and Technology, Nanjing University of Science and Technology(南京理工大学计算机科学与技术学院);Shunde Hospital, Southern Medical University(南方医科大学顺德医院)
AGFS-Tractometry: A Novel Atlas-Guided Fine-Scale Tractometry Approach for Enhanced Along-Tract Group Statistical Comparison Using Diffusion MRI Tractography
University of Electronic Science and Technology of China(电子科技大学);Brigham and Women’s Hospital, Harvard Medical School(哈佛医学院布里奇曼妇女医院);Boston University(波士顿大学)
Field-of-View Extension for Brain Diffusion MRI via Deep Generative Models
Vanderbilt University(范德堡大学);Vanderbilt University Medical Center(范德堡大学医学中心);University of Washington(华盛顿大学);University of Wisconsin School of Medicine and Public Health(威斯康星大学医学院与公共卫生学院);University of Southern California(南加州大学)
Speech Audio Generation from dynamic MRI via a Knowledge Enhanced Conditional Variational Autoencoder
Department of Computer Science, The University of Hong Kong(香港大学计算机科学系);School of Software Engineering, Xi'an Jiaotong University(西安交通大学软件工程学院);Wake Forest University School of Medicine(威克森林大学医学学院);Department of Radiology, Harvard Medical School(哈佛医学院放射科)
SIREM: Speech-Informed MRI Reconstruction with Learned Sampling
Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg(埃森哲-埃尔朗根-纽伦堡大学模式识别实验室);Institute of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔朗根大学医院放射学研究所);Institut für Informationsverarbeitung, Leibniz Universität Hannover(汉诺威莱比锡大学信息处理研究所);Department of Radiology, Harvard Medical School and Massachusetts General Hospital(哈佛医学院放射科和麻省总医院)
Detailed delineation of the fetal brain in diffusion MRI via multi-task learning
Harvard Medical School(哈佛医学院);Elmhurst Hospital Center(埃尔姆赫斯特医院中心);Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院);Massachusetts General Hospital(麻省总医院);University of California Irvine(加州大学欧文分校)
Self-Supervised Diffusion MRI Denoising via Iterative and Stable Refinement
School of Biomedical Engineering, Division of Life Sciences and Medicine, USTC(中国科学技术大学生命科学与医学部生物医学工程学院);MIRACLE Center, Suzhou Institute for Advance Research, USTC(中国科学技术大学苏州研究院MIRACLE中心);State Key Laboratory of Precision and Intelligent Chemistry, USTC(中国科学技术大学精准与智能化学国家重点实验室);Key Laboratory of Intelligent Information Processing of CAS, Institute of Computing Technology, CAS(中国科学院计算技术研究所中国科学院智能信息处理重点实验室)
A Novel Streamline-based diffusion MRI Tractography Registration Method with Probabilistic Keypoint Detection
University of Electronic Science and Technology of China(电子科技大学);Nanjing University of Science and Technology(南京理工大学);Harvard Medical School(哈佛医学院);Brigham and Women’s Hospital(布莱根和妇女医院)
HARP: HARmonizing in-vivo diffusion MRI using Phantom-only training
Department of Psychiatry(精神医学系);Brigham and Women's Hospital(布里奇沃特医院);Harvard Medical School(哈佛医学院);College of Engineering(工程学院);Northeastern University(东北大学);National Institute of Standards and Technology(国家标准技术研究院);University of Utah School of Medicine(犹他大学医学院);George E. Wahlen Veterans Affairs Medical Center(乔治·E·瓦伦的退伍军人事务医疗中心);University of Pittsburgh(匹兹堡大学);Department of Radiology(放射医学系);Harvard-MIT Health Sciences and Technology(哈佛-麻省理工健康科学与技术)
Diff5T: Benchmarking Human Brain Diffusion MRI with an Extensive 5.0 Tesla K-Space and Spatial Dataset
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Beihang University(北京航空航天大学);United-Imaging Healthcare(联影医疗);Tsinghua University(清华大学);Beijing Chaoyang Hospital, Capital Medical University(首都医科大学附属北京朝阳医院);Zhejiang University of Technology(浙江工业大学);University of Electronic Science and Technology of China(电子科技大学)
A Speech-to-Video Synthesis Approach Using Spatio-Temporal Diffusion for Vocal Tract MRI
Harvard Medical School/Massachusetts General Hospital(哈佛医学院/麻省总医院);Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学);Universidad de Antioquia(安蒂奥基亚大学);Yale University(耶鲁大学);University of Maryland School of Dentistry(马里兰大学牙科学院);University Hospital Erlangen(埃尔朗根大学医院);Johns Hopkins University(约翰斯·霍普金斯大学)
DDTracking: A Deep Generative Framework for Diffusion MRI Tractography with Streamline Local-Global Spatiotemporal Modeling
University of Electronic Science and Technology of China(电子科技大学);Nanjing University of Science and Technology(南京理工大学);Brigham and Women’s Hospital(布里奇沃特医院);Harvard Medical School(哈佛医学院)
A Novel Dual-Stream Framework for dMRI Tractography Streamline Classification with Joint dMRI and fMRI Data
University of Electronic Science and Technology of China(电子科技大学);Zhejiang University of Technology(浙江工业大学);University of Tel Aviv(特拉维夫大学);Harvard Medical School(哈佛医学院)
DeepMultiConnectome: Deep Multi-Task Prediction of Structural Connectomes Directly from Diffusion MRI Tractography
Eindhoven University of Technology(埃因霍温理工大学);Brigham and Women’s Hospital(布莱尔妇女医院);Harvard Medical School(哈佛医学院);The University of Sydney(悉尼大学);University of Electronic Science and Technology of China(电子科技大学);Harvard-MIT Health Sciences and Technology(哈佛-麻省理工健康科学与技术)
A Multilinear Tongue Model Derived from Speech Related MRI Data of the Human Vocal Tract
Saarland University(萨尔兰大学);German Research Center for Artificial Intelligence (DFKI GmbH)(德国人工智能研究中心(DFKI GmbH));INRIA Grenoble Rhône-Alpes(法国国家信息与自动化研究所格勒诺布尔-罗纳-阿尔卑斯分部);University of Edinburgh(爱丁堡大学)
Speech-Guided Multimodal Learning for Vocal Tract Segmentation in Real-Time MRI
Harvard Medical School / Massachusetts General Hospital(哈佛医学院/麻省总医院);Institute for Information Processing, Leibniz University Hannover(汉诺威莱布尼茨信息处理研究所);GITA Lab, Facultad de Ingeniería. Universidad de Antioquia UdeA(安提奥基亚大学工程学院GITA实验室)
A Multimodal Deep Learning Approach for White Matter Shape Prediction in Diffusion MRI Tractography
Harvard Medical School(哈佛医学院);The University of Sydney(悉尼大学);Harvard University(哈佛大学);Massachusetts General Hospital(麻省总医院);Boston University(波士顿大学);Harvard-MIT Health Sciences and Technology(哈佛-麻省理工学院健康科学与技术)