Understanding communication and information processing among brain regions of interest (ROIs) is highly dependent on long-range connectivity, which plays a crucial role in facilitating diverse functional neural integration across the entire brain. However, previous studies generally focused on the short-range dependencies within brain networks while neglecting the long-range dependencies, limiting an integrated understanding of brain-wide communication. To address this limitation, we propose Adaptive Long-range aware TransformER (ALTER), a brain graph transformer to capture long-range dependencies between brain ROIs utilizing biased random walk. Specifically, we present a novel long-range aware strategy to explicitly capture long-range dependencies between brain ROIs. By guiding the walker towards the next hop with higher correlation value, our strategy simulates the real-world brain-wide communication. Furthermore, by employing the transformer framework, ALERT adaptively integrates both short- and long-range dependencies between brain ROIs, enabling an integrated understanding of multi-level communication across the entire brain. Extensive experiments on ABIDE and ADNI datasets demonstrate that ALTER consistently outperforms generalized state-of-the-art graph learning methods (including SAN, Graphormer, GraphTrans, and LRGNN) and other graph learning based brain network analysis methods (including FBNETGEN, BrainNetGNN, BrainGNN, and BrainNETTF) in neurological disease diagnosis. Cases of long-range dependencies are also presented to further illustrate the effectiveness of ALTER. The implementation is available at https://github.com/yushuowiki/ALTER.
Self-Clustering Graph Transformer Approach to Model Resting-State Functional Brain Activity
Georgia State University(佐治亚州立大学);Tri-Institutional Center for Translational Research in Neuroimaging and Data Science(三方神经成像与数据科学转化研究中心);Georgia Institute of Technology(佐治亚理工学院)
Federation University Australia(澳大利亚联邦大学);Dalian University of Technology(大连理工大学);Zhejiang Gongshang University(浙江工商大学);RMIT University(皇家墨尔本理工大学);Hong Kong Polytechnic University(香港理工大学);Westlake University(西湖大学)
BrainSymphony: A parameter-efficient multimodal foundation model for brain dynamics with limited data
Turner Institute for Brain and Mental Health(大脑与心理健康Turner研究所);School of Psychological Sciences, Monash University(墨尔本大学心理学科学学院);Cortical Labs(皮层实验室);CIFAR Azrieli Global Scholars Program(CIFAR阿兹里埃利全球学者计划)
Joint rotational invariance and adversarial training of a dual-stream Transformer yields state of the art Brain-Score for Area V4
The Center for Brains, Minds and Machines(大脑、心智与机器中心);Massachusetts Institute of Technology(麻省理工学院)
现代在大脑评分竞赛中获得高分的视觉模型并不源于Vision Transformers。然而,在本文中,我们通过展示双流Transformer,CrossViT $~\textit{a la}$ Chen et al.(2021),在联合旋转不变和对抗优化程序下,在2022年总Brain-Score竞赛中获得第二名,提供了反对Vision Transformers(ViT)在感知上与人类视觉表示不一致的意外趋势的证据(Schrimpf et al.,2020 b)在所有视觉类别中平均,并且在比赛时在V4区域的最高可解释方差中排名第一。此外,我们目前的基于变换器的模型还实现了区域V4、IT和行为的更大的可解释方差,而不是生物启发的CNN(ResNet 50),其集成了类似于额叶V1的计算模块(Dapello等人,2020年)。为了评估优化方案对CrossViT架构的贡献,我们对不同优化的CrossViT的对抗鲁棒性,常见的腐败基准,中腹部刺激解释和特征反转进行了几次额外的实验。与我们最初的预期,我们的家庭的结果提供了临时支持$\textit{"All roads lead to Rome"}$参数通过联合优化规则,即使是非生物学动机的模型,如Vision Transformers的视觉。代码可在https://github.com/williamberrios/BrainScore-T…
EEG-Deformer: A Dense Convolutional Transformer for Brain-computer Interfaces
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);East China University of Science and Technology(华东理工大学);Wilmar International(丰益国际)
Department of Electrical and Computer Engineering, Auburn University(电气与计算机工程系,阿伯杜大学);Department of Computer Science, Emory University(计算机科学系,埃默里大学);Department of Neurology, Emory University(神经病学系,埃默里大学);Department of Radiology and Imaging Sciences, Emory University(放射学与成像科学系,埃默里大学)
Brain network science modelling of sparse neural networks enables Transformers and LLMs to perform as fully connected
Center for Complex Network Intelligence (CCNI)(复杂网络智能研究中心);Dept. of Computer Science & Technology(计算机科学与技术系);School of Biomedical Engineering(生物医学工程学院);University of Padova(帕多瓦大学);Canva Research(Canva研究)
Brain-to-Speech: Prosody Feature Engineering and Transformer-Based Reconstruction
Department of Telecommunications and Artificial Intelligence, Budapest University of Technology and Economics(布达佩斯技术与经济大学电信与人工智能系);EuroMov Digital Health in Motion, University of Montpellier, IMT Mines Alès(蒙彼利埃大学 EuroMov 数字健康运动实验室,IMT 阿莱斯矿业学院)
Residual Vision Transformer (ResViT) Based Self-Supervised Learning Model for Brain Tumor Classification
Center for Diabetes Technology(糖尿病技术中心);University of Virginia(弗吉尼亚大学);Erciyes University(埃尔齐耶斯大学);Biocomplexity Institute and Initiative(生物复杂性研究所与倡议项目)
EEG-based AI-BCI Wheelchair Advancement: Transformer-Based Learning with Motor Imagery for Brain Computer Interface
Department of Computer Science and Engineering, Kathmandu University(加德满都大学计算机科学与工程系);Department of Electronics and Communication Engineering, Nepal Engineering College, Pokhara University(博卡拉大学尼泊尔工程学院电子与通信工程系);Department of Applied Sciences and Chemical Engineering, Institute of Engineering, Pulchowk Campus, Tribhuvan University(特里布万大学工程学院普尔乔克校区应用科学与化学工程系)
Training Compute-Optimal Vision Transformers for Brain Encoding
Concordia University(康考迪亚大学);Université de Montréal(蒙特利尔大学);Centre de Recherche de L’Institut Universitaire de Gériatrie de Montréal(蒙特利尔大学老年医学研究所研究中心)
Understanding Auditory Evoked Brain Signal via Physics-informed Embedding Network with Multi-Task Transformer
School of Mathematics, Southwest Jiaotong University(西南交通大学数学学院);School of Computer, SWJTU-Leeds Joint School(西南交通大学-利兹学院计算机学院);School of Computing and Artificial Intelligence, Southwest Jiaotong University(西南交通大学计算机与人工智能学院);Chengdu University of Technology Oxford Brookes College(成都理工大学牛津布鲁克斯学院)
STARFormer: A Novel Spatio-Temporal Aggregation Reorganization Transformer of FMRI for Brain Disorder Diagnosis
Laboratory of Digital Image and Intelligent Computation, College of Information Engineering, Shanghai Maritime University(数字图像与智能计算实验室,信息工程学院,上海 Maritime 大学);Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University(中英双语研究部,香港理工大学);Department of Neurology, Affiliated Lianyungang Hospital of Xuzhou Medical University(神经科,徐州医学院附属连云港医院)
针对 fMRI 脑疾病分类忽略时空依赖的问题,提出 STARFormer,通过 ROI 空间重组、时间特征重组和时空融合三个模块,在 ASD 和 ADHD 数据集上达到最先进性能。