Language-brain encoding experiments evaluate the ability of language models to predict brain responses elicited by language stimuli. The evaluation scenarios for this task have not yet been standardized which makes it difficult to compare and interpret results. We perform a series of evaluation experiments with a consistent encoding setup and compute the results for multiple fMRI datasets. In addition, we test the sensitivity of the evaluation measures to randomized data and analyze the effect of voxel selection methods. Our experimental framework is publicly available to make modelling decisions more transparent and support reproducibility for future comparisons.
Deep Neural Networks and Brain Alignment: Brain Encoding and Decoding (Survey)
Inria Bordeaux(法国国家信息与自动化研究所波尔多分所);LaBRI, Université de Bordeaux(波尔多大学拉布里实验室);Université de Bordeaux(波尔多大学);TU Berlin(柏林工业大学);National University of Singapore(新加坡国立大学);Microsoft(微软公司);International Institute of Information Technology Hyderabad(海得拉巴国际信息技术研究所);CEA(法国原子能和替代能源委员会);CNRS(法国国家科学研究中心)
Large Language Model-based FMRI Encoding of Language Functions for Subjects with Neurocognitive Disorder
The Chinese University of Hong Kong(香港中文大学);Stanley Ho Big Data Decision Analytics Research Centre, The Chinese University of Hong Kong(香港中文大学何文汇大数据决策分析研究中心)
Independent-Component-Based Encoding Models of Brain Activity During Story Comprehension
School of Electrical and Computer Engineering, Georgia Institute of Technology(佐治亚理工学院电子与计算机工程学院);School of Psychological and Brain Sciences, Georgia Institute of Technology(佐治亚理工学院心理学与脑科学学院);Department of Linguistics, Stanford University(斯坦福大学语言学系)
LinBridge: A Learnable Framework for Interpreting Nonlinear Neural Encoding Models
School of Automation, Northwestern Polytechnical University(西北工业大学自动化学院);School of Software Engineering, Beijing Jiaotong University(北京交通大学软件学院);School of Bioinformatics, Chongqing University of Posts and Telecommunications(重庆邮电大学生物信息学院)