To understand the algorithm that supports the human brain's language representation, previous research has attempted to predict neural responses to linguistic stimuli using embeddings generated by artificial neural networks (ANNs), a process known as neural encoding. However, most of these studies have focused on probing neural representations of Germanic languages, such as English, with unsupervised ANNs. In this paper, we propose to bridge the gap between human brain and supervised ANN representations of the Chinese language. Specifically, we investigate how task tuning influences a pretained Transformer for neural encoding and which tasks lead to the best encoding performances. We generate supervised representations on eight Natural Language Understanding (NLU) tasks using prompt-tuning, a technique that is seldom explored in neural encoding for language. We demonstrate that prompt-tuning yields representations that better predict neural responses to Chinese stimuli than traditional fine-tuning on four tasks. Furthermore, we discover that tasks that require a fine-grained processing of concepts and entities lead to representations that are most predictive of brain activation patterns. Additionally, we reveal that the proportion of tuned parameters highly influences the neural encoding performance of fine-tuned models. Overall, our experimental findings could help us better understand the relationship between supervised artificial and brain language representations.
Encoding Knowledge Graph Entity Aliases in Attentive Neural Network for Wikidata Entity Linking
Fraunhofer IAIS, University of Bonn, Germany(德国波恩大学弗劳恩霍夫研究所人工智能研究所(Fraunhofer IAIS));Cerence GmbH, and Zerotha Research, Germany(德国Cerence GmbH公司,以及Zerotha Research);TIB, Hannover, Germany(德国汉诺威技术信息中心(TIB));University of Dayton, USA(美国代顿大学)
Large Language Model-based FMRI Encoding of Language Functions for Subjects with Neurocognitive Disorder
The Chinese University of Hong Kong(香港中文大学);Stanley Ho Big Data Decision Analytics Research Centre, The Chinese University of Hong Kong(香港中文大学何文汇大数据决策分析研究中心)
Deep Neural Networks and Brain Alignment: Brain Encoding and Decoding (Survey)
Inria Bordeaux(法国国家信息与自动化研究所波尔多分所);LaBRI, Université de Bordeaux(波尔多大学拉布里实验室);Université de Bordeaux(波尔多大学);TU Berlin(柏林工业大学);National University of Singapore(新加坡国立大学);Microsoft(微软公司);International Institute of Information Technology Hyderabad(海得拉巴国际信息技术研究所);CEA(法国原子能和替代能源委员会);CNRS(法国国家科学研究中心)
Independent-Component-Based Encoding Models of Brain Activity During Story Comprehension
School of Electrical and Computer Engineering, Georgia Institute of Technology(佐治亚理工学院电子与计算机工程学院);School of Psychological and Brain Sciences, Georgia Institute of Technology(佐治亚理工学院心理学与脑科学学院);Department of Linguistics, Stanford University(斯坦福大学语言学系)
LinBridge: A Learnable Framework for Interpreting Nonlinear Neural Encoding Models
School of Automation, Northwestern Polytechnical University(西北工业大学自动化学院);School of Software Engineering, Beijing Jiaotong University(北京交通大学软件学院);School of Bioinformatics, Chongqing University of Posts and Telecommunications(重庆邮电大学生物信息学院)
Neural Entity Linking: A Survey of Models Based on Deep Learning
Universität Hamburg(汉堡大学);Skolkovo Institute of Science and Technology(斯科尔科沃科学技术研究院);Lomonosov Moscow State University(莫斯科罗蒙诺索夫国立大学);AIRI(AIRI(人工智能研究所));Moscow Institute of Physics and Technology(莫斯科物理技术学院);FIZ Karlsruhe - Leibniz Institute for Information Infrastructure(FIZ卡尔斯鲁厄——莱布尼茨信息基础设施研究所);Université Sorbonne Paris Nord(巴黎索邦北大学);Vrije University of Amsterdam(阿姆斯特丹自由大学);The Open University(开放大学);University of Cagliari(卡利亚里大学)