The effect of syntactic priming exhibits three well-documented empirical properties: the lexical boost, the inverse frequency effect, and the asymmetrical decay. We aim to show how these three empirical phenomena can be reconciled in a general learning framework, the hierarchical Bayesian model (HBM). The model represents syntactic knowledge in a hierarchical structure of syntactic statistics, where a lower level represents the verb-specific biases of syntactic decisions, and a higher level represents the abstract bias as an aggregation of verb-specific biases. This knowledge is updated in response to experience by Bayesian inference. In simulations, we show that the HBM captures the above-mentioned properties of syntactic priming. The results indicate that some properties of priming which are usually explained by a residual activation account can also be explained by an implicit learning account. We also discuss the model's implications for the lexical basis of syntactic priming.
The Emergence of Chunking Structures with Hierarchical RNN
University of Alberta/Amii(阿尔伯塔大学/Amii);University of Waterloo(滑铁卢大学);Alberta Machine Intelligence Institute (Amii)(阿尔伯塔机器智能研究所(Amii));Huawei Poisson Lab(华为Poisson实验室)
Hierarchical Frequency Tagging Probe (HFTP): A Unified Approach to Investigate Syntactic Structure Representations in Large Language Models and the Human Brain
Peking University(北京大学);Zhejiang University(浙江大学);Beijing Language and Culture University(北京语言大学);Beijing Institute for General Artificial Intelligence(北京通用人工智能研究院)
Structure leads and dominates comprehension in naturalistic reading
Department of Brain and Cognitive Sciences, University of Rochester(罗切斯特大学脑科学与认知科学系);Department of Linguistics and Modern Languages, the Chinese University of Hong Kong(香港中文大学语言学与现代语言系);Department of Language Science, University of California Irvine(加州大学 Irvine 分校语言科学系)
Finding Syntactic Representations in Neural Stacks
Yale University(耶鲁大学);Allen Institute for Artificial Intelligence(艾伦人工智能研究所)
神经网络体系结构已经用可微堆栈进行了扩充,以便引入对学习层次敏感的神经网络的偏好。然而,事实证明,很难评估这种偏差的有效程度,因为可微堆栈的操作并不总是可解释的。在本文中,我们试图通过对选区结构的无监督学习的探索来检测分层结构的潜在表征的存在。使用Shen et al.(2018a,b)的技术,我们从基于语言建模和分类目标训练的堆栈RNN的推送行为中提取语法树。我们发现,我们的模型产生的解析,反映了自然语言句法选区,证明堆栈RNN确实推断语言相关的层次结构。