arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.07144cs.CL
收藏

作为语言模型的语言模型

Language Models as Models of Language

Macquarie University(麦考瑞大学)

Raphaël Millière

AI总结:

本章批判性探讨现代语言模型对理论语言学的潜在价值,回顾实证证据表明其可习得层级句法等语言知识,指出用能力/表现区分否定其相关性为时过早,提出控制条件结合因果干预的实验可约束语言习得假说,呼吁跨学科合作以推动语言天赋论辩论。

摘要:

本章批判性地审视了现代语言模型对理论语言学的潜在贡献。尽管这些模型以工程目标为核心,但它们仅通过接触数据就能获取复杂语言知识的能力,值得我们重新审慎评估其与语言学理论的相关性。笔者回顾了越来越多的实证证据,这些证据表明,即便在发育层面合理的数据量下进行训练,语言模型也能学习层级句法结构,并对各类语言现象表现出敏感性。虽然学界曾援引语言能力/语言表现的区分来否定这类模型与语言学理论的关联,但笔者认为这种论断可能为时过早。通过严格控制学习条件并运用因果干预方法,针对语言模型的实验有望约束关于语言习得与语言能力的假说。笔者总结道,理论语言学家与计算研究者开展更紧密的合作能够产生宝贵洞见,尤其是在推动语言天赋论相关辩论方面。

英文摘要:

This chapter critically examines the potential contributions of modern language models to theoretical linguistics. Despite their focus on engineering goals, these models' ability to acquire sophisticated linguistic knowledge from mere exposure to data warrants a careful reassessment of their relevance to linguistic theory. I review a growing body of empirical evidence suggesting that language models can learn hierarchical syntactic structure and exhibit sensitivity to various linguistic phenomena, even when trained on developmentally plausible amounts of data. While the competence/performance distinction has been invoked to dismiss the relevance of such models to linguistic theory, I argue that this assessment may be premature. By carefully controlling learning conditions and making use of causal intervention methods, experiments with language models can potentially constrain hypotheses about language acquisition and competence. I conclude that closer collaboration between theoretical linguists and computational researchers could yield valuable insights, particularly in advancing debates about linguistic nativism.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑