In this paper, we trace the history of neural networks applied to natural language understanding tasks, and identify key contributions which the nature of language has made to the development of neural network architectures. We focus on the importance of variable binding and its instantiation in attention-based models, and argue that Transformer is not a sequence model but an induced-structure model. This perspective leads to predictions of the challenges facing research in deep learning architectures for natural language understanding.
How Human-Like Are Large Language Models? A Register-Aware Linguistic Evaluation Framework
Department Artificial Intelligence in Biomedical Engineering (AIBE)(人工智能生物医学工程系);Department of Digital Humanities and Social Studies (DHSS)(数字人文与社会科学系);University of Birmingham(伯明翰大学);Chair of AI-supported Therapy Decisions(人工智能支持治疗决策教授职位);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Institute of AI for Health, Helmholtz Zentrum München(健康人工智能研究所,海德堡中心慕尼黑)
Putting a Spin on Language: A Quantum Interpretation of Unary Connectives for Linguistic Applications
Institute for Theoretical Physics(理论物理研究所);Center for Complex Systems Studies(复杂系统研究中心);Utrecht University(乌得勒支大学);Utrecht Institute of Linguistics OTS(乌得勒支语言学研究所OTS)
When Words Speak Louder than Images: Towards Understanding Language Bias in Vision-Language Models
University of Waterloo(滑铁卢大学);Johns Hopkins University(约翰霍普金斯大学);University of California, Santa Barbara(加州大学圣塔芭芭拉分校);Nanyang Technological University(南洋理工大学);Indiana University(印第安纳大学)
Language and Mental Health: Measures of Emotion Dynamics from Text as Linguistic Biosocial Markers
University of Alberta(阿尔伯塔大学);Alberta Machine Intelligence Institute (Amii)(阿尔伯塔机器智能研究所);LMU Munich(慕尼黑大学);Carleton University(卡尔顿大学);National Research Council Canada(加拿大国家研究委员会)
Institute for Cross-Disciplinary Physics and Complex Systems IFISC (UIB-CSIC)(跨学科物理与复杂系统研究所IFISC(巴利阿里群岛大学-西班牙国家研究委员会));Centro de Investigaciones Ópticas (CONICET La Plata-CIC-UNLP)(光学研究中心(拉普拉塔国家科学技术研究委员会-拉普拉塔文化与科学研究中心-拉普拉塔国立大学));Departamento de Ciencias Básicas, Facultad de Ingeniería, Universidad Nacional de La Plata (UNLP)(拉普拉塔国立大学工程学院基础科学系)
A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directions
MBZUAI(Mohamed bin Zayed 人工智能大学);German International University, Egypt(德国国际大学);University of Stuttgart(斯图加特大学);University of Houston(休斯顿大学);New York University Abu Dhabi(纽约大学阿布扎比分校)
Automated Speech Scoring System Under The Lens: Evaluating and interpreting the linguistic cues for language proficiency
Columbia University(哥伦比亚大学);Second Language Testing, Inc.(第二语言测试公司);Indraprastha Institute of Information Technology, Delhi(德里印多尔信息科技学院);SUNY at Buffalo(布法罗纽约州立大学);Adobe Media Data Science Research(奥多比媒体数据科学研究中心)
Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Ahead
Saarland University, Saarland Informatics Campus(萨尔兰大学,萨尔兰信息学校区);LMU Munich and Munich Center for Machine Learning(慕尼黑大学及慕尼黑机器学习中心);Mila - Quebec AI Institute, McGill University & Canada CIFAR AI Chair(魁北克人工智能研究所,麦吉尔大学及加拿大 CIFAR 人工智能 chair)
Sifting Robotic from Organic Text: A Natural Language Approach for Detecting Automation on Twitter
Vermont Complex Systems Center(佛蒙特复杂系统中心);Vermont Center for Behavior and Health(佛蒙特行为与健康中心);Vermont Center for Clinical and Translational Science(佛蒙特临床与转化科学中心)
Revealing semantic and emotional structure of suicide notes with cognitive network science
INESC-ID(INESC-ID研究所);Indiana Network Science Institute, Indiana University(印第安纳大学印第安纳网络科学研究所);Hospital da Luz Learning Health, Luz Saúde(卢兹健康卢兹医院学习健康中心);University of Warsaw(华沙大学);University of Kansas(堪萨斯大学);University of Exeter(埃克塞特大学);Complex Science Consulting(复杂科学咨询公司)
A POS Tier Is the Key to Automated Annotation for Low-Resource Language Documentation: Neural Interlinear Glossing for Irabu, a Southern Ryukyuan Language