By the age of two, children tend to assume that new word categories are based on objects' shape, rather than their color or texture; this assumption is called the shape bias. They are thought to learn this bias by observing that their caregiver's language is biased towards shape based categories. This presents a chicken and egg problem: if the shape bias must be present in the language in order for children to learn it, how did it arise in language in the first place? In this paper, we propose that communicative efficiency explains both how the shape bias emerged and why it persists across generations. We model this process with neural emergent language agents that learn to communicate about raw pixelated images. First, we show that the shape bias emerges as a result of efficient communication strategies employed by agents. Second, we show that pressure brought on by communicative need is also necessary for it to persist across generations; simply having a shape bias in an agent's input language is insufficient. These results suggest that, over and above the operation of other learning strategies, the shape bias in human learners may emerge and be sustained by communicative pressures.
Simulating the Emergence of Differential Case Marking with Communicating Neural-Network Agents
Faculty of Electronic and Information Engineering, Xi’an Jiaotong University(西安交通大学电子与信息工程学院);Leiden Institute of Advanced Computer Science, Leiden University(莱顿大学高级计算机科学研究所);Center for Language and Cognition, University of Groningen(格罗宁根大学语言与认知中心)
Scale Can't Overcome Pragmatics: The Impact of Reporting Bias on Vision-Language Reasoning
University of Washington(华盛顿大学);University of California, Los Angeles(加州大学洛杉矶分校);Samaya AI(Samaya人工智能);Mistral AI(Mistral人工智能);Allen Institute for AI(人工智能研究所)
Technical University of Madrid(马德里理工大学);Queen Mary University of London(伦敦玛丽女王大学);Telefonica Research(西班牙电信研究院);Universitat Politècnica de Catalunya(加泰罗尼亚理工大学)
Learning and communication pressures in neural networks: Lessons from emergent communication
Centre for Machine Learning(机器学习中心);University of Southern Denmark (SDU)(南丹麦大学);Max Planck Institute for Psycholinguistics(马克斯·普朗克心理语言学研究所);University of Glasgow(格拉斯哥大学)
Simulating a Bias Mitigation Scenario in Large Language Models
Department of Computer Science, Bowling Green State University(计算机科学系,布恩维尔州立大学);School of Computing, University of Nebraska–Lincoln(计算学院,内布拉斯加-林肯大学);Department of Civil, Environmental, and Ocean Engineering, Stevens Institute of Technology(土木、环境与海洋工程系,史蒂文斯理工学院);Department of Computer Science, University of South Carolina(计算机科学系,南卡罗来纳大学);Artificial Intelligence Institute, University of South Carolina(人工智能研究院,南卡罗来纳大学)