arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.03361cs.CL
收藏

指称博弈中语言与主体的协同进化

Co-evolution of language and agents in referential games

University of Amsterdam(阿姆斯特丹大学);Facebook AI Research(脸书人工智能研究院);University of Osnabrück(奥斯纳布吕克大学)

Gautier Dagan, Dieuwke Hupkes, Elia Bruni

摘要:

参照游戏为神经代理提供了一个接地的学习环境,这说明语言在功能上是用来交流的。然而,他们没有考虑到第二个被认为是人类语言形成的基本限制:它必须是新的语言学习者可以学习的。Cogswell et al.(2019)通过不断变化的代理人群在参考游戏中引入文化传播,以限制新兴语言的可学习性。然而,由此产生的语言仍然固有地受到代理的底层能力的影响。在这项工作中,我们引入语言传输引擎来模拟人口的代理人的文化和建筑的演变。作为我们的核心贡献,我们的经验表明,最佳的情况是考虑到语言学习者的学习偏见,从而让语言和代理共同发展。当我们允许智能体群体通过架构进化来进化时,我们在所有考虑的指标上都实现了全面的改进,并超过了文化传播所带来的收益。这些结果强调了研究潜在的代理架构的重要性,并铺平了道路,以调查语言和代理的共同进化的语言出现研究。

英文摘要:

Referential games offer a grounded learning environment for neural agents which accounts for the fact that language is functionally used to communicate. However, they do not take into account a second constraint considered to be fundamental for the shape of human language: that it must be learnable by new language learners. Cogswell et al. (2019) introduced cultural transmission within referential games through a changing population of agents to constrain the emerging language to be learnable. However, the resulting languages remain inherently biased by the agents' underlying capabilities. In this work, we introduce Language Transmission Engine to model both cultural and architectural evolution in a population of agents. As our core contribution, we empirically show that the optimal situation is to take into account also the learning biases of the language learners and thus let language and agents co-evolve. When we allow the agent population to evolve through architectural evolution, we achieve across the board improvements on all considered metrics and surpass the gains made with cultural transmission. These results stress the importance of studying the underlying agent architecture and pave the way to investigate the co-evolution of language and agent in language emergence studies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑