arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.04474cs.AI
收藏

面向规则推理的涌现通信

Emergent Communication for Rules Reasoning

University of Science and Technology of China(中国科学技术大学);State Key Lab of Processors, Institute of Computing Technolgy, CAS(中国科学院计算技术研究所处理器国家重点实验室);Cambricon Technologies(寒武纪科技);Shanghai Innovation Center for Processor Technologies(上海处理器技术创新中心);Intelligent Software Research Center, Institute of Software, CAS(中国科学院软件研究所智能软件研究中心);University of Chinese Academy of Sciences(中国科学院大学)
Yuxuan Guo, Yifan Hao, Rui Zhang, Enshuai Zhou, Zidong Du, Xishan Zhang, Xinkai Song, Yuanbo Wen, Yongwei Zhao, Xuehai Zhou, Jiaming Guo, Qi Yi, Shaohui Peng, D… 展开作者

Yuxuan Guo, Yifan Hao, Rui Zhang, Enshuai Zhou, Zidong Du, Xishan Zhang, Xinkai Song, Yuanbo Wen, Yongwei Zhao, Xuehai Zhou, Jiaming Guo, Qi Yi, Shaohui Peng, Di Huang, Ruizhi Chen, Qi Guo, Yunji Chen

AI总结:

针对现有涌现通信研究多聚焦感知导向环境的问题,本文提出认知导向的推理游戏环境、无偏基准数据集rule-RAVEN及两阶段课程训练方法,验证了推理场景下可涌现语义稳定的组合性语言,助力规则泛化与迁移。

摘要:

基于深度学习的智能体之间涌现通信的研究因对语言学和人工智能具有启发意义而受到广泛关注。但以往的研究多围绕感知导向环境设置下的通信涌现展开,这类设置迫使智能体描述图像或符号语境中的低层感知特征。受经典人类推理测试(即Raven's Progressive Matrix,瑞文推理测验)的启发,本文提出了“推理游戏”(Reasoning Game)这一认知导向环境,鼓励智能体对高层规则进行推理和交流,而非感知到的低层语境。此外,本文还提出:1)一个无偏数据集(即rule-RAVEN)作为基准以避免过拟合;2)一种两阶段课程式智能体训练方法,作为在语境与语义双向漂移的推理游戏中实现更稳定收敛的基线。实验结果表明,在推理游戏中会涌现出一种语义稳定且具有组合性的语言来解决推理问题。这种涌现出的语言有助于智能体将提取到的规则应用于未见过的语境属性的泛化,以及不同语境属性甚至不同任务之间的迁移。

英文摘要:

Research on emergent communication between deep-learning-based agents has received extensive attention due to its inspiration for linguistics and artificial intelligence. However, previous attempts have hovered around emerging communication under perception-oriented environmental settings, that forces agents to describe low-level perceptual features intra image or symbol contexts. In this work, inspired by the classic human reasoning test (namely Raven's Progressive Matrix), we propose the Reasoning Game, a cognition-oriented environment that encourages agents to reason and communicate high-level rules, rather than perceived low-level contexts. Moreover, we propose 1) an unbiased dataset (namely rule-RAVEN) as a benchmark to avoid overfitting, 2) and a two-stage curriculum agent training method as a baseline for more stable convergence in the Reasoning Game, where contexts and semantics are bilaterally drifting. Experimental results show that, in the Reasoning Game, a semantically stable and compositional language emerges to solve reasoning problems. The emerged language helps agents apply the extracted rules to the generalization of unseen context attributes, and to the transfer between different context attributes or even tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑