arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.21713cs.LGcs.AI
收藏

通过与其他智能体交互进行社会学习:综述

Social Learning through Interactions with Other Agents: A Survey

Institute of High Performance Computing, A*STAR(高性能计算研究所(新加坡科技研究局));Singapore Management University(新加坡管理大学)

Dylan Hillier, Cheston Tan, Jing Jiang

AI总结:

本文综述机器学习尤其是具身智能体中的社会学习方法,梳理模仿、人类反馈学习与智能体间交流,并指出缺乏将这些技术统一整合的研究。

摘要:

社会学习在人类智能的发展中发挥着重要作用。童年时期,我们模仿父母的言语模式,直到能够发出声音;我们从他们的表扬与批评中学习;成年后,我们通过与他人合作来学习。在本研究中,我们综述了“社会学习”这一范式在机器学习中被复现的程度。特别是,由于社会性学习需要与他人互动,我们关注具身智能体如何能够以及已经如何利用这些技术。这一关注尤其基于自然语言处理(NLP)的最新进展在多大程度上使我们能够实现新形式的社会学习。我们考察了行为克隆和下一 token 预测如何对应人类的模仿,从人类反馈中学习如何对应人类的教育,以及我们如何更进一步,实现能够彼此学习的、具备完整交流能力的智能体。我们发现,尽管单项社会学习技术已得到成功应用,但几乎没有统一性研究说明如何将它们整合为社会性具身智能体。

英文摘要:

Social learning plays an important role in the development of human intelligence. As children, we imitate our parents' speech patterns until we are able to produce sounds; we learn from them praising us and scolding us; and as adults, we learn by working with others. In this work, we survey the degree to which this paradigm -- social learning -- has been mirrored in machine learning. In particular, since learning socially requires interacting with others, we are interested in how embodied agents can and have utilised these techniques. This is especially in light of the degree to which recent advances in natural language processing (NLP) enable us to perform new forms of social learning. We look at how behavioural cloning and next-token prediction mirror human imitation, how learning from human feedback mirrors human education, and how we can go further to enable fully communicative agents that learn from each other. We find that while individual social learning techniques have been used successfully, there has been little unifying work showing how to bring them together into socially embodied agents.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑