arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1809.06194cs.CL
收藏

快速而灵活:训练神经网络学习遵循小数据的指令

The Fast and the Flexible: training neural networks to learn to follow instructions from small data

University of Amsterdam(阿姆斯特丹大学);Facebook AI(Facebook人工智能(实验室)/Facebook AI Research(FAIR)(注:根据机构常见译法,Facebook AI通常译为Facebook人工智能或Facebook AI研究实验室))

Rezka Leonandya, Elia Bruni, Dieuwke Hupkes, Germán Kruszewski

摘要:

学习遵循人类指令是人工智能长期追求的目标。如果假设没有所用语言的先验知识,而只依靠少数例子来学习,那么这项任务就变得特别具有挑战性。过去的工作依赖于手工编码的组件或手工设计的功能,以提供强大的归纳偏差,使在这种情况下学习成为可能。相比之下,在这里,我们试图建立这种知识是否可以自动获取的神经网络系统通过两个阶段的训练过程:(慢)离线学习阶段,网络学习任务的一般结构和(快速)在线适应阶段,网络学习一个新的给定的扬声器的语言。对照实验表明,当网络暴露于熟悉的指令,但包含新的单词,该模型适应新的词汇非常有效。此外,即使对于语言使用与我们的人工训练语言有很大差异的人类说话者,我们的网络仍然可以利用其自动获得的归纳偏差来学习更有效地遵循指令。

英文摘要:

Learning to follow human instructions is a long-pursued goal in artificial intelligence. The task becomes particularly challenging if no prior knowledge of the employed language is assumed while relying only on a handful of examples to learn from. Work in the past has relied on hand-coded components or manually engineered features to provide strong inductive biases that make learning in such situations possible. In contrast, here we seek to establish whether this knowledge can be acquired automatically by a neural network system through a two phase training procedure: A (slow) offline learning stage where the network learns about the general structure of the task and a (fast) online adaptation phase where the network learns the language of a new given speaker. Controlled experiments show that when the network is exposed to familiar instructions but containing novel words, the model adapts very efficiently to the new vocabulary. Moreover, even for human speakers whose language usage can depart significantly from our artificial training language, our network can still make use of its automatically acquired inductive bias to learn to follow instructions more effectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑