arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2301.02809cs.AIcs.CL
收藏

一种基于类脑记忆转换的可微分神经计算机及其在基于推理的问答中的应用

A Brain-inspired Memory Transformation based Differentiable Neural Computer for Reasoning-based Question Answering

Yao Liang, Hongjian Fang, Yi Zeng, Feifei Zhao

AI总结:

受大脑记忆机制启发,提出MT-DNC模型,通过融合工作记忆与长期记忆并实现自主转换,显著提升了基于推理问答的性能、收敛速度与鲁棒性。

摘要:

推理与问答作为人类的基本认知功能,对当前人工智能而言仍是巨大挑战。尽管Differentiable Neural Computer (DNC) 模型能在一定程度上解决此类问题,但其发展仍受限于高算法复杂度、慢收敛速度和较差的测试鲁棒性。受大脑学习与记忆机制启发,本文提出了基于记忆转换的可微分神经计算机(MT-DNC)模型。MT-DNC将工作记忆和长期记忆融入DNC,实现了获得性经验在工作记忆与长期记忆之间的自主转换,从而有助于有效提取获得性知识以提升推理能力。在bAbI问答任务上的实验结果表明,与其他现有的DNN和DNC模型相比,本文方法取得了更优的性能和更快的收敛速度。消融研究还表明,从工作记忆到长期记忆的记忆转换在提升推理的鲁棒性和稳定性方面发挥着重要作用。本工作探索了如何将类脑记忆转换整合并应用于复杂的智能对话与推理系统。

英文摘要:

Reasoning and question answering as a basic cognitive function for humans, is nevertheless a great challenge for current artificial intelligence. Although the Differentiable Neural Computer (DNC) model could solve such problems to a certain extent, the development is still limited by its high algorithm complexity, slow convergence speed, and poor test robustness. Inspired by the learning and memory mechanism of the brain, this paper proposed a Memory Transformation based Differentiable Neural Computer (MT-DNC) model. MT-DNC incorporates working memory and long-term memory into DNC, and realizes the autonomous transformation of acquired experience between working memory and long-term memory, thereby helping to effectively extract acquired knowledge to improve reasoning ability. Experimental results on bAbI question answering task demonstrated that our proposed method achieves superior performance and faster convergence speed compared to other existing DNN and DNC models. Ablation studies also indicated that the memory transformation from working memory to long-term memory plays essential role in improving the robustness and stability of reasoning. This work explores how brain-inspired memory transformation can be integrated and applied to complex intelligent dialogue and reasoning systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑