arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1711.01754cs.AIcs.LG
收藏

人工神经网络的学习求解过程

Learning Solving Procedure for Artificial Neural Network

Inha University(仁荷大学)

Ju-Hong Lee, Moon-Ju Kang, Bumghi Choi

摘要:

人们预计,通过集成表示学习和复杂推理的系统的出现,将实现向真正的人工智能的进展(LeCun et al. 2015)。针对这一预测,已经进行了在人工神经网络中实现冯·诺依曼计算机的符号推理的研究(Graves et al. 2016; Graves et al. 2014; Reed et al. 2015)。然而,这些研究在实现神经-符号积分方面有许多局限性(Jaeger. 2016年)。在这里,我们提出了一个新的学习范式:学习解决程序(LSP),学习解决复杂问题的程序。这不仅仅是通过学习输入-输出数据来实现的,而是通过通过求解过程的学习算法来实现的,该求解过程获得作为给定输入问题的任务序列的输出。LSP神经网络系统不仅学习简单的加法和乘法问题,而且学习复杂问题的算法,如复杂的算术表达式,排序和汉诺塔。为了实现这一点,LSP神经网络结构由递归组合的深度神经网络和长短期记忆组成。通过实验,我们证明了LSP的效率和可扩展性及其作为一种复杂推理机制的有效性。

英文摘要:

It is expected that progress toward true artificial intelligence will be achieved through the emergence of a system that integrates representation learning and complex reasoning (LeCun et al. 2015). In response to this prediction, research has been conducted on implementing the symbolic reasoning of a von Neumann computer in an artificial neural network (Graves et al. 2016; Graves et al. 2014; Reed et al. 2015). However, these studies have many limitations in realizing neural-symbolic integration (Jaeger. 2016). Here, we present a new learning paradigm: a learning solving procedure (LSP) that learns the procedure for solving complex problems. This is not accomplished merely by learning input-output data, but by learning algorithms through a solving procedure that obtains the output as a sequence of tasks for a given input problem. The LSP neural network system not only learns simple problems of addition and multiplication, but also the algorithms of complicated problems, such as complex arithmetic expression, sorting, and Hanoi Tower. To realize this, the LSP neural network structure consists of a deep neural network and long short-term memory, which are recursively combined. Through experimentation, we demonstrate the efficiency and scalability of LSP and its validity as a mechanism of complex reasoning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑