arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.04320cs.LG
收藏

Derivation of the Backpropagation Algorithm Based on Derivative Amplification Coefficients

Beijing Jiaotong University(北京交通大学)

Yiping Cheng

英文摘要:

The backpropagation algorithm for neural networks is widely felt hard to understand, despite the existence of some well-written explanations and/or derivations. This paper provides a new derivation of this algorithm based on the concept of derivative amplification coefficients. First proposed by this author for fully connected cascade networks, this concept is found to well carry over to conventional feedforward neural networks and it paves the way for the use of mathematical induction in establishing a key result that enables backpropagation for derivative amplification coefficients. Then we establish the connection between derivative amplification coefficients and error coefficients (commonly referred to as errors in the literature), and show that the same backpropagation procedure can be used for error coefficients. The entire derivation is thus rigorous, simple, and elegant.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑