arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2206.09149cs.LG
收藏

分段线性神经网络和深度学习

Piecewise Linear Neural Networks and Deep Learning

KU Leuven(鲁汶大学);Tsinghua University(清华大学)

Qinghua Tao, Li Li, Xiaolin Huang, Xiangming Xi, Shuning Wang, Johan A. K. Suykens

摘要:

作为一种强大的建模方法,分段线性神经网络(PWLNN)已在各个领域取得成功,最近在深度学习中取得了成功。为了应用PWLNN方法,长期以来一直在研究表示和学习。1977年,规范表示开创了通过增量设计学习的浅PWLNN的工作,但应用于大规模数据被禁止。2010年,修正线性单元(ReLU)提倡PWLNN在深度学习中的流行。从那时起,PWLNN已成功应用于广泛的任务,并取得了优越的性能。在本书中,我们通过将作品分为浅层和深层网络,系统地介绍了PWLNN的方法。首先,不同的PWLNN表示模型构造与详细的例子。通过PWLNN,介绍了数据学习算法的演变,并进行了深入的理论分析。然后,介绍了典型的应用,并进行了讨论和展望。

英文摘要:

As a powerful modelling method, PieceWise Linear Neural Networks (PWLNNs) have proven successful in various fields, most recently in deep learning. To apply PWLNN methods, both the representation and the learning have long been studied. In 1977, the canonical representation pioneered the works of shallow PWLNNs learned by incremental designs, but the applications to large-scale data were prohibited. In 2010, the Rectified Linear Unit (ReLU) advocated the prevalence of PWLNNs in deep learning. Ever since, PWLNNs have been successfully applied to extensive tasks and achieved advantageous performances. In this Primer, we systematically introduce the methodology of PWLNNs by grouping the works into shallow and deep networks. Firstly, different PWLNN representation models are constructed with elaborated examples. With PWLNNs, the evolution of learning algorithms for data is presented and fundamental theoretical analysis follows up for in-depth understandings. Then, representative applications are introduced together with discussions and outlooks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑