arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2207.04886cs.NEcs.AIq-bio.PE
收藏

生物启发的机器学习:程序化死亡和复制

Bio-inspired Machine Learning: programmed death and replication

Budker Institute of Nuclear Physics(布德克尔核物理研究所);Novosibirsk State University(新西伯利亚国立大学);National Center for Biotechnology Information(美国国家生物技术信息中心);Duluth Institute for Advanced Study(德卢斯高等研究院)

Andrey Grabovsky, Vitaly Vanchurin

摘要:

我们在机器学习的背景下分析生物现象的算法和计算方面,例如复制和程序性死亡。我们使用两种不同的神经元效率度量来开发机器学习算法,用于向系统添加神经元(即复制算法)和从系统中删除神经元(即程序性死亡算法)。我们认为,程序死亡算法可以用于压缩的神经网络和复制算法可以用于提高性能的已经训练好的神经网络。我们还表明,程序死亡和复制的组合算法可以提高任意机器学习系统的学习效率。生物启发算法的计算优势,证明了通过训练前馈神经网络的MNIST数据集的手写图像。

英文摘要:

We analyze algorithmic and computational aspects of biological phenomena, such as replication and programmed death, in the context of machine learning. We use two different measures of neuron efficiency to develop machine learning algorithms for adding neurons to the system (i.e. replication algorithm) and removing neurons from the system (i.e. programmed death algorithm). We argue that the programmed death algorithm can be used for compression of neural networks and the replication algorithm can be used for improving performance of the already trained neural networks. We also show that a combined algorithm of programmed death and replication can improve the learning efficiency of arbitrary machine learning systems. The computational advantages of the bio-inspired algorithms are demonstrated by training feedforward neural networks on the MNIST dataset of handwritten images.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑