arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.04171cs.NEcs.LG
收藏

二进制通信网络神经形态部署的超参数优化

Hyperparameter Optimization in Binary Communication Networks for Neuromorphic Deployment

Purdue University(普渡大学);Oak Ridge National Laboratory(橡树岭国家实验室);Sandia National Laboratories(桑迪亚国家实验室)

Maryam Parsa, Catherine D. Schuman, Prasanna Date, Derek C. Rose, Bill Kay, J. Parker Mitchell, Steven R. Young, Ryan Dellana, William Severa, Thomas E. Potok, Kaushik Roy

摘要:

训练用于神经形态部署的神经网络并非易事。已经提出了多种方法来调整适合于训练的反向传播或类反向传播算法。考虑到这些网络通常具有与传统神经网络非常不同的性能特征,通常不清楚如何设置网络拓扑或超参数以实现最佳性能。在这项工作中,我们介绍了一种贝叶斯方法,用于优化训练二进制通信网络的算法的超参数,可以部署到神经形态硬件。我们表明,通过优化每个数据集的该算法的超参数,我们可以在每个数据集上实现比以前最先进的算法更高的准确性(高达15%)。这种性能上的飞跃继续强调了将传统神经网络转换为适用于神经形态硬件的二进制通信的潜力。

英文摘要:

Training neural networks for neuromorphic deployment is non-trivial. There have been a variety of approaches proposed to adapt back-propagation or back-propagation-like algorithms appropriate for training. Considering that these networks often have very different performance characteristics than traditional neural networks, it is often unclear how to set either the network topology or the hyperparameters to achieve optimal performance. In this work, we introduce a Bayesian approach for optimizing the hyperparameters of an algorithm for training binary communication networks that can be deployed to neuromorphic hardware. We show that by optimizing the hyperparameters on this algorithm for each dataset, we can achieve improvements in accuracy over the previous state-of-the-art for this algorithm on each dataset (by up to 15 percent). This jump in performance continues to emphasize the potential when converting traditional neural networks to binary communication applicable to neuromorphic hardware.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑