arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.02535cs.NE
收藏

大规模光子库计算机的贝叶斯优化

Bayesian optimisation of large-scale photonic reservoir computers

Piotr Antonik, Nicolas Marsal, Daniel Brunner, Damien Rontani

摘要:

导论.储备池计算是一种不断发展的循环神经网络简化训练范例,具有很高的硬件实现潜力。在光学和电子学方面的大量实验产生了与最先进的数字算法相当的性能。该领域的许多最新工作都集中在大规模光子系统上,这些系统具有数万个物理节点和任意互连。虽然这种趋势显著地扩展了光子储备池计算的潜在应用,但它也使系统的大量超参数的优化复杂化。方法.在这项工作中,我们提出了使用贝叶斯优化的超参数空间的有效探索在最小数量的迭代。结果我们测试这种方法在以前报道的大规模实验系统,比较常用的网格搜索,并报告显着的改进性能和优化超参数所需的实验迭代次数。结论因此,贝叶斯优化有可能成为调整光子储备池计算中的超参数的标准方法。

英文摘要:

Introduction. Reservoir computing is a growing paradigm for simplified training of recurrent neural networks, with a high potential for hardware implementations. Numerous experiments in optics and electronics yield comparable performance to digital state-of-the-art algorithms. Many of the most recent works in the field focus on large-scale photonic systems, with tens of thousands of physical nodes and arbitrary interconnections. While this trend significantly expands the potential applications of photonic reservoir computing, it also complicates the optimisation of the high number of hyper-parameters of the system. Methods. In this work, we propose the use of Bayesian optimisation for efficient exploration of the hyper-parameter space in a minimum number of iteration. Results. We test this approach on a previously reported large-scale experimental system, compare it to the commonly used grid search, and report notable improvements in performance and the number of experimental iterations required to optimise the hyper-parameters. Conclusion. Bayesian optimisation thus has the potential to become the standard method for tuning the hyper-parameters in photonic reservoir computing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑