arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.14619cs.LGquant-phstat.ML
收藏

递归量子神经网络

Recurrent Quantum Neural Networks

Johannes Bausch

摘要:

递归神经网络是机器学习中许多序列到序列模型的基础,例如机器翻译和语音合成。相比之下,应用量子计算还处于起步阶段。然而,已经存在量子机器学习模型,例如已经成功地用于例如能量最小化任务的上下文中的变分量子本征解算器。在这项工作中,我们构建了一个量子递归神经网络(QRNN),在序列学习和整数数字分类等非平凡任务上具有可证明的性能。QRNN细胞是由参数化的量子神经元构建的,其与振幅放大相结合,创建其输入和细胞状态的多项式的非线性激活,并允许在每一步提取预测类的概率分布。为了研究该模型的性能,我们提供了一个pytorch的实现,它允许相对有效的优化参数化量子电路与数千个参数。我们通过基准优化超参数建立了QRNN训练设置,并分析了Elman关于时间结构学习的开创性论文(1990)中简单记忆和序列预测任务的合适网络拓扑。然后,我们继续在MNIST分类上评估QRNN,既通过逐像素地向QRNN提供每个图像;又通过利用现代数据增强作为预处理步骤。最后,我们分析了网络的酉性质在多大程度上抵消了困扰许多现有量子分类器和经典RNN的消失梯度问题。

英文摘要:

Recurrent neural networks are the foundation of many sequence-to-sequence models in machine learning, such as machine translation and speech synthesis. In contrast, applied quantum computing is in its infancy. Nevertheless there already exist quantum machine learning models such as variational quantum eigensolvers which have been used successfully e.g. in the context of energy minimization tasks. In this work we construct a quantum recurrent neural network (QRNN) with demonstrable performance on non-trivial tasks such as sequence learning and integer digit classification. The QRNN cell is built from parametrized quantum neurons, which, in conjunction with amplitude amplification, create a nonlinear activation of polynomials of its inputs and cell state, and allow the extraction of a probability distribution over predicted classes at each step. To study the model's performance, we provide an implementation in pytorch, which allows the relatively efficient optimization of parametrized quantum circuits with thousands of parameters. We establish a QRNN training setup by benchmarking optimization hyperparameters, and analyse suitable network topologies for simple memorisation and sequence prediction tasks from Elman's seminal paper (1990) on temporal structure learning. We then proceed to evaluate the QRNN on MNIST classification, both by feeding the QRNN each image pixel-by-pixel; and by utilising modern data augmentation as preprocessing step. Finally, we analyse to what extent the unitary nature of the network counteracts the vanishing gradient problem that plagues many existing quantum classifiers and classical RNNs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑