arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.04807cs.LG
收藏

PyRCN:储备池计算网络的开发与应用

PyRCN: A Toolbox for Exploration and Application of Reservoir Computing Networks

Technische Universität Dresden(德累斯顿工业大学);Ghent University(根特大学);imec(比利时微电子研究中心);Princeton University(普林斯顿大学)

Peter Steiner, Azarakhsh Jalalvand, Simon Stone, Peter Birkholz

摘要:

储备池计算网络(RCN)属于一组机器学习技术,其将输入空间非线性地投影到高维特征空间中,其中底层任务可以线性地求解。RCN的流行变体能够解决与广泛使用的深度神经网络等效的复杂任务,但基于线性回归的训练范式要简单得多。在本文中,我们展示了如何用小而清晰的构建块统一描述RCN,并介绍了Python工具箱PyRCN(Python储备池计算网络),用于在任意大的数据集上优化,训练和分析RCN。该工具基于广泛使用的科学软件包,并符合scikit-learn接口规范。它为RCN的教育和探索性分析提供了一个平台,以及将RCN应用于复杂任务(包括序列处理)的框架。通过少量的构建块,该框架允许实现许多不同的RCN架构。我们提供了关于如何为时间序列预测和序列分类任务设置RCN的代码示例。PyRCN在基准测试任务上比参考工具箱快10倍左右,同时需要的样板代码少得多。

英文摘要:

Reservoir Computing Networks (RCNs) belong to a group of machine learning techniques that project the input space non-linearly into a high-dimensional feature space, where the underlying task can be solved linearly. Popular variants of RCNs are capable of solving complex tasks equivalently to widely used deep neural networks, but with a substantially simpler training paradigm based on linear regression. In this paper, we show how to uniformly describe RCNs with small and clearly defined building blocks, and we introduce the Python toolbox PyRCN (Python Reservoir Computing Networks) for optimizing, training and analyzing RCNs on arbitrarily large datasets. The tool is based on widely-used scientific packages and complies with the scikit-learn interface specification. It provides a platform for educational and exploratory analyses of RCNs, as well as a framework to apply RCNs on complex tasks including sequence processing. With a small number of building blocks, the framework allows the implementation of numerous different RCN architectures. We provide code examples on how to set up RCNs for time series prediction and for sequence classification tasks. PyRCN is around ten times faster than reference toolboxes on a benchmark task while requiring substantially less boilerplate code.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑