FastONN --基于Python的操作神经网络开源GPU实现
FastONN -- Python based open-source GPU implementation for Operational Neural Networks
摘要:
操作神经网络(Operational Neural Networks,ONNs)是近年来提出的一种用于网格结构数据的特殊的人工神经网络。它们使异构非线性操作能够推广广泛采用的基于卷积的神经元模型。这项工作介绍了一个快速的GPU启用库训练业务神经网络,FastONN,这是基于一种新的矢量化制定的操作神经元。利用反向传播的自动反向模式微分,FastONN通过引入新的算子集和自定义梯度流来提高灵活性。此外,捆绑的辅助模块提供了跨不同数据分区和自定义指标的性能跟踪和检查点接口。
英文摘要:
Operational Neural Networks (ONNs) have recently been proposed as a special class of artificial neural networks for grid structured data. They enable heterogenous non-linear operations to generalize the widely adopted convolution-based neuron model. This work introduces a fast GPU-enabled library for training operational neural networks, FastONN, which is based on a novel vectorized formulation of the operational neurons. Leveraging on automatic reverse-mode differentiation for backpropagation, FastONN enables increased flexibility with the incorporation of new operator sets and customized gradient flows. Additionally, bundled auxiliary modules offer interfaces for performance tracking and checkpointing across different data partitions and customized metrics.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。