arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.09346cs.LGcs.NE
收藏

TorchDyn:一个神经微分方程库

TorchDyn: A Neural Differential Equations Library

KAIST(韩国科学技术院);University of Tokyo(东京大学)

Michael Poli, Stefano Massaroli, Atsushi Yamashita, Hajime Asama, Jinkyoo Park

摘要:

连续深度学习最近成为深度学习的一个新视角,它可以提高与动态系统和密度估计相关的任务的性能。这些方法的核心是神经微分方程,其前向传递是由神经网络参数化的初始值问题的解决方案。由于与标准离散神经网络相比的特殊差异,释放连续深度模型的全部潜力需要一套不同的软件工具,例如推理必须通过数值求解器进行。我们介绍了TorchDyn,一个专用于连续深度学习的PyTorch库,旨在将神经微分方程提升为与常规即插即用深度学习原语一样可访问。这一目标是通过识别和细分不同的变体为共同的基本组件,可以组合和自由地重新利用,以获得复杂的组合架构。TorchDyn还提供了一步一步的教程和基准,旨在指导研究人员和贡献者。

英文摘要:

Continuous-depth learning has recently emerged as a novel perspective on deep learning, improving performance in tasks related to dynamical systems and density estimation. Core to these approaches is the neural differential equation, whose forward passes are the solutions of an initial value problem parametrized by a neural network. Unlocking the full potential of continuous-depth models requires a different set of software tools, due to peculiar differences compared to standard discrete neural networks, e.g inference must be carried out via numerical solvers. We introduce TorchDyn, a PyTorch library dedicated to continuous-depth learning, designed to elevate neural differential equations to be as accessible as regular plug-and-play deep learning primitives. This objective is achieved by identifying and subdividing different variants into common essential components, which can be combined and freely repurposed to obtain complex compositional architectures. TorchDyn further offers step-by-step tutorials and benchmarks designed to guide researchers and contributors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑