arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.06837cs.LGcs.AImath.CT
收藏

使用梯度下降学习函子

Learning Functors using Gradient Descent

TakeLab, FER, University of Zagreb(萨格勒布大学电气工程与计算学院 TakeLab 实验室)

Bruno Gavranović

摘要:

神经网络是可微优化的一般框架,其包括许多其他机器学习方法作为特例。在本文中,我们建立了一个范畴理论的形式主义周围的神经网络系统称为CycleGAN。CycleGAN是近年来受到关注的一种非成对图像到图像翻译的通用方法。受范畴数据库系统的启发,我们证明了CycleGAN是一个“模式”,即由生成器和关系表示的特定类别,其特定参数实例化只是该模式上的集值函子。我们表明,强制执行循环,强制执行组合不变在这一类。我们将学习过程推广到任意的类别,并显示了一类特殊的函子,而不是函数,可以使用梯度下降学习。使用这个框架,我们设计了一个新的神经网络系统,能够学习插入和删除对象的图像没有配对的数据。我们定性评估CelebA数据集上的系统,并获得了可喜的成果。

英文摘要:

Neural networks are a general framework for differentiable optimization which includes many other machine learning approaches as special cases. In this paper we build a category-theoretic formalism around a neural network system called CycleGAN. CycleGAN is a general approach to unpaired image-to-image translation that has been getting attention in the recent years. Inspired by categorical database systems, we show that CycleGAN is a "schema", i.e. a specific category presented by generators and relations, whose specific parameter instantiations are just set-valued functors on this schema. We show that enforcing cycle-consistencies amounts to enforcing composition invariants in this category. We generalize the learning procedure to arbitrary such categories and show a special class of functors, rather than functions, can be learned using gradient descent. Using this framework we design a novel neural network system capable of learning to insert and delete objects from images without paired data. We qualitatively evaluate the system on the CelebA dataset and obtain promising results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑