arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.04346stat.MLcs.LGmath.DS
收藏

变量变换公式的推广及其在剩余流中的应用

Generalization of the Change of Variables Formula with Applications to Residual Flows

University of Bremen(不来梅大学);Leibniz Institute for Prevention Research and Epidemiology – BIPS(莱布尼茨预防研究与流行病学研究所——BIPS)

Niklas Koenen, Marvin N. Wright, Peter Maaß, Jens Behrmann

摘要:

规范化流利用变量变化公式(CVF)定义灵活的密度模型。然而,CVF中的平滑变换(同构)的要求对这些模型的构建提出了重大挑战。为了扩大流的设计空间,我们引入了$\mathcal{L}$ -代数同态作为广义变换,这可能违反零勒贝格测度集上的这些要求。这种放松允许使用ReLU等非平滑激活功能。最后,我们将所得结果应用于平面,径向和收缩残余流。

英文摘要:

Normalizing flows leverage the Change of Variables Formula (CVF) to define flexible density models. Yet, the requirement of smooth transformations (diffeomorphisms) in the CVF poses a significant challenge in the construction of these models. To enlarge the design space of flows, we introduce $\mathcal{L}$-diffeomorphisms as generalized transformations which may violate these requirements on zero Lebesgue-measure sets. This relaxation allows e.g. the use of non-smooth activation functions such as ReLU. Finally, we apply the obtained results to planar, radial, and contractive residual flows.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑