arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.11780math.OC
收藏

通过耦合张量范数正则化提高推广性

Improving the generalization via coupled tensor norm regularization

Ying Gao, Yunfei Qu, Chunfeng Cui, Deren Han

摘要:

在本文中,我们提出了一种耦合张量范数正则化,可以使模型输出特征和数据输入位于低维流形中,这有助于我们减少过拟合。我们证明了这个正则化项对于逻辑斯谛回归是凸的、可微的和梯度Lipschitz连续的,而对于深度神经网络是非凸的和非光滑的。我们进一步分析了一阶方法求解该模型的收敛性。数值实验表明,我们的方法是有效的。

英文摘要:

In this paper, we propose a coupled tensor norm regularization that could enable the model output feature and the data input to lie in a low-dimensional manifold, which helps us to reduce overfitting. We show this regularization term is convex, differentiable, and gradient Lipschitz continuous for logistic regression, while nonconvex and nonsmooth for deep neural networks. We further analyze the convergence of the first-order method for solving this model. The numerical experiments demonstrate that our method is efficient.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑