arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2004.12209cs.LGstat.ML
收藏

半内积空间中广义不变性的凸表示学习

Convex Representation Learning for Generalized Invariance in Semi-Inner-Product Space

University of Illinois at Chicago(伊利诺伊大学芝加哥分校);University of Waterloo(滑铁卢大学);Vector Institute(向量研究所)

Yingyi Ma, Vignesh Ganapathiraman, Yaoliang Yu, Xinhua Zhang

摘要:

不变性(一般意义上的定义)一直是表示学习最有效的先验之一。参数模型的直接因式分解只适用于小范围的不变性,而正则化方法,尽管提高了通用性,导致非凸优化。在这项工作中,我们开发了一个凸表示学习算法的各种广义不变性,可以建模为半规范。在半内积空间中引入了新的欧氏嵌入,并建立了近似界。正如我们的实验所证实的那样,这使得不变表示能够高效有效地学习,并具有准确的预测。

英文摘要:

Invariance (defined in a general sense) has been one of the most effective priors for representation learning. Direct factorization of parametric models is feasible only for a small range of invariances, while regularization approaches, despite improved generality, lead to nonconvex optimization. In this work, we develop a convex representation learning algorithm for a variety of generalized invariances that can be modeled as semi-norms. Novel Euclidean embeddings are introduced for kernel representers in a semi-inner-product space, and approximation bounds are established. This allows invariant representations to be learned efficiently and effectively as confirmed in our experiments, along with accurate predictions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑