arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.05465cs.LGstat.ML
收藏

双曲空间中的鲁棒大间隔学习

Robust Large-Margin Learning in Hyperbolic Space

Princeton University(普林斯顿大学);Google Research(谷歌研究院)

Melanie Weber, Manzil Zaheer, Ankit Singh Rawat, Aditya Menon, Sanjiv Kumar

摘要:

最近,人们对双曲空间中的表示学习产生了浓厚的兴趣,这是因为双曲空间能够表示比标准欧几里得空间维数少得多的层次数据。然而,双曲空间在下游机器学习任务中的可行性和好处却受到较少的关注。在本文中,我们提出,据我们所知,第一个理论保证学习分类在双曲而不是欧几里得空间。具体来说,我们考虑的问题,学习一个大的利润分类器的数据具有层次结构。我们提供了一种算法来有效地学习一个大的边缘超平面,依赖于仔细注入对抗性的例子。最后,我们证明了对于嵌入双曲空间的分层数据,当直接在双曲空间中学习分类器时,低嵌入维数确保了更好的保证。

英文摘要:

Recently, there has been a surge of interest in representation learning in hyperbolic spaces, driven by their ability to represent hierarchical data with significantly fewer dimensions than standard Euclidean spaces. However, the viability and benefits of hyperbolic spaces for downstream machine learning tasks have received less attention. In this paper, we present, to our knowledge, the first theoretical guarantees for learning a classifier in hyperbolic rather than Euclidean space. Specifically, we consider the problem of learning a large-margin classifier for data possessing a hierarchical structure. We provide an algorithm to efficiently learn a large-margin hyperplane, relying on the careful injection of adversarial examples. Finally, we prove that for hierarchical data that embeds well into hyperbolic space, the low embedding dimension ensures superior guarantees when learning the classifier directly in hyperbolic space.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑