arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.13841cs.LG
收藏

快速双曲面决策树算法

Fast hyperboloid decision tree algorithms

Columbia University(哥伦比亚大学);Barnard College(巴纳德学院)

Philippe Chlenski, Ethan Turok, Antonio Moretti, Itsik Pe'er

AI总结:

针对双曲分类器计算成本高的问题,提出基于内积的双曲决策树hyperDT及双曲随机森林hyperRF,无需黎曼优化,保持常数决策复杂度,在多数据集上性能优异,提供高效易用的双曲数据分析工具。

摘要:

双曲几何因其在捕捉真实世界数据中的层次结构方面的有效性,在机器学习领域正受到越来越多的关注。邻域呈指数增长的双曲空间具备显著优势,并且在各类应用中持续取得最先进的结果。然而,双曲分类器常常面临计算方面的挑战。依赖黎曼优化的方法通常运行速度缓慢,这是因为黎曼流形上的运算计算量更高。针对这些挑战,我们提出了hyperDT——一种将决策树算法拓展到双曲空间的全新方法。关键在于,hyperDT通过利用内积将欧氏决策树算法适配到双曲空间,无需计算密集的黎曼优化、数值不稳定的指数映射与对数映射,也无需点与点之间的成对比较。我们的方法概念简洁,保持了常数时间的决策复杂度,同时缓解了高维欧氏空间固有的可扩展性问题。在hyperDT的基础上,我们还提出了hyperRF——一种双曲随机森林模型。在多个不同数据集上开展的广泛基准测试证实了这些模型的优异性能,为双曲数据分析提供了一套快速、精准、准确且易用的工具包。

英文摘要:

Hyperbolic geometry is gaining traction in machine learning for its effectiveness at capturing hierarchical structures in real-world data. Hyperbolic spaces, where neighborhoods grow exponentially, offer substantial advantages and consistently deliver state-of-the-art results across diverse applications. However, hyperbolic classifiers often grapple with computational challenges. Methods reliant on Riemannian optimization frequently exhibit sluggishness, stemming from the increased computational demands of operations on Riemannian manifolds. In response to these challenges, we present hyperDT, a novel extension of decision tree algorithms into hyperbolic space. Crucially, hyperDT eliminates the need for computationally intensive Riemannian optimization, numerically unstable exponential and logarithmic maps, or pairwise comparisons between points by leveraging inner products to adapt Euclidean decision tree algorithms to hyperbolic space. Our approach is conceptually straightforward and maintains constant-time decision complexity while mitigating the scalability issues inherent in high-dimensional Euclidean spaces. Building upon hyperDT we introduce hyperRF, a hyperbolic random forest model. Extensive benchmarking across diverse datasets underscores the superior performance of these models, providing a swift, precise, accurate, and user-friendly toolkit for hyperbolic data analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑