Hyperbolic geometry is gaining traction in machine learning for its effectiveness at capturing hierarchical structures in real-world data. Hyperbolic spaces, where neighborhoods grow exponentially, offer substantial advantages and consistently deliver state-of-the-art results across diverse applications. However, hyperbolic classifiers often grapple with computational challenges. Methods reliant on Riemannian optimization frequently exhibit sluggishness, stemming from the increased computational demands of operations on Riemannian manifolds. In response to these challenges, we present hyperDT, a novel extension of decision tree algorithms into hyperbolic space. Crucially, hyperDT eliminates the need for computationally intensive Riemannian optimization, numerically unstable exponential and logarithmic maps, or pairwise comparisons between points by leveraging inner products to adapt Euclidean decision tree algorithms to hyperbolic space. Our approach is conceptually straightforward and maintains constant-time decision complexity while mitigating the scalability issues inherent in high-dimensional Euclidean spaces. Building upon hyperDT we introduce hyperRF, a hyperbolic random forest model. Extensive benchmarking across diverse datasets underscores the superior performance of these models, providing a swift, precise, accurate, and user-friendly toolkit for hyperbolic data analysis.
Graduate School of Information Science and Technology, The University of Tokyo(东京大学信息科学与技术研究生院)
核方法是分析结构化数据(如序列、树和图)的一种潜在方法,然而,无序树尚未得到广泛研究。Kimura et al.(2011)提出了一种基于子路径的无序树的核函数,子路径是树的垂直子结构,负责其中的层次信息。他们的内核在精度和速度方面表现出实际上很好的性能;然而,线性时间计算在理论上不能保证,不像Vishwanathan和Smola(2003)提出的其他无序树内核。在本文中,我们提出了一个理论上保证线性时间内核计算算法,实际上是快速的,我们提出了一个有效的预测算法,其运行时间只取决于输入树的大小。实验结果表明,本文提出的算法在实际应用中是非常有效的.
Fast Estimation of Partial Dependence Functions using Trees
University of Copenhagen(哥本哈根大学);University of Bremen(不来梅大学);Leibniz Institute for Prevention Research and Epidemiology - BIPS(莱布尼茨预防研究与流行病学研究所 - BIPS)
Fast inference of Boosted Decision Trees in FPGAs for particle physics
European Organization for Nuclear Research (CERN)(欧洲核子研究组织(CERN));Columbia University(哥伦比亚大学);University of California San Diego(加利福尼亚大学圣迭戈分校);Massachusetts Institute of Technology(麻省理工学院);Rhodes College(罗德学院);Fermi National Accelerator Laboratory(费米国家加速器实验室);Institute of Physics Belgrade(贝尔格莱德物理研究所);University of Illinois at Chicago(伊利诺伊大学芝加哥分校)