arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.01285cs.LG
收藏

X-TIME:一种利用CAM加速表格数据机器学习的内存引擎

X-TIME: An in-memory engine for accelerating machine learning on tabular data with CAMs

Hewlett Packard Labs(惠普实验室)
Giacomo Pedretti, John Moon, Pedro Bruel, Sergey Serebryakov, Ron M. Roth, Luca Buonanno, Archit Gajjar, Lei Zhao, Tobias Ziegler, Cong Xu, Martin Foltin, Paolo… 展开作者

Giacomo Pedretti, John Moon, Pedro Bruel, Sergey Serebryakov, Ron M. Roth, Luca Buonanno, Archit Gajjar, Lei Zhao, Tobias Ziegler, Cong Xu, Martin Foltin, Paolo Faraboschi, Jim Ignowski, Catherine E. Graves

AI总结:

X-TIME提出一种模数混合内存引擎,利用高精度模拟CAM加速树模型推理,相比GPU实现119倍吞吐量、9740倍低延迟和150倍能效提升。

摘要:

结构化数据,即表格数据,是数据科学中最常见的格式。虽然深度学习模型在从图像或语音等非结构化数据中学习时表现出强大的能力,但在从表格数据中学习时,它们的准确性不如更简单的方法。相比之下,现代基于树的机器学习(ML)模型在从结构化数据中提取相关信息方面表现出色。数据科学中的一个基本需求是降低模型推理延迟,例如,当模型与模拟闭环使用以加速科学发现时。然而,硬件加速社区主要关注深度神经网络,而在很大程度上忽略了其他形式的机器学习。先前的工作描述了使用模拟内容可寻址存储器(CAM)组件来高效映射随机森林。在这项工作中,我们开发了一种模数混合架构,该架构实现了一种新型的高精度模拟CAM和一种可编程芯片,用于推理最先进的基于树的ML模型,如XGBoost、CatBoost等。得益于硬件感知训练,与最先进的GPU相比,X-TIME在最多4096棵树、深度为8的模型上达到了最先进的准确性,吞吐量提高了119倍,延迟降低了9740倍,能效提高了150倍以上,峰值功耗为19W。

英文摘要:

Structured, or tabular, data is the most common format in data science. While deep learning models have proven formidable in learning from unstructured data such as images or speech, they are less accurate than simpler approaches when learning from tabular data. In contrast, modern tree-based Machine Learning (ML) models shine in extracting relevant information from structured data. An essential requirement in data science is to reduce model inference latency in cases where, for example, models are used in a closed loop with simulation to accelerate scientific discovery. However, the hardware acceleration community has mostly focused on deep neural networks and largely ignored other forms of machine learning. Previous work has described the use of an analog content addressable memory (CAM) component for efficiently mapping random forests. In this work, we develop an analog-digital architecture that implements a novel increased precision analog CAM and a programmable chip for inference of state-of-the-art tree-based ML models, such as XGBoost, CatBoost, and others. Thanks to hardware-aware training, X-TIME reaches state-of-the-art accuracy and 119x higher throughput at 9740x lower latency with >150x improved energy efficiency compared with a state-of-the-art GPU for models with up to 4096 trees and depth of 8, with a 19W peak power consumption.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑