arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.26557cs.LG
收藏

在饮食中提升树:为资源受限设备设计的紧凑模型

Boosted Trees on a Diet: Compact Models for Resource-Constrained Devices

University of Münster(明斯特大学);University of Rostock(罗斯托克大学);University of Copenhagen(哥本哈根大学)

Nina Herrmann, Jan Stenkamp, Benjamin Karic, Stefan Oehmcke, Fabian Gieseke

AI总结:

本文提出了一种提升决策树的压缩方法,通过减少内存足迹实现轻量级模型,适用于资源受限的物联网设备。

摘要:

在计算受限的设备上部署机器学习模型已成为现代物联网应用的关键构建块。在本文中,我们提出了一种针对提升决策树的压缩方案,以应对对轻量级机器学习模型日益增长的需求。具体而言,我们提供了训练紧凑提升决策树集成的技术,通过在训练过程中奖励特征和阈值的重用,从而减少内存足迹。我们的实验评估表明,通过适应的训练过程和替代的内存布局,所获得的模型在性能上与LightGBM模型相比,压缩比达到4-16倍。一旦部署,相应的物联网设备可以独立于持续的通信或外部能源供应运行,因此可以自主运行,仅需最小的计算能力和能源。这种能力为广泛的物联网应用打开了大门,包括远程监控、边缘分析和在孤立或电力受限环境中的实时决策制定。

英文摘要:

Deploying machine learning models on compute-constrained devices has become a key building block of modern IoT applications. In this work, we present a compression scheme for boosted decision trees, addressing the growing need for lightweight machine learning models. Specifically, we provide techniques for training compact boosted decision tree ensembles that exhibit a reduced memory footprint by rewarding, among other things, the reuse of features and thresholds during training. Our experimental evaluation shows that models achieved the same performance with a compression ratio of 4-16x compared to LightGBM models using an adapted training process and an alternative memory layout. Once deployed, the corresponding IoT devices can operate independently of constant communication or external energy supply, and, thus, autonomously, requiring only minimal computing power and energy. This capability opens the door to a wide range of IoT applications, including remote monitoring, edge analytics, and real-time decision making in isolated or power-limited environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑