arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.04894cs.LG
收藏

一种用于微型设备推理的脑启发低维计算分类器

A Brain-Inspired Low-Dimensional Computing Classifier for Inference on Tiny Devices

Northeastern University(东北大学);UC Riverside(加州大学河滨分校)

Shijin Duan, Xiaolin Xu, Shaolei Ren

摘要:

通过模仿类脑认知和利用并行性,超维计算(HDC)分类器已经成为一个轻量级的框架,以实现有效的设备上的推理。尽管如此,它们有两个基本的缺点,启发式训练过程和超高的维度,这导致次优的推理精度和大的模型尺寸超出了具有严格资源约束的微小设备的能力。在本文中,我们解决这些根本的缺点,并提出了一个低维计算(LDC)的替代方案。具体来说,通过将我们的LDC分类器映射到等效的神经网络中,我们使用原则性训练方法优化了我们的模型。最重要的是,我们可以提高推理精度,同时成功地将现有HDC模型的超高维度降低了几个数量级(例如,8000 vs. 4/64)。我们运行实验来评估我们的LDC分类器,通过考虑不同的数据集在微小设备上进行推理,并在FPGA平台上实现不同的模型以进行加速。结果突出表明,我们的LDC分类器比现有的大脑启发的HDC模型具有压倒性的优势,特别适合在微型设备上进行推理。

英文摘要:

By mimicking brain-like cognition and exploiting parallelism, hyperdimensional computing (HDC) classifiers have been emerging as a lightweight framework to achieve efficient on-device inference. Nonetheless, they have two fundamental drawbacks, heuristic training process and ultra-high dimension, which result in sub-optimal inference accuracy and large model sizes beyond the capability of tiny devices with stringent resource constraints. In this paper, we address these fundamental drawbacks and propose a low-dimensional computing (LDC) alternative. Specifically, by mapping our LDC classifier into an equivalent neural network, we optimize our model using a principled training approach. Most importantly, we can improve the inference accuracy while successfully reducing the ultra-high dimension of existing HDC models by orders of magnitude (e.g., 8000 vs. 4/64). We run experiments to evaluate our LDC classifier by considering different datasets for inference on tiny devices, and also implement different models on an FPGA platform for acceleration. The results highlight that our LDC classifier offers an overwhelming advantage over the existing brain-inspired HDC models and is particularly suitable for inference on tiny devices.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑