SCAI:用于IoT平台的具有自适应推断的光谱数据分类框架
SCAI: A Spectral data Classification framework with Adaptive Inference for the IoT platform
摘要:
借助深度学习和物联网技术实现海量光谱数据的准确、高效、实时识别是当前的研究热点。深度神经网络在光谱分析中发挥了关键作用。然而,更深层模型的推断是以静态方式执行的,并且不能根据设备进行调整。并非所有样本都需要分配所有计算来达到置信预测,这阻碍了整体性能的最大化。为了解决上述问题,我们提出了一个光谱数据分类框架与自适应推理。具体来说,为了为不同的样本分配不同的计算,同时更好地利用不同设备之间的协作,我们利用Early-exit架构,将中间分类器放置在架构的不同深度,当预测置信度达到预设阈值时,模型输出结果。我们提出了一种自升华学习的训练模式,最深的分类器对浅层分类器进行软监督,以最大限度地提高它们的性能和训练速度。同时,为了减轻早期退出范式中中间分类器的位置和数量设置对性能的脆弱性,我们提出了一种位置自适应残差网络。它可以在不同的曲线位置调整每个块中的层数,因此它可以专注于曲线的重要位置(例如:拉曼峰),并根据任务性能和计算资源准确分配适当的计算预算。据我们所知,本文是首次尝试在物联网平台下通过自适应推理对频谱检测进行优化。我们进行了大量的实验,实验结果表明,我们提出的方法可以达到更高的性能与更少的计算预算比现有的方法。
英文摘要:
Currently, it is a hot research topic to realize accurate, efficient, and real-time identification of massive spectral data with the help of deep learning and IoT technology. Deep neural networks played a key role in spectral analysis. However, the inference of deeper models is performed in a static manner, and cannot be adjusted according to the device. Not all samples need to allocate all computation to reach confident prediction, which hinders maximizing the overall performance. To address the above issues, we propose a Spectral data Classification framework with Adaptive Inference. Specifically, to allocate different computations for different samples while better exploiting the collaboration among different devices, we leverage Early-exit architecture, place intermediate classifiers at different depths of the architecture, and the model outputs the results when the prediction confidence reaches a preset threshold. We propose a training paradigm of self-distillation learning, the deepest classifier performs soft supervision on the shallow ones to maximize their performance and training speed. At the same time, to mitigate the vulnerability of performance to the location and number settings of intermediate classifiers in the Early-exit paradigm, we propose a Position-Adaptive residual network. It can adjust the number of layers in each block at different curve positions, so it can focus on important positions of the curve (e.g.: Raman peak), and accurately allocate the appropriate computational budget based on task performance and computing resources. To the best of our knowledge, this paper is the first attempt to conduct optimization by adaptive inference for spectral detection under the IoT platform. We conducted many experiments, the experimental results show that our proposed method can achieve higher performance with less computational budget than existing methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。