arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.02461cs.LGeess.SP
收藏

基于振动的基础模型在物联网感知中的效率与鲁棒性:案例研究

On the Efficiency and Robustness of Vibration-based Foundation Models for IoT Sensing: A Case Study

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);DEVCOM Army Research Laboratory(DEVCOM陆军研究实验室);Shanghai Jiao Tong University(上海交通大学);University of California, Los Angeles(加利福尼亚大学洛杉矶分校)

Tomoyoshi Kimura, Jinyang Li, Tianshi Wang, Denizhan Kara, Yizhuo Chen, Yigong Hu, Ruijie Wang, Maggie Wigness, Shengzhong Liu, Mani Srivastava, Suhas Diggavi, Tarek Abdelzaher

AI总结:

本文以声学与地震感知车辆分类为案例,评估类FM模型FOCAL,证明自监督预训练加微调可提升资源受限物联网场景中的推理鲁棒性、效率与环境适应能力。

摘要:

本文展示了利用未标注感知数据预训练的基于振动的基础模型(FMs)在提升一类物联网应用运行时推理鲁棒性方面的潜力。文中提出了一个采用声学和地震感知的车辆分类应用案例研究。该工作的动因是基础模型在自然语言处理和计算机视觉领域取得的成功,这促使FM概念也被推广到其他存在大量未标注数据、可用于自监督预训练的领域,物联网应用便是其中之一。物联网领域中针对特定感知模态的基础模型,可利用现有未标注传感器数据以与环境无关的方式进行预训练,随后使用少量标注数据针对当前部署场景进行微调。本文表明,预训练/微调方法提升了下游推理的鲁棒性,并有助于适应不同环境条件。更具体地说,我们在真实场景中开展案例研究,评估一个名为FOCAL的简单(基于振动的)类FM模型,证明其相比传统监督深度神经网络(DNN)具有更优的鲁棒性和适应能力。我们还证明了其相比监督方案具有更优的收敛性。研究结果凸显了基于振动的FM(以及通常受FM启发的自监督模型)在资源受限物联网环境中,于推理鲁棒性、运行时效率和模型适应(通过微调)方面的优势。

英文摘要:

This paper demonstrates the potential of vibration-based Foundation Models (FMs), pre-trained with unlabeled sensing data, to improve the robustness of run-time inference in (a class of) IoT applications. A case study is presented featuring a vehicle classification application using acoustic and seismic sensing. The work is motivated by the success of foundation models in the areas of natural language processing and computer vision, leading to generalizations of the FM concept to other domains as well, where significant amounts of unlabeled data exist that can be used for self-supervised pre-training. One such domain is IoT applications. Foundation models for selected sensing modalities in the IoT domain can be pre-trained in an environment-agnostic fashion using available unlabeled sensor data and then fine-tuned to the deployment at hand using a small amount of labeled data. The paper shows that the pre-training/fine-tuning approach improves the robustness of downstream inference and facilitates adaptation to different environmental conditions. More specifically, we present a case study in a real-world setting to evaluate a simple (vibration-based) FM-like model, called FOCAL, demonstrating its superior robustness and adaptation, compared to conventional supervised deep neural networks (DNNs). We also demonstrate its superior convergence over supervised solutions. Our findings highlight the advantages of vibration-based FMs (and FM-inspired selfsupervised models in general) in terms of inference robustness, runtime efficiency, and model adaptation (via fine-tuning) in resource-limited IoT settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑