arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.02275cs.LG
收藏

SudokuSens:使用生成方法增强物联网传感应用的深度学习鲁棒性

SudokuSens: Enhancing Deep Learning Robustness for IoT Sensing Applications using a Generative Approach

University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Shanghai Jiao Tong University(上海交通大学);IBM T. J. Watson Research Center(IBM T. J. 沃森研究中心)

Tianshi Wang, Jinyang Li, Ruijie Wang, Denizhan Kara, Shengzhong Liu, Davis Wertheimer, Antoni Viros-i-Martin, Raghu Ganti, Mudhakar Srivatsa, Tarek Abdelzaher

AI总结:

SudokuSens提出一种生成框架,利用条件变分自编码器和会话感知时间对比学习,将物联网训练数据需求从乘性降至近线性,显著提升深度学习模型在数据收集昂贵场景下的鲁棒性。

摘要:

本文介绍了SudokuSens,一个用于基于机器学习的物联网(IoT)应用中自动生成训练数据的生成框架,使得生成的合成数据能够模拟实际传感器数据收集过程中未遇到过的实验配置。该框架提高了所得到的深度学习模型的鲁棒性,旨在用于数据收集成本高昂的物联网应用。这项工作的动机源于这样一个事实:物联网时间序列数据将观测对象的特征与周围环境的混杂固有属性以及所经历的动态环境扰动纠缠在一起。为了将足够的多样性纳入物联网训练数据,因此需要考虑训练案例的组合爆炸,这些训练案例在考虑的对象数量以及可能遇到这些对象的环境条件数量上是乘性的。我们的框架大幅减少了这些乘性的训练需求。为了将对象特征与环境条件解耦,我们采用了条件变分自编码器(CVAE),这使我们能够将数据收集需求从乘性降低到(几乎)线性,同时合成生成缺失条件的数据。为了获得对动态扰动的鲁棒性,我们采用了会话感知的时间对比学习方法。整合上述两种方法,SudokuSens显著提高了深度学习在物联网应用中的鲁棒性。我们探讨了SudokuSens在不同数据集中对下游推理任务的益处程度,并讨论了该方法特别有效的条件。

英文摘要:

This paper introduces SudokuSens, a generative framework for automated generation of training data in machine-learning-based Internet-of-Things (IoT) applications, such that the generated synthetic data mimic experimental configurations not encountered during actual sensor data collection. The framework improves the robustness of resulting deep learning models, and is intended for IoT applications where data collection is expensive. The work is motivated by the fact that IoT time-series data entangle the signatures of observed objects with the confounding intrinsic properties of the surrounding environment and the dynamic environmental disturbances experienced. To incorporate sufficient diversity into the IoT training data, one therefore needs to consider a combinatorial explosion of training cases that are multiplicative in the number of objects considered and the possible environmental conditions in which such objects may be encountered. Our framework substantially reduces these multiplicative training needs. To decouple object signatures from environmental conditions, we employ a Conditional Variational Autoencoder (CVAE) that allows us to reduce data collection needs from multiplicative to (nearly) linear, while synthetically generating (data for) the missing conditions. To obtain robustness with respect to dynamic disturbances, a session-aware temporal contrastive learning approach is taken. Integrating the aforementioned two approaches, SudokuSens significantly improves the robustness of deep learning for IoT applications. We explore the degree to which SudokuSens benefits downstream inference tasks in different data sets and discuss conditions under which the approach is particularly effective.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑