CoRAST:迈向资源受限 CPS 与 IoT 中由基础模型驱动的相关数据分析
CoRAST: Towards Foundation Model-Powered Correlated Data Analysis in Resource-Constrained CPS and IoT
AI总结:
本文提出 CoRAST 框架,利用服务器端基础模型学习传感器数据的时间、空间与跨模态关联,在资源受限边缘场景中提升分布式异构数据分析,天气预测误差最高降低 50.3%。
摘要:
基础模型(FMs)正成为利用分布式且多样化环境数据的一种有前景的解决方案,其通过借助先验知识来理解异构数据集中复杂的时间和空间相关性。与联邦学习等分布式学习框架不同——这些框架往往难以处理多模态数据——FMs 能够将多样化输入转换为嵌入。这一过程促进了来自各种模态的信息整合,也促进了将先前学习应用于新领域。然而,在资源受限的边缘系统中部署 FMs 带来了重大挑战。为此,我们提出 CoRAST,这是一种新颖的学习框架,利用 FMs 来增强对分布式、相关异构数据的分析。通过使用基于服务器的 FM,CoRAST 能够利用现有环境信息提取传感器数据之间的时间、空间和跨模态相关性。这使得 CoRAST 能够通过由 FM 驱动的全局表征学习,为本地化客户端任务提供具备情境感知能力的洞察。我们在真实世界天气数据集上的评估表明,CoRAST 有能力通过环境表征学习利用相关异构数据,与基线相比将预测误差最高降低 50.3%。
英文摘要:
Foundation models (FMs) emerge as a promising solution to harness distributed and diverse environmental data by leveraging prior knowledge to understand the complicated temporal and spatial correlations within heterogeneous datasets. Unlike distributed learning frameworks such as federated learning, which often struggle with multimodal data, FMs can transform diverse inputs into embeddings. This process facilitates the integration of information from various modalities and the application of prior learning to new domains. However, deploying FMs in resource-constrained edge systems poses significant challenges. To this end, we introduce CoRAST, a novel learning framework that utilizes FMs for enhanced analysis of distributed, correlated heterogeneous data. Utilizing a server-based FM, CoRAST can exploit existing environment information to extract temporal, spatial, and cross-modal correlations among sensor data. This enables CoRAST to offer context-aware insights for localized client tasks through FM-powered global representation learning. Our evaluation on real-world weather dataset demonstrates CoRAST's ability to exploit correlated heterogeneous data through environmental representation learning to reduce the forecast errors by up to 50.3% compared to the baselines.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。