借助大语言模型的图生成以提升多变量时间序列表示学习
Graph Generation Powered with LLMs for Boosting Multivariate Time-Series Representation Learning
AI总结:
针对现有多变量时间序列图生成方法易受小数据集偏差影响的问题,提出K-Link框架,利用大语言模型的通用知识构建知识链接图并通过图对齐模块迁移知识,提升图质量与多变量时间序列表示学习效果,经实验验证在多种任务上性能优异。
摘要:
多变量时间序列(MTS)数据源自多个传感器并按时间顺序组织,蕴含关键的时空依赖关系。为捕捉这些依赖关系,图神经网络(GNN)已成为强大的工具。由于显式图并非MTS数据固有,图生成成为将GNN适配到该领域的关键第一步。然而,现有方法通常仅依赖数据本身进行MTS图生成,这使其易受小训练数据集偏差的影响。该限制削弱了它们构建有效图的能力,破坏了对MTS数据中潜在依赖关系的准确建模,并降低了GNN在该领域的性能。为解决这一挑战,我们提出了一种新颖的框架K-Link,利用大语言模型(LLM)中编码的广泛通用知识来减少偏差,以实现更强大的MTS图生成。为利用LLM中的知识(如物理原理),我们设计并提取了一个\textit{知识链接图(Knowledge-Link graph)},该图捕捉传感器及其关联的通用知识。为通过知识链接图增强MTS图生成,我们进一步引入了一个图对齐模块,将通用知识从知识链接图迁移到由MTS数据生成的图中。这提升了MTS图的质量,确保了MTS数据的有效表示学习。大量实验证明了K-Link的有效性,其在多种MTS任务上取得了优异性能。
英文摘要:
Sourced from multiple sensors and organized chronologically, Multivariate Time-Series (MTS) data involves crucial spatial-temporal dependencies. To capture these dependencies, Graph Neural Networks (GNNs) have emerged as powerful tools. As explicit graphs are not inherent to MTS data, graph generation becomes a critical first step in adapting GNNs to this domain. However, existing approaches often rely solely on the data itself for MTS graph generation, leaving them vulnerable to biases from small training datasets. This limitation hampers their ability to construct effective graphs, undermining the accurate modeling of underlying dependencies in MTS data and reducing GNN performance in this field. To address this challenge, we propose a novel framework, K-Link, leveraging the extensive universal knowledge encoded in Large Language Models (LLMs) to reduce biases for powered MTS graph generation. To harness the knowledge within LLMs, such as physical principles, we design and extract a \textit{Knowledge-Link graph} that captures universal knowledge of sensors and their linkage. To empower MTS graph generation with the knowledge-link graph, we further introduce a graph alignment module that transfers universal knowledge from the knowledge-link graph to the graph generated from MTS data. This enhances the MTS graph quality, ensuring effective representation learning for MTS data. Extensive experiments demonstrate the efficacy of K-Link for superior performance on various MTS tasks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。