arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.14192cs.LGcs.CL
收藏

大语言模型如何理解时空数据?

How Can Large Language Models Understand Spatial-Temporal Data?

Dalian University of Technology(大连理工大学)

Lei Liu, Shuo Yu, Runze Wang, Zhenxun Ma, Yanming Shen

AI总结:

针对大语言模型难以适配时空数据的问题,研究提出STG-LLM框架,通过时空图分词器与极简适配器微调少量参数,实现了与专用最优方法相当的时空预测性能。

摘要:

尽管大语言模型(LLMs)在自然语言处理、计算机视觉等任务中占据主导地位,但将其能力应用于时空预测仍具挑战性。序列文本与复杂时空数据之间的差异阻碍了这一应用。为解决该问题,本文提出STG-LLM,这是一种赋能LLMs开展时空预测的创新方法。我们通过两项设计解决数据不匹配问题:1)STG-Tokenizer(时空图分词器):该时空图分词器将复杂的图数据转换为简洁的token,同时捕捉空间与时间关联;2)STG-Adapter(时空图适配器):这款极简适配器由线性编码与解码层构成,打通了分词后数据与LLM理解之间的壁垒。仅通过微调少量参数,它就能有效掌握STG-Tokenizer生成token的语义,同时保留LLMs原有的自然语言理解能力。在多个时空基准数据集上开展的大量实验表明,STG-LLM成功释放了LLM在时空预测领域的潜力,其性能可与专用的SOTA(当前最优)方法相媲美。

英文摘要:

While Large Language Models (LLMs) dominate tasks like natural language processing and computer vision, harnessing their power for spatial-temporal forecasting remains challenging. The disparity between sequential text and complex spatial-temporal data hinders this application. To address this issue, this paper introduces STG-LLM, an innovative approach empowering LLMs for spatial-temporal forecasting. We tackle the data mismatch by proposing: 1) STG-Tokenizer: This spatial-temporal graph tokenizer transforms intricate graph data into concise tokens capturing both spatial and temporal relationships; 2) STG-Adapter: This minimalistic adapter, consisting of linear encoding and decoding layers, bridges the gap between tokenized data and LLM comprehension. By fine-tuning only a small set of parameters, it can effectively grasp the semantics of tokens generated by STG-Tokenizer, while preserving the original natural language understanding capabilities of LLMs. Extensive experiments on diverse spatial-temporal benchmark datasets show that STG-LLM successfully unlocks LLM potential for spatial-temporal forecasting. Remarkably, our approach achieves competitive performance on par with dedicated SOTA methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑