arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.10883cs.AIcs.CL
收藏

Chat-TS: 提升时间序列与自然语言数据的多模态推理能力

Chat-TS: Enhancing Multi-Modal Reasoning Over Time-Series and Natural Language Data

Electrical and Computer Engineering, Queen’s University(皇后大学电气与计算机工程学院);Mechanical and Materials Engineering, Queen’s University(皇后大学机械与材料工程学院);Ingenuity Labs Research Institute, Queen’s University(皇后大学创新实验室研究 institute)

Paul Quinlan, Qingguo Li, Xiaodan Zhu

AI总结:

Chat-TS通过整合时间序列标记提升多模态推理能力,提供新数据集和训练策略,在保持自然语言能力的同时增强时间序列推理性能。

摘要:

大型语言模型正被迅速应用于许多领域,如医疗、金融、交通和能源,其中时间序列数据是基本组成部分。当前的工作在处理同时涉及时间序列和相应文本内容的推理方面仍存在局限。我们通过引入Chat-TS,一种基于大型语言模型(LLM)的框架,来解决这一差距。不同于传统模型,Chat-TS将时间序列标记整合到LLM的词汇中,从而增强其对两种模态的推理能力,而不影响核心自然语言能力。为了支持学习和评估,我们贡献了新的数据集:TS Instruct训练数据集(将多样化的时序数据与相关的文本指令和响应配对用于指令微调)、TS Instruct问题与答案(QA)黄金数据集(多选问题以评估多模态推理)以及TS Instruct定量探测集(一个TS Instruct QA推理任务的小子集,配合数学和决策问题用于LLM评估)。我们设计了一种训练策略,以保留LLM的固有推理能力,同时增强其对时间序列的推理能力。实验显示,Chat-TS在多模态推理任务中实现了最先进的性能,通过保持强大的自然语言能力同时提升时间序列推理能力。

英文摘要:

Large language models are being rapidly deployed across many fields such as healthcare, finance, transportation, and energy, where time-series data are fundamental components. The current works are still limited in their ability to perform reasoning that involves both time-series and the corresponding textual content. We address this gap by introducing Chat-TS, a large language model (LLM) based framework designed to support reasoning over time series and textual data. Unlike traditional models, Chat-TS integrates time-series tokens into LLMs' vocabulary, enhancing its reasoning ability over both modalities without compromising core natural language capabilities. To support learning and evaluation, we contribute new datasets: the TS Instruct Training Dataset (pairing diverse time-series data with relevant text instructions and responses for instruction tuning), the TS Instruct Question and Answer (QA) Gold Dataset (multiple-choice questions to evaluate multimodal reasoning), and a TS Instruct Quantitative Probing Set (a small subset of TS Instruct QA reasoning tasks alongside math and decision-making questions for LLM evaluation). We design a training strategy to preserve the inherent reasoning capabilities of LLMs while augmenting them for time-series reasoning. Experiments show that Chat-TS achieves state-of-the-art performance in multimodal reasoning tasks by maintaining strong natural language proficiency while improving time-series reasoning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑