arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.07830cs.AI
收藏

通过过程可验证的思维数据合成与调度实现时间序列推理

Time Series Reasoning via Process-Verifiable Thinking Data Synthesis and Scheduling for Tailored LLM Reasoning

Sun Yat-sen University(中山大学);Xiaomi Corporation(小米公司);National University of Singapore(新加坡国立大学)

Jiahui Zhou, Dan Li, Boxin Li, Xiao Zhang, Erli Meng, Lin Li, Zhuomin Chen, Jian Lou, See-Kiong Ng

AI总结:

本文提出VeriTime框架,通过数据合成、调度和强化学习训练,提升LLM在时间序列推理任务中的性能,使小模型达到或超越大模型效果。

摘要:

时间序列是一种广泛应用于各种应用领域的数据类型,合理解决多样化的时间序列任务一直是长期目标。最近,大语言模型(LLM)在强化学习(RL)中解锁的推理能力为解决具有长链思维(CoT)推理的任务提供了新机会。然而,利用LLM进行时间序列推理仍处于初级阶段,受限于缺乏精心编纂的时间序列CoT数据用于训练、由于未探索数据调度导致的数据效率低下,以及缺乏专门针对此类时间序列CoT数据的RL算法。在本文中,我们引入VeriTime,一个通过数据合成、数据调度和RL训练来定制LLM进行时间序列推理的框架。首先,我们提出了一条数据合成管道,构建具有过程可验证注释的TS-文本多模态数据集。其次,我们设计了一种数据调度机制,根据难度和任务分类学的原理安排训练样本。第三,我们开发了两阶段强化微调,具有细粒度、多目标奖励,利用可验证的进程级CoT数据。大量实验表明,VeriTime在各种时间序列推理任务中显著提升了LLM的性能。值得注意的是,它使紧凑的3B、4B模型能够达到或超过更大专有LLM的推理能力。

英文摘要:

Time series is a pervasive data type across various application domains, rendering the reasonable solving of diverse time series tasks a long-standing goal. Recent advances in large language models (LLMs), especially their reasoning abilities unlocked through reinforcement learning (RL), have opened new opportunities for tackling tasks with long Chain-of-Thought (CoT) reasoning. However, leveraging LLM reasoning for time series remains in its infancy, hindered by the absence of carefully curated time series CoT data for training, limited data efficiency caused by underexplored data scheduling, and the lack of RL algorithms tailored for exploiting such time series CoT data. In this paper, we introduce VeriTime, a framework that tailors LLMs for time series reasoning through data synthesis, data scheduling, and RL training. First, we propose a data synthesis pipeline that constructs a TS-text multimodal dataset with process-verifiable annotations. Second, we design a data scheduling mechanism that arranges training samples according to a principled hierarchy of difficulty and task taxonomy. Third, we develop a two-stage reinforcement finetuning featuring fine-grained, multi-objective rewards that leverage verifiable process-level CoT data. Extensive experiments show that VeriTime substantially boosts LLM performance across diverse time series reasoning tasks. Notably, it enables compact 3B, 4B models to achieve reasoning capabilities on par with or exceeding those of larger proprietary LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑