Time series~(TS) modeling is essential in dynamic systems like weather prediction and anomaly detection. Recent studies utilize Large Language Models (LLMs) for TS modeling, leveraging their powerful pattern recognition capabilities. These methods primarily position LLMs as the predictive backbone, often omitting the mathematical modeling within traditional TS models, such as periodicity. However, disregarding the potential of LLMs also overlooks their pattern recognition capabilities. To address this gap, we introduce \textit{LLM-TS Integrator}, a novel framework that effectively integrates the capabilities of LLMs into traditional TS modeling. Central to this integration is our \textit{mutual information} module. The core of this \textit{mutual information} module is a traditional TS model enhanced with LLM-derived insights for improved predictive abilities. This enhancement is achieved by maximizing the mutual information between traditional model's TS representations and LLM's textual representation counterparts, bridging the two modalities. Moreover, we recognize that samples vary in importance for two losses: traditional prediction and mutual information maximization. To address this variability, we introduce the \textit{sample reweighting} module to improve information utilization. This module assigns dual weights to each sample: one for prediction loss and another for mutual information loss, dynamically optimizing these weights via bi-level optimization. Our method achieves state-of-the-art or comparable performance across five mainstream TS tasks, including short-term and long-term forecasting, imputation, classification, and anomaly detection.
Integrating the Expected Future in Load Forecasts with Contextually Enhanced Transformer Models
Intelligent Maintenance and Operations Systems (IMOS)(智能维护与运营系统);École Polytechnique Fédérale de Lausanne (EPFL)(瑞士联邦理工学院洛桑分校);Department of Mechanical and Process Engineering(机械与过程工程系);Eidgenössische Technische Hochschule (ETH)(瑞士联邦理工学院(ETH));Department of Civil and Environmental Engineering(土木与环境工程系);Massachusetts Institute of Technology (MIT)(麻省理工学院)
A Materials Map Integrating Experimental and Computational Data via Graph-Based Machine Learning for Enhanced Materials Discovery
Frontier research Institute for Interdisciplinary Sciences, Tohoku University(东北大学跨学科前沿研究所);Advanced Institute for Materials Research (WPI-AIMR), Tohoku University(东北大学材料前沿研究所(WPI-AIMR))
Integrating Newton's Laws with deep learning for enhanced physics-informed compound flood modelling
Center for Complex Hydrosystems Research(复杂水系统研究中心);Department of Civil, Construction and Environmental Engineering(土木、建设与环境工程系);The University of Alabama(阿拉巴马大学)
Optimizing Search Advertising Strategies: Integrating Reinforcement Learning with Generalized Second-Price Auctions for Enhanced Ad Ranking and Bidding
Columbia University(哥伦比亚大学);University of Michigan(密歇根大学);University of California, Irvine(加利福尼亚大学尔湾分校)
GS-EMA: Integrating Gradient Surgery Exponential Moving Average with Boundary-Aware Contrastive Learning for Enhanced Domain Generalization in Aneurysm Segmentation
University of Leeds(利兹大学);University of Manchester(曼彻斯特大学)
Integrating Score-Based Diffusion Models with Machine Learning-Enhanced Localization for Advanced Data Assimilation in Geological Carbon Storage
Faculty of Civil Engineering;Geosciences, TU Delft, Stevinweg 1, 2628 CN Delft, Netherlands;Centrum Wiskunde \& Informatica, Science Park 123, 1098 XG Amsterdam, Netherlands;Simulation Group, Imperial College London, London, United Kingdom;Department of Energy Resources Engineering, Stanford University, CA, USA
FLDmamba: Integrating Fourier and Laplace Transform Decomposition with Mamba for Enhanced Time Series Prediction
University of Hong Kong(香港大学);Westlake University(西拉雅大学);University of California, Los Angeles(加州大学洛杉矶分校);Tsinghua University(清华大学);University of Queensland(昆士兰大学)
Integrating Time Series into LLMs via Multi-layer Steerable Embedding Fusion for Enhanced Forecasting
School of Software Engineering Sun Yat-Sen University(软件工程学院中山大学);Institute of Data Science(数据科学研究院);School of Computing(计算机学院);National University of Singapore(新加坡国立大学)