Empowering Time Series Analysis with Foundation Models: A Comprehensive Survey
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));The Hong Kong University of Science and Technology(香港科学与技术大学);Shanghai University of Finance and Economics(上海财经大学)
Jiexia Ye, Yongzi Yu, Weiqi Zhang, Le Wang, Jia Li, Fugee Tsung
Time series data are ubiquitous across diverse real-world applications, making time series analysis critically important. Traditional approaches are largely task-specific, offering limited functionality and poor transferability. In recent years, foundation models have revolutionized NLP and CV with their remarkable cross-task transferability, zero-/few-shot learning capabilities, and multimodal integration capacity. This success has motivated increasing efforts to explore foundation models for addressing time series modeling challenges. Although some tutorials and surveys were published in the early stages of this field, the rapid pace of recent developments necessitates a more comprehensive and in-depth synthesis to cover the latest advances. Our survey aims to fill this gap by introducing a modality-aware, challenge-oriented perspective, which reveals how foundation models pre-trained on different modalities face distinct hurdles when adapted to time series tasks. Building on this perspective, we propose a taxonomy of existing works organized by pre-training modality (time series, language, and vision), analyze modality-specific challenges and categorize corresponding solutions, discussing their advantages and limitations. Beyond this, we review real-world applications to illustrate domain-specific advancements, provide open-source codes, and conclude with potential future research directions in this rapidly evolving field.
Low-Rank Adaptation for Foundation Models: A Comprehensive Review
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Yale University(耶鲁大学);Nanyang Technological University(南洋理工大学);Central University of Finance and Economics(中央财经大学);The Chinese University of Hong Kong(香港中文大学);Xi’an University of Electronic Science and Technology(西安电子科技大学);University of California, Davis(加州大学戴维斯分校);The University of Cambridge(剑桥大学);LOGS AI
Empowering Time Series Analysis with Synthetic Data: A Survey and Outlook in the Era of Foundation Models
Salesforce AI Research(Salesforce AI研究院);National University of Singapore(新加坡国立大学);Squirrel Ai Learning(松鼠人工智能学习);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Experts
Salesforce AI Research(Salesforce AI研究院);National University of Singapore(新加坡国立大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
BudgetThinker: Empowering Budget-aware LLM Reasoning with Control Tokens
Institute for AI Industry Research (AIR) Tsinghua University(人工智能产业研究院(AIR)清华大学);Global Innovation Exchange & Department of Automation Tsinghua University(全球创新交流中心及自动化系 清华大学)
Empowering Precision Medicine: AI-Driven Schizophrenia Diagnosis via EEG Signals: A Comprehensive Review from 2002-2023
The Graduate School of Biomedical Engineering, UNSW Sydney(新南威尔士大学悉尼分校生物医学工程研究生院);Data Science and Computational Intelligence Institute, University of Granada(格拉纳达大学数据科学与计算智能研究所);UNSW Data Science Hub, The University of New South Wales(新南威尔士大学数据科学中心);Centre for Applied Artificial Intelligence, Macquarie University(麦考瑞大学应用人工智能中心);School of Computing, Macquarie University(麦考瑞大学计算学院);School of Mathematics, Physics and Computing, University of Southern Queensland(南昆士兰大学数学、物理与计算学院);Department of Psychiatry, University of Cambridge(剑桥大学精神病学系)
Empowering VLMs for Few-Shot Multimodal Time Series Classification via Tailored Agentic Reasoning
Sun Yat-sen University(中山大学);Xiaomi Corporation(小米公司);University of Science and Technology of China(中国科学技术大学);National University of Singapore(新加坡国立大学)
Intelligently Augmented Contrastive Tensor Factorization: Empowering Multi-dimensional Time Series Classification in Low-Data Environments
Engineering Product Development Singapore University of Technology and Design(新加坡科技与设计大学工程产品开发学院);School of Automation Chongqing University(重庆大学自动化学院);Institute for Infocomm Research Agency for Science, Technology and Research(信息与通信研究所);School of Electrical and Electronics Engineering Nanyang Technological University(南洋理工大学电子与电气工程学院)
Multimodal Clinical Benchmark for Emergency Care (MC-BEC): A Comprehensive Benchmark for Evaluating Foundation Models in Emergency Medicine
Harvard Medical School(哈佛医学院);Stanford University(斯坦福大学);Harvard John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院)
Unraveling Spatio-Temporal Foundation Models via the Pipeline Lens: A Comprehensive Review
University of Electronic Science and Technology of China(电子科技大学);Aalborg University(奥尔堡大学);Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州))
An Electrocardiogram Multi-task Benchmark with Comprehensive Evaluations and Insightful Findings
Department of Computer Science, Emory University(埃默里大学计算机科学系);Bakar Computational Health Sciences Institute, University of California, San Francisco(加州大学旧金山分校巴卡计算健康科学研究所);Center for Data Science, School of Nursing, Emory University(埃默里大学护理学院数据科学中心);Department of Computer Science, University of Southern California(南加州大学计算机科学系)
A Foundation Chemical Language Model for Comprehensive Fragment-Based Drug Discovery
Advanced Technology Core for Macromolecular X-Ray Crystallography(宏分子X射线衍射先进技术核心);Verna and Marrs McLean Dept. of Biochemistry and Molecular Pharmacology(韦纳和玛里斯麦克莱恩生物化学与分子药理学系);Dept. of Molecular & Cellular Biology(分子与细胞生物学系);Dept. of Molecular Virology & Microbiology(分子病毒学与微生物学系);Baylor College of Medicine(贝勒医学院)
University of Notre Dame(诺丁汉大学);University of Connecticut(康涅狄格大学);University of Virginia(弗吉尼亚大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Cambridge(剑桥大学);Mila - Québec AI Institute(魁北克AI研究院);Université de Montréal(蒙特利尔大学)