我们提出了一种用于电子病历(EHR)的预测世界模型,该模型将患者病史表示为动作条件下的潜在轨迹。与仅通过自回归令牌预测来建模临床事件不同,我们的框架明确将患者状态与观察到的临床动作分离,并通过状态和动作条件转移算子学习其演化。其核心是一个依赖状态的线性化预测器,该预测器传播潜在患者状态的局部变化,支持时间分辨预测、多步回滚以及动作条件模拟。经验证,生成的潜在轨迹保留了下游预测信号、时间结构以及编码器衍生表示中存在的亚组水平统计关系。我们进一步将自由运行回滚解码为原始临床特征空间,并使用任务匹配的预测基线将未来临床测量值与观察值进行评估,证明学习到的动态保留了超出潜在空间一致性的预测信息。在二分类和事件时间任务中,EHR WM 相对于规模大得多的 EHR 基础模型实现了具有竞争力的性能(尽管依赖于任务),同时参数规模小 30 倍。最后,对观察到的动作序列进行扰动会在生成的轨迹中产生相应变化,证明了学习到的动态的动作敏感性。总之,这些结果支持世界建模作为一种互补框架,用于从纵向 EHR 中学习患者演化的显式时间索引表示。
英文摘要:
We introduce a predictive world model for electronic health records (EHR) that represents patient histories as action conditioned latent trajectories. Rather than modeling clinical events solely through autoregressive token prediction, our framework explicitly separates patient states from observed clinical actions and learns their evolution through a state and action conditioned transition operator. At its core is a state dependent linearization predictor that propagates local changes in latent patient state, enabling time resolved prediction, multi step rollout, and action conditioned simulation. Empirically, we show that generated latent trajectories preserve downstream predictive signal, temporal structure, and subgroup level statistical relationships present in encoder derived representations. We further decode free running rollouts into the original clinical feature space and evaluate future clinical measurements against observed values using task matched forecasting baselines, demonstrating that the learned dynamics retain predictive information beyond latent space agreement. Across binary classification and time to event tasks, EHR WM achieves competitive, though task dependent, performance relative to substantially larger EHR foundation models while using a 30x smaller parameter footprint. Finally, perturbing observed action sequences produces corresponding changes in generated trajectories, demonstrating the action sensitivity of the learned dynamics. Together, these results support world modeling as a complementary framework for learning explicit, time indexed representations of patient evolution from longitudinal EHR.
A Comparative Study of Traditional Machine Learning, Deep Learning, and Large Language Models for Mental Health Forecasting using Smartphone Sensing Data
Singapore University of Technology and Design(新加坡科技设计大学);Tianqiao and Chrissy Chen Institute(田桥和克里斯西·陈研究所);Nanyang Technological University(南洋理工大学);Purdue University(普渡大学)
SACQ: Structured Decoding with Memory-Conditioned Refinement for Long-Horizon Forecasting
University of Science and Technology Beijing(北京科技大学);Zhejiang University of Technology(浙江工业大学);Institution of Artificial Intelligence, University of Science and Technology Beijing(北京科技大学人工智能研究院)
When2What: A Timing-Conditioned Framework for Long-Horizon Forecasting of Continuous Cardiovascular Waveforms
Indiana University Bloomington(印第安纳大学布鲁明顿分校);Indiana University School of Medicine(印第安纳大学医学院);Fuwai Hospital, National Centre for Cardiovascular Diseases, Chinese Academy of Medical Sciences & Peking Union Medical College(中国医学科学院阜外医院(国家心血管病中心、北京协和医学院));Tianjin Chest Hospital, Tianjin University(天津大学附属天津胸科医院);Nanjing Drum Tower Hospital, Affiliated Hospital of Medical School, Nanjing University(南京大学医学院附属南京鼓楼医院);Xiangya Hospital, Central South University(中南大学湘雅医院);University of California Davis School of Medicine(加州大学戴维斯分校医学院);Microsoft(微软公司)
DECODE: Dual-Enhanced Conditioned Diffusion for EEG Forecasting
Concordia Institute for Information Systems Engineering (CIISE), Concordia University, Canada. Department of Electrical;Computer Engineering, University of Toronto, Canada
Sera: Semantic Representation Aggregation with Knowledge and LLM for Reliable and Interpretable Battery Health Forecasting
Singapore Institute of Technology(新加坡理工学院);Singapore University of Social Sciences(新加坡社科大学);Shanghai Jiao Tong University(上海交通大学);Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局);Institute of Advanced Intelligence and Computing (IAIC), Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局高级智能与计算研究所);Institute of Materials Research and Engineering (IMRE), Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局材料研究与工程研究所)
TimelyGPT: Extrapolatable Transformer Pre-training for Long-term Time-Series Forecasting in Healthcare
School of Computer Science, McGill University(麦吉尔大学计算机学院);School of Population and Global Health, McGill University(麦吉尔大学人口与全球健康学院);Mila Quebec AI institute(米拉魁北克人工智能研究所)
提出 TimelyGPT,通过 xPos、循环注意力与时间卷积实现可外推时间序列预训练,在连续生物信号和不规则 EHR 数据上提升长期预测表现。
Enhancing Prediction and Analysis of UK Road Traffic Accident Severity Using AI: Integration of Machine Learning, Econometric Techniques, and Time Series Forecasting in Public Health Research
CEDAR: Controlled and Event-Driven Demand Forecasting via Residual Decomposition
School of Artificial Intelligence and Data Science, University of Science and Technology of China(中国科学技术大学人工智能与数据科学学院);Alibaba Group(阿里巴巴集团);Thrust of Artificial Intelligence, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)人工智能学域)
Transformer self-attention encoder-decoder with multimodal deep learning for response time series forecasting and digital twin support in wind structural health monitoring
Department of Mechanical Engineering, University of Bath(巴斯大学机械工程系);Department of Civil Engineering, Zhejiang University(浙江大学土木工程系)
Synergistic Neural Forecasting of Air Pollution with Stochastic Sampling
Mohamed bin Zayed University of Artificial Intelligence(莫德尔·本·扎耶德人工智能大学);Weizmann Institute of Science(魏兹曼科学研究所);Linköping University(林雪平大学);Australian National University(澳大利亚国立大学)
Journaling Data for Daily PHQ-2 Depression Prediction and Forecasting
University of Augsburg(奥格斯堡大学);Imperial College London(帝国理工学院);GET.ON Institut für Online Gesundheitstrainings GmbH/HelloBetter(GET.ON在线健康培训研究所有限公司/HelloBetter);Technical University Munich(慕尼黑工业大学)
Hybrid Predictive Modeling of Malaria Incidence in the Amhara Region, Ethiopia: Integrating Multi-Output Regression and Time-Series Forecasting
Department of Computer Science, Injibara University(计算机科学系,因吉巴拉大学);Department of Software Engineering, Injibara University(软件工程系,因吉巴拉大学);Department of Information Technology, Injibara University(信息技术系,因吉巴拉大学);Department of Electrical/Electronic and Computer Engineering, Afe Babalola University(电子与计算机工程系,阿费·巴巴洛拉大学)