arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2609.20800cs.CL

JEPA-Anything:跨不同世界学习预测模型

JEPA-Anything: Learning Predictive Models across Different Worlds

Taoyong Cui, Zhongyao Wang, Xinyue Xu, Weiyang Liu, Zhaochen Yu, Yuying Zhang, Qiang Gao, Mengyue Yang, Wanli Ouyang, Pheng Ann Heng, Yingcheng Wu, Zhenfei Yin, Ling Yang

AI总结:

提出领域无关的JEPA-Anything框架,基于正交预测分解,在七个领域验证了通用预测原则,提升动力学预测并获实验支持。

AI中文摘要:

世界建模使智能体能够预测后果、指导干预并从交互中学习。然而,预测模型仍然局限于特定领域:是否存在一种通用的学习原则,能够支持跨根本不同系统的世界建模?我们提出了JEPA-Anything,一种基于正交预测分解(OPF)的领域无关框架。扩展联合嵌入预测架构,OPF将潜在目标分解为互补因子,通过专用路径学习它们,并在共享预测设计中重新组合。我们在七个领域评估了JEPA-Anything:视觉、生物学、临床轨迹、控制、分子动力学、物理场和天气。实验涵盖表示学习、干预预测、分布外泛化和长时程动力学,包括10个匹配的动力学任务、对超过1000个临床事件的预测,以及跨四个系统的100步分子展开。与匹配的JEPA基线相比,JEPA-Anything在所有10个动力学任务上改进了报告指标,并将Interventional Pong上的单次干预预测误差降低了34.8%。在所有四个系统中,它实现了所比较方法中最低的一步和100步分子误差。在预测之外,一个因子指定的生物干预在细胞共培养、患者来源类器官、肿瘤碎片和小鼠中获得了实验支持;潜在轨道模式恢复了开普勒标度指数,拟合斜率为-1.4991。这些结果支持跨异质世界的共同因子化预测原则,将世界建模与干预和实验基础的科学发现联系起来。代码:此https URL

英文摘要:

World modeling enables intelligence to anticipate consequences, guide interventions, and learn from interaction. Yet predictive models remain domain-specific: can a common learning principle support world modeling across radically different systems? We introduce JEPA-Anything, a domain-agnostic framework based on orthogonal predictive factorization (OPF). Extending joint-embedding predictive architectures, OPF decomposes latent targets into complementary factors, learns them through dedicated pathways, and recombines them within a shared predictive design. We evaluate JEPA-Anything across seven domains: vision, biology, clinical trajectories, control, molecular dynamics, physical fields, and weather. Experiments span representation learning, intervention prediction, out-of-distribution generalization, and long-horizon dynamics, including 10 matched dynamics tasks, forecasting of over 1,000 clinical events, and 100-step molecular rollouts across four systems. Against matched JEPA baselines, JEPA-Anything improves reported metrics on all 10 dynamics tasks and reduces single-intervention prediction error on Interventional Pong by 34.8%. It achieves the lowest one-step and 100-step molecular errors among compared methods in all four systems. Beyond prediction, a factor-nominated biological intervention receives experimental support in cell co-cultures, patient-derived organoids, tumor fragments, and mice; latent orbital modes recover the Keplerian scaling exponent with a fitted slope of -1.4991. These results support a common factorized predictive principle across heterogeneous worlds, connecting world modeling with intervention and experimentally grounded scientific discovery. Code: https://github.com/Gen-Verse/JEPA-Anything

补充信息

↑