UniZero: Generalized and Efficient Planning with Scalable Latent World Models
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);SenseTime Research(商汤科技研究院);The Chinese University of Hong Kong(香港中文大学);Shanghai Jiao Tong University(上海交通大学)
Learning predictive world models is crucial for enhancing the planning capabilities of reinforcement learning (RL) agents. Recently, MuZero-style algorithms, leveraging the value equivalence principle and Monte Carlo Tree Search (MCTS), have achieved superhuman performance in various domains. However, these methods struggle to scale in heterogeneous scenarios with diverse dependencies and task variability. To overcome these limitations, we introduce UniZero, a novel approach that employs a modular transformer-based world model to effectively learn a shared latent space. By concurrently predicting latent dynamics and decision-oriented quantities conditioned on the learned latent history, UniZero enables joint optimization of the long-horizon world model and policy, facilitating broader and more efficient planning in the latent space. We show that UniZero significantly outperforms existing baselines in benchmarks that require long-term memory. Additionally, UniZero demonstrates superior scalability in multitask learning experiments conducted on Atari benchmarks. In standard single-task RL settings, such as Atari and DMControl, UniZero matches or even surpasses the performance of current state-of-the-art methods. Finally, extensive ablation studies and visual analyses validate the effectiveness and scalability of UniZero's design choices. Our code is available at \textcolor{magenta}{https://github.com/opendilab/LightZero}.
One Model for All Tasks: Leveraging Efficient World Models in Multi-Task Planning
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Chinese University of Hong Kong MMLab(香港中文大学 MMLab);University of Science and Technology of China(中国科学技术大学);Novosibirsk State University(新西伯利亚州立大学);Centre for Perceptual and Interactive Intelligence(感知与交互智能中心)
Representation Learning Enables Scalable Multitask Deep Reinforcement Learning
Mila – Québec AI Institute(魁北克AI研究所);Université de Montréal(蒙特利尔大学);McGill University(麦吉尔大学);CIFAR AI Chair(CIFAR人工智能 chair);Google DeepMind(谷歌DeepMind)
PlanningBench: Generating Scalable and Verifiable Planning Data for Evaluating and Training Large Language Models
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院 Gallagher 学校);LLM Department, Hunyuan Team, Tencent(腾讯 Hunyuan 团队 LLM 部门);Beijing Academy of Artificial Intelligence(北京人工智能研究院);The Chinese University of Hong Kong(香港中文大学)
Fast and scalable retrosynthetic planning with a transformer neural network and speculative beam search
SUPSI, IDSIA(SUPSI、IDSIA);Pfizer Research and Development(辉瑞研发);Institute for Digital Technologies for Personalized Healthcare(个性化医疗数字技术研究所);KAUST(王国立科技大学);Center for Generative AI(生成人工智能中心)
Federated prediction for scalable and privacy-preserved knowledge-based planning in radiotherapy
Department of Radiation Oncology, Columbia University Irving Medical Center(放射肿瘤学系,哥伦比亚大学伊文思医疗中心);Herbert Irving Comprehensive Cancer Center, Columbia University(赫伯特·伊文思综合癌症中心,哥伦比亚大学);Data Science Institute, Columbia University(数据科学研究所,哥伦比亚大学)