机器人 / 具身智能

Structure-aware World Model for Probe Guidance via Large-scale Self-supervised Pre-train

Haojun Jiang, Meng Li, Zhenguo Sun, Ning Jia, Yu Sun, Shaqi Luo, Shiji Song, Gao Huang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.CV

Comments Accepted by MICCAI 2024 ASMUS Workshop

LIMT: Language-Informed Multi-Task Visual World Models

Elie Aljalbout, Nikolaos Sotirakis, Patrick van der Smagt, Maximilian Karl, Nutan Chen

专题命中 具身推理 ：world model(title,abstract)；分类 cs.RO、cs.LG

Augmenting Replay in World Models for Continual Reinforcement Learning

Luke Yang, Levin Kuhlmann, Gideon Kowadlo

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Sora and V-JEPA Have Not Learned The Complete Real World Model -- A Philosophical Analysis of Video AIs Through the Theory of Productive Imagination

Jianqiu Zhang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.CV

Comments 30 pages, 9 figures

From Efficient Multimodal Models to World Models: A Survey

Xinji Mai, Zeng Tao, Junxiong Lin, Haoran Wang, Yang Chang, Yanlan Kang, Yan Wang, Wenqiang Zhang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Reinforcement Learning from Delayed Observations via World Models

Armin Karamzade, Kyungmin Kim, Montek Kalsi, Roy Fox

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Learning Abstract World Model for Value-preserving Planning with Options

Rafael Rodriguez-Sanchez, George Konidaris

专题命中 具身推理 ：world model(title)；navigation(abstract)；分类 cs.AI、cs.LG

Comments Published in the Proceedings of Reinforcement Learning Conference

Pandora: Towards General World Model with Natural Language Actions and Video States

Jiannan Xiang, Guangyi Liu, Yi Gu, Qiyue Gao, Yuting Ning, Yuheng Zha, Zeyu Feng, Tianhua Tao, Shibo Hao, Yemin Shi, Zhengzhong Liu, Eric P. Xing, Zhiting Hu

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.CV

Comments Website: https://world-model.maitrix.org/

AD3: Implicit Action is the Key for World Models to Distinguish the Diverse Visual Distractors

Yucen Wang, Shenghua Wan, Le Gan, Shuai Feng, De-Chuan Zhan

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV、cs.LG

Learning Latent Dynamic Robust Representations for World Models

Ruixiang Sun, Hongyu Zang, Xin Li, Riashat Islam

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Journal ref ICML 2024

Improving Token-Based World Models with Parallel Observation Prediction

Lior Cohen, Kaixin Wang, Bingyi Kang, Shie Mannor

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

In-Context Symmetries: Self-Supervised Learning through Contextual World Models

Sharut Gupta, Chenyu Wang, Yifei Wang, Tommi Jaakkola, Stefanie Jegelka

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV、cs.LG

Comments 32 pages, 24 tables and 11 figures

MuDreamer: Learning Predictive World Models without Reconstruction

Maxime Burchi, Radu Timofte

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.CV

GameVLM: A Decision-making Framework for Robotic Task Planning Based on Visual Language Models and Zero-sum Games

Aoran Mei, Jianhua Wang, Guo-Niu Zhu, Zhongxue Gan

专题命中 具身推理 ：robotic(title,abstract)；分类 cs.RO、cs.AI

Neurosymbolic Grounding for Compositional World Models

Atharva Sehgal, Arya Grayeli, Jennifer J. Sun, Swarat Chaudhuri

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments Uploading ICLR,2024 Camera Ready Version

On the Road to Clarity: Exploring Explainable AI for World Models in a Driver Assistance System

Mohamed Roshdi, Julian Petzold, Mostafa Wahby, Hussein Ebrahim, Mladen Berekovic, Heiko Hamann

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV、cs.LG

Comments 8 pages, 6 figures, to be published in IEEE CAI 2024

Locality Sensitive Sparse Encoding for Learning World Models Online

Zichen Liu, Chao Du, Wee Sun Lee, Min Lin

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments ICLR 2024

World Models via Policy-Guided Trajectory Diffusion

Marc Rigter, Jun Yamada, Ingmar Posner

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments Published in TMLR, March 2024

WorldGPT: A Sora-Inspired Video AI Agent as Rich World Models from Text and Image Inputs

Deshun Yang, Luhui Hu, Yu Tian, Zihao Li, Chris Kelly, Bang Yang, Cindy Yang, Yuexian Zou

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.CV

Comments 11 pages, 2 figures, 2 tables

ED2: Environment Dynamics Decomposition World Models for Continuous Control

Jianye Hao, Yifu Yuan, Cong Wang, Zhen Wang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments 10 pages, 13 figures

Do Transformer World Models Give Better Policy Gradients?

Michel Ma, Tianwei Ni, Clement Gehring, Pierluca D'Oro, Pierre-Luc Bacon

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments Michel Ma and Pierluca D'Oro contributed equally

Slot Structured World Models

Jonathan Collu, Riccardo Majellaro, Aske Plaat, Thomas M. Moerland

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV、cs.LG

Exploring the Potential of World Models for Anomaly Detection in Autonomous Driving

Daniel Bogdoll, Lukas Bosch, Tim Joseph, Helen Gremmelmaier, Yitian Yang, J. Marius Zöllner

专题命中 具身推理 ：world model(title,abstract)；分类 cs.RO、cs.AI

Comments Accepted for publication at SSCI 2023

Generalization properties of contrastive world models

Kandan Ramakrishnan, R. James Cotton, Xaq Pitkow, Andreas S. Tolias

专题命中 具身推理 ：world model(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted at the NeurIPS 2023 Workshop: Self-Supervised Learning - Theory and Practice

Gradient-based Planning with World Models

Jyothir S, Siddhartha Jalagam, Yann LeCun, Vlad Sobal

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Action Inference by Maximising Evidence: Zero-Shot Imitation from Observation with World Models

Xingyuan Zhang, Philip Becker-Ehmck, Patrick van der Smagt, Maximilian Karl

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments NeurIPS 2023

Multi Time Scale World Models

Vaisakh Shaj, Saleh Gholam Zadeh, Ozan Demir, Luiz Ricardo Douat, Gerhard Neumann

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted as spotlight at NeurIPS 2023

ADriver-I: A General World Model for Autonomous Driving

Fan Jia, Weixin Mao, Yingfei Liu, Yucheng Zhao, Yuqing Wen, Chi Zhang, Xiangyu Zhang, Tiancai Wang

专题命中 具身推理 ：world model(title,abstract)；分类 cs.RO、cs.CV

Comments Tech Report

Linear Latent World Models in Simple Transformers: A Case Study on Othello-GPT

Dean S. Hazineh, Zechen Zhang, Jeffery Chiu

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Reasoning with Language Model is Planning with World Model

Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, Zhiting Hu

专题命中 具身推理 ：world model(title,abstract)；分类 cs.AI、cs.LG

Comments EMNLP 2023. Code is available at https://github.com/Ber666/llm-reasoners