世界模型

Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Models

Anna A. Ivanova, Aalok Sathe, Benjamin Lipkin, Unnathi Kumar, Setayesh Radkani, Thomas H. Clark, Carina Kauf, Jennifer Hu, R. T. Pramod, Gabriel Grand, Vivian Paulun, Maria Ryskina, Ekin Akyürek, Ethan Wilcox, Nafisa Rashid, Leshem Choshen, Roger Levy, Evelina Fedorenko, Joshua Tenenbaum, Jacob Andreas

机构 * Georgia Tech（佐治亚理工学院） ； Johns Hopkins University（约翰霍普金斯大学） ； UC Berkeley（加州大学伯克利分校） ； Brown University（布朗大学） ； Vector Institute（向量研究所） ； MIT-IBM Watson AI（MIT-IBM沃森人工智能实验室） ； MIT（麻省理工学院） ； Georgetown University（乔治城大学） 纠错

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

Comments Accepted to Transactions of the ACL (TACL). Contains 25 pages (14 main), 6 figures. Visit http://ewok-core.github.io for data and code. Authors Anna Ivanova, Aalok Sathe, Benjamin Lipkin contributed equally

Unified Vision-Language-Action Model

Yuqi Wang, Xinghang Li, Wenxuan Wang, Junbo Zhang, Yingyan Li, Yuntao Chen, Xinlong Wang, Zhaoxiang Zhang

机构 * CASIA（中国科学院自动化研究所） ； BAAI（阿里巴巴人工智能研究院） ； THU（清华大学） ； HKISI（香港理工大学） 纠错

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.CV、cs.RO

Comments technical report

Memory Allocation in Resource-Constrained Reinforcement Learning

Massimiliano Tamborski, David Abel

机构 * School of Informatics University of Edinburgh（信息学院爱丁堡大学） 纠错

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

Comments RLDM 2025

RLHS: Mitigating Misalignment in RLHF with Hindsight Simulation

Kaiqu Liang, Haimin Hu, Ryan Liu, Thomas L. Griffiths, Jaime Fernández Fisac

机构 * Princeton University（普林斯顿大学） 纠错

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

Comments 27 pages, 18 figures

CityGPT: Empowering Urban Spatial Cognition of Large Language Models

Jie Feng, Tianhui Liu, Yuwei Du, Siqi Guo, Yuming Lin, Yong Li

机构 * Department of Electronic Engineering, BNRist, Tsinghua University（电子工程系、BNRist、清华大学） ； School of Electronic and Information Engineering, Beijing Jiaotong University（电子信息工程学院、北京交通大学） ； Department of Electronic Engineering, Tsinghua University（电子工程系、清华大学） ； Department of Urban Planning, Tsinghua University（城市规划系、清华大学） 纠错

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

Comments Accepted by KDD 2025 Research Track, https://github.com/tsinghua-fib-lab/CityGPT

AXIOM: Learning to Play Games in Minutes with Expanding Object-Centric Models

Conor Heins, Toon Van de Maele, Alexander Tschantz, Hampus Linander, Dimitrije Markovic, Tommaso Salvatori, Corrado Pezzato, Ozan Catal, Ran Wei, Magnus Koudahl, Marco Perin, Karl Friston, Tim Verbelen, Christopher Buckley

机构 * VERSES AI ； University of Sussex, Department of Informatics（苏塞克斯大学信息学院） ； Technische Universität Dresden, Faculty of Psychology（德累斯顿技术大学心理学系） ； University College London, Queen Square Institute of Neurology（伦敦大学学院 Queen Square 神经学研究所） 纠错

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

Comments 10 pages main text, 4 figures, 2 tables; 25 pages supplementary material, 8 figures

Video-GPT via Next Clip Diffusion

Shaobin Zhuang, Zhipeng Huang, Ying Zhang, Fangyikang Wang, Canmiao Fu, Binxin Yang, Chong Sun, Chen Li, Yali Wang

机构 * Shanghai Jiao Tong University（上海交通大学） ； University of Science and Technology of China（中国科学技术大学） ； WeChat Vision, Tencent Inc.（腾讯微信视觉团队） ； Zhejiang University（浙江大学） ； Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences Shanghai AI Laboratory（深圳先进技术研究院、中国科学院上海人工智能实验室） 纠错

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.CV

Comments 22 pages, 12 figures, 18 tables

MAGI-1: Autoregressive Video Generation at Scale

Sand. ai, Hansi Teng, Hongyu Jia, Lei Sun, Lingzhi Li, Maolin Li, Mingqiu Tang, Shuai Han, Tianning Zhang, W. Q. Zhang, Weifeng Luo, Xiaoyang Kang, Yuchen Sun, Yue Cao, Yunpeng Huang, Yutong Lin, Yuxin Fang, Zewei Tao, Zheng Zhang, Zhongshu Wang, Zixun Liu, Dai Shi, Guoli Su, Hanwen Sun, Hong Pan, Jie Wang, Jiexin Sheng, Min Cui, Min Hu, Ming Yan, Shucheng Yin, Siran Zhang, Tingting Liu, Xianping Yin, Xiaoyu Yang, Xin Song, Xuan Hu, Yankai Zhang, Yuqiao Li

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.CV

Can Large Language Models Play Text Games Well? Current State-of-the-Art and Open Questions

Chen Feng Tsai, Xiaochen Zhou, Sierra S. Liu, Jing Li, Mo Yu, Hongyuan Mei

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

POp-GS: Next Best View in 3D-Gaussian Splatting with P-Optimality

Joey Wilson, Marcelino Almeida, Sachit Mahajan, Martin Labrie, Maani Ghaffari, Omid Ghasemalizadeh, Min Sun, Cheng-Hao Kuo, Arnab Sen

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.CV、cs.RO

SCOOP: A Framework for Proactive Collaboration and Social Continual Learning through Natural Language Interaction andCausal Reasoning

Dimitri Ognibene, Sabrina Patania, Luca Annese, Cansu Koyuturk, Franca Garzotto, Giuseppe Vizzari, Azzurra Ruggeri, Simone Colombani

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.RO、cs.MA

Comments 5 pages

A Representationalist, Functionalist and Naturalistic Conception of Intelligence as a Foundation for AGI

Rolf Pfister

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.RO

Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?

Yoshua Bengio, Michael Cohen, Damiano Fornasiere, Joumana Ghosn, Pietro Greiner, Matt MacDermott, Sören Mindermann, Adam Oberman, Jesse Richardson, Oliver Richardson, Marc-Antoine Rondeau, Pierre-Luc St-Charles, David Williams-King

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

Comments v2 with fixed formatting for URLs and hyperlinks

Efficient auto-labeling of large-scale poultry datasets (ALPD) using an ensemble model with self- and active-learning approaches

Ramesh Bahadur Bist, Lilong Chai, Shawna Weimer, Hannah Atungulua, Chantel Pennicott, Xiao Yang, Sachin Subedi, Chaitanya Pallerla, Yang Tian, Dongyi Wang

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.CV

Self-Consistent Model-based Adaptation for Visual Reinforcement Learning

Xinning Zhou, Chengyang Ying, Yao Feng, Hang Su, Jun Zhu

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.LG、cs.CV

M$^3$PC: Test-time Model Predictive Control for Pretrained Masked Trajectory Model

Kehan Wen, Yutong Hu, Yao Mu, Lei Ke

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.LG、cs.RO

Comments ICLR 2025

PhiP-G: Physics-Guided Text-to-3D Compositional Scene Generation

Qixuan Li, Chao Wang, Zongjin He, Yan Peng

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.CV

Comments 13 pages.8 figures

Revisiting Rogers' Paradox in the Context of Human-AI Interaction

Katherine M. Collins, Umang Bhatt, Ilia Sucholutsky

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

Comments Pre-print

Towards Probabilistic Inference of Human Motor Intentions by Assistive Mobile Robots Controlled via a Brain-Computer Interface

Xiaoshan Zhou, Carol M. Menassa, Vineet R. Kamat

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.LG、cs.RO

Comments 10 pages

A Data-Centric Perspective on Evaluating Machine Learning Models for Tabular Data

Andrej Tschalzev, Sascha Marton, Stefan Lüdtke, Christian Bartelt, Heiner Stuckenschmidt

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

SplatR : Experience Goal Visual Rearrangement with 3D Gaussian Splatting and Dense Feature Matching

Arjun P S, Andrew Melnik, Gora Chand Nandi

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.CV、cs.RO

Free Energy Projective Simulation (FEPS): Active inference with interpretability

Joséphine Pazem, Marius Krumm, Alexander Q. Vining, Lukas J. Fiderer, Hans J. Briegel

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

Comments 26 pages (including 5 pages appendix), 6 figures

Dreaming to Assist: Learning to Align with Human Objectives for Shared Control in High-Speed Racing

Jonathan DeCastro, Andrew Silva, Deepak Gopinath, Emily Sumner, Thomas M. Balch, Laporsha Dees, Guy Rosman

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.RO

Comments Accepted to CoRL 2024, Munich, Germany

Offline Inverse Constrained Reinforcement Learning for Safe-Critical Decision Making in Healthcare

Nan Fang, Guiliang Liu, Wei Gong

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

Benchmarking General-Purpose In-Context Learning

Fan Wang, Chuan Lin, Yang Cao, Yu Kang

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

Anatomy of a Robotaxi Crash: Lessons from the Cruise Pedestrian Dragging Mishap

Philip Koopman

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.RO

Comments 15 pages, 2 figures

Differentiable Tree Search Network

Dixant Mittal, Wee Sun Lee

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous Systems

Jianliang He, Siyu Chen, Fengzhuo Zhang, Zhuoran Yang

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.AI、cs.LG

Comments 47 pages, accepted by ICML 2024

Modeling the Real World with High-Density Visual Particle Dynamics

William F. Whitney, Jacob Varley, Deepali Jain, Krzysztof Choromanski, Sumeet Singh, Vikas Sindhwani

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.LG、cs.RO

Vectorized Representation Dreamer (VRD): Dreaming-Assisted Multi-Agent Motion-Forecasting

Hunter Schofield, Hamidreza Mirkhani, Mohammed Elmahgiubi, Kasra Rezaee, Jinjun Shan

专题命中 通用世界模型 ：world model(abstract)；world model(abstract)；分类 cs.LG、cs.RO

Comments Accepted for publication in IEEE Intelligent Vehicle Symposium (IV 2024)