arXivDaily arXiv每日学术速递 周一至周五更新

视觉与机器人

世界模型

面向环境建模、时序预测、仿真规划、具身智能和自动驾驶的世界模型方法与应用。

共收录 6497 信号源:cs.AI, cs.LG, cs.CV, cs.RO, cs.MA

1. 具身与机器人 510 篇

2603.07393 2026-03-10 cs.RO cs.SY eess.SY 81%

Underwater Embodied Intelligence for Autonomous Robots: A Constraint-Coupled Perspective on Planning, Control, and Deployment

水下具身智能:一种约束耦合视角下的规划、控制与部署

Jingzehua Xu, Guanwen Xie, Jiwei Tang, Shuai Zhang, Xiaofan Li

机构 * Department of Mechanical Engineering, The University of Hong Kong(香港大学机械工程系) Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生学院) Department of Data and Systems Engineering, The University of Hong Kong(香港大学数据与系统工程系) Department of Data Science, New Jersey Institute of Technology(新泽西理工学院数据科学系)

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

AI总结 本文提出一种约束耦合视角下的水下具身智能方法,探讨了规划、控制与部署中的紧密耦合约束,旨在实现更可靠和可扩展的自主性。

Comments This article is currently under review

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.02456 2026-02-17 cs.RO 81%

InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulation

InternVLA-A1:统一理解、生成和行动以实现机器人操作

Junhao Cai, Zetao Cai, Jiafei Cao, Yilun Chen, Zeyu He, Lei Jiang, Hang Li, Hengjie Li, Yang Li, Yufei Liu, Yanan Lu, Qi Lv, Haoxiang Ma, Jiangmiao Pang, Yu Qiao, Zherui Qiu, Yanqing Shen, Xu Shi, Yang Tian, Bolun Wang, Hanqing Wang, Jiaheng Wang, Tai Wang, Xueyuan Wei, Chao Wu, Yiman Xie, Boyang Xing, Yuqiang Yang, Yuyin Yang, Qiaojun Yu, Feng Yuan, Jia Zeng, Jingjing Zhang, Shenghan Zhang, Shi Zhang, Zhuoma Zhaxi, Bowen Zhou, Yuanzhen Zhou, Yunsong Zhou, Hongrui Zhu, Yangkun Zhu, Yuchen Zhu

机构 * InternVLA-A1 Team(InternVLA-A1团队)

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

AI总结 InternVLA-A1通过统一的Transformer架构,结合语义理解和动态预测能力,提升了机器人操作任务的性能。

Comments Homepage: https://internrobotics.github.io/internvla-a1.github.io/

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.02378 2026-01-07 cs.RO 81%

Modeling the Mental World for Embodied AI: A Comprehensive Review

构建具身AI的内心世界:全面综述

Biyuan Liu, Daigang Xu, Lei Jiang, Wenjun Guo, Ping Chen

机构 * ZTE Corporation(中兴通讯公司)

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

AI总结 本文综述了具身AI中内心世界模型的研究,构建了理论框架,定义了关键组件,并分析了两种核心理论思维推理范式,以促进人机协作发展。

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.03538 2025-12-04 cs.RO 81%

AdaPower: Specializing World Foundation Models for Predictive Manipulation

AdaPower: 为预测操纵专门化世界基础模型

Yuhang Huang, Shilong Zou, Jiazhao Zhang, Xinwang Liu, Ruizhen Hu, Kai Xu

机构 * National University of Defense Technology(国防科技大学) Peking University(北京大学) Shenzhen University(深圳大学)

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

AI总结 AdaPower通过时空测试时间训练和记忆持久性机制,将通用世界基础模型转化为专门模型,提升机器人任务成功率41%

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.07417 2025-10-10 cs.RO 81%

FLEET: Formal Language-Grounded Scheduling for Heterogeneous Robot Teams

Corban Rivera, Grayson Byrd, Meghan Booker, Bethany Kemp, Allison Gaines, Emma Holmes, James Uplinger, Celso M de Melo, David Handelman

机构 * JHU APL(约翰霍普金斯大学应用物理实验室) JHU(约翰霍普金斯大学) DEVCOM ARL(国防高级研究计划局)

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.10399 2025-08-15 cs.RO 81%

Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learning

Wenlong Liang, Rui Zhou, Yang Ma, Bing Zhang, Songlin Li, Yijia Liao, Ping Kuang

机构 * University of Electronic Science and Technology of China(电子科技大学)

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.22355 2025-07-08 cs.AI 81%

Embodied AI Agents: Modeling the World

Pascale Fung, Yoram Bachrach, Asli Celikyilmaz, Kamalika Chaudhuri, Delong Chen, Willy Chung, Emmanuel Dupoux, Hongyu Gong, Hervé Jégou, Alessandro Lazaric, Arjun Majumdar, Andrea Madotto, Franziska Meier, Florian Metze, Louis-Philippe Morency, Théo Moutakanni, Juan Pino, Basile Terver, Joseph Tighe, Paden Tomasello, Jitendra Malik

机构 * Meta AI Research(Meta AI 研究)

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.03709 2025-06-05 cs.CV 81%

AetherVision-Bench: An Open-Vocabulary RGB-Infrared Benchmark for Multi-Angle Segmentation across Aerial and Ground Perspectives

Aniruddh Sikdar, Aditya Gandhamal, Suresh Sundaram

机构 * Robert Bosch Centre for Cyber Physical Systems, Indian Institute of Science, Bengaluru, India(罗伯特·博世协同物理系统中心,印度科学研究院,班加罗尔) Kotak IISc AI-ML Centre, Indian Institute of Science, Bengaluru, India(Kotak IISc AI-ML 中心,印度科学研究院,班加罗尔) Department of Aerospace Engineering, Indian Institute of Science, Bengaluru, India(航空航天工程系,印度科学研究院,班加罗尔)

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

Comments Accepted at Workshop on Foundation Models Meet Embodied Agents at CVPR 2025 (Non-archival Track)

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.07468 2025-03-04 cs.AI 81%

From Screens to Scenes: A Survey of Embodied AI in Healthcare

Yihao Liu, Xu Cao, Tingting Chen, Yankai Jiang, Junjie You, Minghua Wu, Xiaosong Wang, Mengling Feng, Yaochu Jin, Jintai Chen

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

Comments 56 pages, 11 figures, manuscript accepted by Information Fusion

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.19379 2024-10-28 cs.RO 81%

Visual Imitation Learning of Non-Prehensile Manipulation Tasks with Dynamics-Supervised Models

Abdullah Mustafa, Ryo Hanai, Ixchel Ramirez, Floris Erich, Ryoichi Nakajo, Yukiyasu Domae, Tetsuya Ogata

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

Comments Accepted to IEEE CASE 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.06236 2021-03-11 cs.RO 81%

Real-Time RGBD Odometry for Fused-State Navigation Systems

Andrew R. Willis, Kevin M. Brink

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.12215 2026-06-04 cs.RO 80%

LDA-1B: Scaling Latent Dynamics Action Model via Universal Embodied Data Ingestion

LDA-1B:通过通用具身数据摄取扩展潜动力学动作模型

Jiangran Lyu, Kai Liu, Xuheng Zhang, Haoran Liao, Yusen Feng, Wenxuan Zhu, Tingrui Shen, Jiayi Chen, Jiazhao Zhang, Yifei Dong, Wenbo Cui, Senmao Qi, Shuo Wang, Yixin Zheng, Mi Yan, Xuesong Shi, Haoran Li, Dongbin Zhao, Ming-Yu Liu, Zhizheng Zhang, Li Yi, Yizhou Wang, He Wang

机构 * Peking University(北京大学) Galbot CASIA(中国科学院自动化研究所) BAAI(北京人工智能研究院) Tsinghua University(清华大学) Sun Yat-sen University(中山大学) NVIDIA

专题命中 具身与机器人 :latent dynamics(title);world model(abstract);world model(abstract);分类 cs.RO

AI总结 提出LDA-1B机器人基础模型,通过统一格式的具身交互数据集EI-30k和结构化DINO潜空间中的动力学学习,联合建模动力学、策略和视觉预测,在接触丰富、灵巧和长时任务上分别提升高达21%、48%和23%。

Comments Accepted at RSS 2026, Project Page:https://pku-epic.github.io/LDA

详情

展开后加载摘要…

URL PDF HTML 收藏
1803.07729 2018-07-27 cs.CV cs.AI cs.CL cs.RO 80%

Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigation

Xin Wang, Wenhan Xiong, Hongmin Wang, William Yang Wang

专题命中 具身与机器人 :model-based reinforcement learning(title,abstract);environment model(abstract);分类 cs.AI、cs.CV、cs.RO

Comments 21 pages, 7 figures, with supplementary material

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.22845 2025-12-01 eess.SP 80%

Embodied Intelligent Wireless (EIW): Synesthesia of Machines Empowered Wireless Communications

具身智能无线通信(EIW):由机器的通感能力赋能的无线通信

Xiang Cheng, Weibo Wen, Haotian Zhang, Boxun Liu, Zonghui Yang, Jianan Zhang, Xuesong Cai

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

AI总结 本文提出EIW范式,通过具身智能理念重新定义无线通信节点,实现环境感知、决策与行动的闭环,提升无线通信系统的适应性和智能性。

详情

展开后加载摘要…

URL PDF HTML 收藏
1902.05485 2019-10-14 cs.NE 80%

Engineered Self-Organization for Resilient Robot Self-Assembly with Minimal Surprise

Tanja Katharina Kaiser, Heiko Hamann

专题命中 具身与机器人 :world model(abstract);world models(abstract);world model(abstract);world models(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.11997 2026-05-27 cs.LG cs.AI cs.RO 78%

Continual Model-Based Reinforcement Learning with Hypernetworks

基于超网络的连续模型强化学习

Yizhou Huang, Kevin Xie, Homanga Bharadhwaj, Florian Shkurti

机构 * Division of Engineering Science, University of Toronto, Canada(多伦多大学工程科学系) Department of Computer Science, University of Toronto, Canada(多伦多大学计算机科学系)

专题命中 具身与机器人 :model-based reinforcement learning(title,abstract);分类 cs.AI、cs.LG、cs.RO;dynamics model(abstract)

AI总结 提出HyperCRL方法,利用任务条件超网络在序列任务中持续学习动力学模型,避免重新训练并固定存储开销,在机器人 locomotion 和 manipulation 任务中优于现有持续学习方法。

Comments Updated link to project website in the abstract. 7 pages (+2 pages in appendix), 8 figures. In proceedings of the 2021 IEEE International Conference on Robotics and Automation

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.07746 2026-08-11 cs.LG cs.RO 新提交 78%

LUCID: Latent-Skill Unified Control via Imagined Dynamics for Long-Horizon Humanoid Loco-Manipulation

LUCID:基于想象动力学的潜在技能统一控制用于长程人形机器人移动操作

Cheng Guo, Mingzhe Ni, Angelo Cangelosi, Arash Ajoudani

专题命中 具身与机器人 :world model(abstract);world model(abstract);model-based reinforcement learning(abstract);分类 cs.LG、cs.RO

AI总结 该研究针对人形机器人长程移动操作的复杂序列任务,提出分层基于模型的强化学习框架LUCID,经模拟多物体重排实验验证,其任务成功率优于现有基线方法。

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.02857 2026-02-04 cs.RO 78%

Latent Perspective-Taking via a Schrödinger Bridge in Influence-Augmented Local Models

通过影响增强的局部模型实现潜在的视角转换

Kevin Alcedo, Pedro U. Lima, Rachid Alami

机构 * Institute for Systems and Robotics(系统与机器人研究所) Universidade de Lisboa(里斯本大学) LAAS-CNRS(拉沙尔国家研究中心) Artificial and Natural Intelligence Toulouse Institute (ANITI)(图卢兹人工智能与自然智能研究所)

专题命中 具身与机器人 :world model(abstract,comments);world model(abstract,comments);model-based reinforcement learning(abstract);分类 cs.RO

AI总结 本文提出了一种基于影响增强的局部模型和施罗德桥的神经符号框架,用于实现机器人在社交交互中的心理状态推断和决策规划。

Comments Extended Abstract & Poster, Presented at World Modeling Workshop 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.12418 2023-01-24 cs.RO cs.AI cs.HC cs.LG 77%

MILD: Multimodal Interactive Latent Dynamics for Learning Human-Robot Interaction

Vignesh Prasad, Dorothea Koert, Ruth Stock-Homburg, Jan Peters, Georgia Chalvatzaki

专题命中 具身与机器人 :latent dynamics(title,abstract);分类 cs.AI、cs.LG、cs.RO

Comments Accepted at the IEEE-RAS International Conference on Humanoid Robots (Humanoids) 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
1905.13402 2020-05-19 cs.LG cs.AI cs.RO stat.ML 77%

Safety Augmented Value Estimation from Demonstrations (SAVED): Safe Deep Model-Based RL for Sparse Cost Robotic Tasks

Brijen Thananjeyan, Ashwin Balakrishna, Ugo Rosolia, Felix Li, Rowan McAllister, Joseph E. Gonzalez, Sergey Levine, Francesco Borrelli, Ken Goldberg

专题命中 具身与机器人 :model-based RL(title);model-based reinforcement learning(abstract);分类 cs.AI、cs.LG、cs.RO

Comments Robotics and Automation Letters and International Conference on Robotics and Automation 2020. First two authors contributed equally

Journal ref Robotics and Automation Letters 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.12410 2023-10-20 cs.LG cs.RO stat.ML 76%

EDGI: Equivariant Diffusion for Planning with Embodied Agents

Johann Brehmer, Joey Bose, Pim de Haan, Taco Cohen

专题命中 具身与机器人 :world model(abstract);world model(abstract);model-based reinforcement learning(abstract);分类 cs.LG、cs.RO

Comments Accepted at NeurIPS 2023. v2: matches camera-ready version

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.09864 2023-09-20 cs.AI 76%

Learning Spatial and Temporal Hierarchies: Hierarchical Active Inference for navigation in Multi-Room Maze Environments

Daria de Tinguy, Toon Van de Maele, Tim Verbelen, Bart Dhoedt

专题命中 具身与机器人 :world model(abstract,comments);world model(abstract,comments);world models(comments);分类 cs.AI

Comments IROS 2023 Workshop World Models and Predictive Coding in Cognitive Robotics. arXiv admin note: text overlap with arXiv:2306.13546

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.21585 2025-05-01 cs.RO cs.AI cs.SY eess.SY 76%

Multi-Goal Dexterous Hand Manipulation using Probabilistic Model-based Reinforcement Learning

Yingzhuo Jiang, Wenjun Huang, Rongdun Lin, Chenyang Miao, Tianfu Sun, Yunduan Cui

机构 * University of Chinese Academy of Sciences(中国科学院大学) Shenzhen Institutes of Advanced Technology(深圳先进技术研究院)

专题命中 具身与机器人 :model-based reinforcement learning(title,abstract);分类 cs.AI、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.01867 2024-04-03 cs.RO cs.LG 76%

Active Exploration in Bayesian Model-based Reinforcement Learning for Robot Manipulation

Carlos Plou, Ana C. Murillo, Ruben Martinez-Cantin

专题命中 具身与机器人 :model-based reinforcement learning(title);model-based RL(abstract);分类 cs.LG、cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.05257 2023-12-12 cs.RO cs.AI 76%

Autonomous Port Navigation With Ranging Sensors Using Model-Based Reinforcement Learning

Siemen Herremans, Ali Anwar, Arne Troch, Ian Ravijts, Maarten Vangeneugden, Siegfried Mercelis, Peter Hellinckx

专题命中 具身与机器人 :model-based reinforcement learning(title,abstract);分类 cs.AI、cs.RO

Comments Presented at 42nd International Conference on Ocean, Offshore & Arctic Engineering. June 11 - 16, 2023. Melbourne, Australia

Journal ref Proceedings of the ASME 2023 42nd International Conference on Ocean, Offshore and Arctic Engineering. Volume 5: Ocean Engineering. Melbourne, Australia. June 11-16, 2023. V005T06A072. ASME

详情

展开后加载摘要…

URL PDF HTML 收藏
2608.22067 2026-08-26 cs.RO cs.AI cs.CV cs.LG 版本更新 75%

Inferring Action from Future Latent State for Robotic Manipulation

从未来隐状态推断机器人操纵动作

Fenghao Lei, Zhixiong Huang, Long Yang, Jiabao Chen, Peilin Huang, Han Fu, Zhuo Li, Xiaoxue Ren

机构 * DeepLeap Research(DeepLeap研究院)

专题命中 具身与机器人 :world model(abstract);world model(abstract);分类 cs.AI、cs.LG、cs.CV

AI总结 本文提出无需视频生成的机器人操纵模型DELE-w0.5,通过从捕获动作相关物理结果的未来隐状态推断动作,在4项长程操纵任务的480次试验中,其性能优于最强基线47.5和30.7个百分点,实现最优表现。

详情

展开后加载摘要…

URL PDF HTML 收藏
2603.23481 2026-03-25 cs.RO cs.AI cs.CV cs.LG 75%

VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAs

VTAM:用于复杂物理交互的视频-触觉-动作模型超越VLAs

Haoran Yuan, Weigang Yi, Zhenyu Zhang, Wendi Chen, Yuchen Mo, Jiashi Yin, Xinzhuo Li, Xiangyu Zeng, Chuan Wen, Cewu Lu, Katherine Driggs-Campbell, Ismini Lourentzou

机构 * University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校) Stanford University(斯坦福大学) Shanghai Jiao Tong University(上海交通大学)

专题命中 具身与机器人 :world model(abstract);world model(abstract);分类 cs.AI、cs.LG、cs.CV

AI总结 VTAM通过整合触觉感知提升复杂物理交互的稳定性,其多模态框架在接触密集任务中表现优异,成功率达到90%。

Comments https://plan-lab.github.io/projects/vtam/

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.00739 2025-10-02 cs.LG 75%

TD-JEPA: Latent-predictive Representations for Zero-Shot Reinforcement Learning

Marco Bagatella, Matteo Pirotta, Ahmed Touati, Alessandro Lazaric, Andrea Tirinzoni

机构 * FAIR at Meta(Meta 的 FAIR) ETH Zurich(苏黎世联邦理工学院)

专题命中 具身与机器人 :world model(abstract);world model(abstract);latent dynamics(abstract);分类 cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
1503.05079 2015-03-18 cs.RO 75%

Learning Models for Following Natural Language Directions in Unknown Environments

Sachithra Hemachandra, Felix Duvallet, Thomas M. Howard, Nicholas Roy, Anthony Stentz, Matthew R. Walter

专题命中 具身与机器人 :world model(abstract);world model(abstract);environment model(abstract);分类 cs.RO

Comments ICRA 2015

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.07069 2026-05-08 cs.RO cs.SY eess.SY 74%

Optimal Gait Control for a Tendon-driven Soft Quadruped Robot by Model-based Reinforcement Learning

基于模型强化学习的腱驱动软四足机器人类最优步态控制

Xuezhi Niu, Kaige Tan, Lei Feng

机构 * Department of Engineering Design, KTH Royal Institute of Technology, Stockholm 10044, Sweden(工程设计系,皇家理工学院,斯德哥尔摩)

专题命中 具身与机器人 :model-based reinforcement learning(title,abstract);分类 cs.RO

AI总结 本文提出一种基于模型强化学习的软四足机器人最优步态控制方法,通过多阶段方法提升步态控制器性能,实现快速稳定运动。

详情

展开后加载摘要…

URL PDF HTML 收藏