arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

视觉与机器人

VLA / 视觉-语言-动作模型

视觉-语言-动作模型、机器人基础模型和语言条件机器人控制。

共收录 44 信号源:cs.RO, cs.CV, cs.AI, cs.LG

1. 机器人基础模型 44 篇

2605.15153 2026-05-22 cs.RO cs.AI 62%

Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action

Pelican-Unify 1.0:一种用于理解和推理、想象和行动的统一具身智能模型

Yi Zhang, Yinda Chen, Che Liu, Zeyuan Ding, Jin Xu, Shilong Zou, Junwei Liao, Jiayu Hu, Xiancong Ren, Xiaopeng Zhang, Yechi Liu, Haoyuan Shi, Zecong Tang, Haosong Sun, Renwen Cui, Kuishu Wu, Wenhai Liu, Yang Xu, Yingji Zhang, Yidong Wang, Senkang Hu, Jinpeng Lu, Nga Teng Chan, Yechen Wu, Zeting Liu, Xianzhou Hou, Yong Dai, Jian Tang, Xiaozhu Ju

机构 * Beijing Innovation Center of Humanoid Robotics (X-Humanoid)(北京人形机器人创新中心(X-Humanoid))

专题命中 机器人基础模型 :embodied foundation model(abstract);分类 cs.RO、cs.AI

AI总结 本文提出Pelican-Unify 1.0,一种基于统一原则训练的首个具身基础模型,通过单一视觉语言模型作为统一理解模块,将场景、指令、视觉上下文和行动历史映射到共享语义空间,并通过统一推理模块生成任务、行动和未来导向的思维链,最终将隐藏状态投影到密集潜在变量中,再通过统一未来生成器生成未来视频和行动。

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.00917 2025-11-20 cs.RO cs.AI 62%

Maestro: Orchestrating Robotics Modules with Vision-Language Models for Zero-Shot Generalist Robots

Junyao Shi, Rujia Yang, Kaitian Chao, Selina Bingqing Wan, Yifei Shao, Jiahui Lei, Jianing Qian, Long Le, Pratik Chaudhari, Kostas Daniilidis, Chuan Wen, Dinesh Jayaraman

专题命中 机器人基础模型 :VLA(abstract);分类 cs.RO、cs.AI

Comments Plan to resubmit after significant revisions

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.08950 2025-03-13 cs.RO cs.AI 62%

FP3: A 3D Foundation Policy for Robotic Manipulation

Rujia Yang, Geng Chen, Chuan Wen, Yang Gao

专题命中 机器人基础模型 :robot foundation model(abstract);分类 cs.RO、cs.AI

Comments Project website: https://3d-foundation-policy.github.io

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.20548 2025-03-11 cs.RO cs.AI cs.HC 62%

Robi Butler: Multimodal Remote Interaction with a Household Robot Assistant

Anxing Xiao, Nuwan Janaka, Tianrun Hu, Anshul Gupta, Kaixin Li, Cunjun Yu, David Hsu

专题命中 机器人基础模型 :robot foundation model(abstract);分类 cs.RO、cs.AI

Comments Accepted to ICRA 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.14037 2025-02-24 cs.RO cs.LG 62%

Re-Mix: Optimizing Data Mixtures for Large Scale Imitation Learning

Joey Hejna, Chethan Bhateja, Yichen Jiang, Karl Pertsch, Dorsa Sadigh

专题命中 机器人基础模型 :robot foundation model(abstract);分类 cs.RO、cs.LG

详情

展开后加载摘要…

URL PDF HTML 收藏
2512.22983 2026-08-18 cs.RO 版本更新 57%

Embodied Robot Manipulation in the Era of Foundation Models: Planning and Learning Perspectives

基础模型时代中的具身机器人操作:规划与学习视角

Shuanghao Bai, Wenxuan Song, Jiayi Chen, Yuheng Ji, Zhide Zhong, Jin Yang, Han Zhao, Wanqi Zhou, Zhe Li, Pengxiang Ding, Cheng Chi, Chang Xu, Xiaolong Zheng, Donglin Wang, Haoang Li, Shanghang Zhang, Badong Chen

机构 * Xi’an Jiaotong Univeristy(西安交通大学) Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)) Chinese Academy of Sciences(中国科学院) Westlake University(西湖大学) Zhejiang University(浙江大学) University of Sydney(悉尼大学) BAAI(百度人工智能研究院) Peking University(北京大学)

专题命中 机器人基础模型 :action model(abstract);分类 cs.RO

AI总结 本文探讨了基础模型时代机器人操作的规划与学习方法,分析了高层推理与低层控制的统一框架,并提出了未来研究方向。

Comments This work is a re-architected core derived from the full survey (arXiv:2510.10903), refined to highlight the most central themes and representative studies

详情

展开后加载摘要…

URL PDF HTML 收藏
2607.06501 2026-07-08 cs.RO 新提交 57%

Hypothesis-driven Model Expansion under Uncertainty for Open-World Robot Planning

不确定性下用于开放世界机器人规划的假设驱动模型扩展

Anxing Xiao, Hanbo Zhang, Tianrun Hu, David Hsu

机构 * School of Computing, National University of Singapore(新加坡国立大学计算机学院) Smart Systems Institute, National University of Singapore(新加坡国立大学智能系统研究所)

专题命中 机器人基础模型 :robot foundation model(abstract);分类 cs.RO

AI总结 针对开放世界机器人规划中传统方法失效的问题,提出假设驱动模型扩展框架,利用基础模型生成假设,结合自动规划与验证反馈进行迭代优化,实现自主知识扩展,推动家用服务机器人实际部署。

Comments Accepted to Robotics: Science and Systems (RSS) 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2607.04426 2026-07-07 cs.RO 新提交 57%

ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI

ACE-Brain-0.5:用于物理智能体人工智能的统一具身基础模型

Brain Team, Ziyang Gong, Haoming Gu, Zehang Luo, Tianyi Zhang, Tao Tao, Yixiao Chi, Zhe Liu, Lingsi Zhu, Jingyuan Liu, Anke Tang, Songze Li, Yilun Kong, Ningjing Liu, Tianyu Zhu, Yunpeng Qing, Shuang Luo, Xiang Liu, Shi Fu, Dawei Nie, Sixiang Liu, Zhexi Wen, Feng Pan, Xiaofeng Wang, Zhi Hou, Chunxiao Liu, Xue Yang, Junchi Yan, Hengshuang Zhao, Dacheng Tao, Xiaogang Wang

机构 * ACE-Brain Team(ACE-Brain团队)

专题命中 机器人基础模型 :embodied foundation model(abstract);分类 cs.RO

AI总结 研究针对具身人工智能从模块向物理智能体发展的问题,提出ACE-Brain-0.5统一基础模型,通过耦合的五个功能及SSR+等方法,提升空间感知等能力,在多基准测试中有进步。

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.27153 2026-06-26 cs.DC cs.LG 新提交 57%

DMuon: Efficient Distributed Muon Training with Near-Adam Overhead

DMuon: 高效分布式Muon训练,开销接近Adam

Vincent Chen, Starrick Liu, Regis Cheng, Dance Yang, Shalfun Li, Ryan Yu, Lucy Liang, Hang Su, Roy Gan, Hao Wang, Qian Wang

机构 * X SQUARE ROBOT TEAM(X SQUARE机器人团队)

专题命中 机器人基础模型 :embodied foundation model(abstract);分类 cs.LG

AI总结 提出DMuon,一种分布式矩阵正交化优化器,通过减少通信和计算开销,使每步延迟接近AdamW,在基础模型和LLM训练中实现1.48-3.01倍端到端加速。

详情

展开后加载摘要…

URL PDF HTML 收藏
2606.13672 2026-06-18 cs.RO 新提交 57%

WEAVER, Better, Faster, Longer: An Effective World Model for Robotic Manipulation

$\texttt{WEAVER}$:更好、更快、更长——一种有效的机器人操作世界模型

Arnav Kumar Jain, Yilin Wu, Jesse Farebrother, Gokul Swamy, Andrea Bajcsy

机构 * Mila - Québec AI Institute(Mila - 魁北克人工智能研究所) Université de Montréal(蒙特利尔大学) Carnegie Mellon University(卡内基梅隆大学) McGill University(麦吉尔大学)

专题命中 机器人基础模型 :robot foundation model(abstract);分类 cs.RO

AI总结 提出WEAVER世界模型架构,通过流匹配损失训练多视图潜在预测,同时实现高保真度、长程一致性和高效推理,在机器人操作任务中显著提升策略评估、改进和测试时规划性能。

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.11766 2025-09-16 cs.RO 57%

Igniting VLMs toward the Embodied Space

Andy Zhai, Brae Liu, Bruno Fang, Chalse Cai, Ellie Ma, Ethan Yin, Hao Wang, Hugo Zhou, James Wang, Lights Shi, Lucy Liang, Make Wang, Qian Wang, Roy Gan, Ryan Yu, Shalfun Li, Starrick Liu, Sylas Chen, Vincent Chen, Zach Xu

机构 * X SQUARE ROBOT

专题命中 机器人基础模型 :embodied foundation model(abstract);分类 cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏
2506.19613 2025-06-25 cs.AI 57%

Position: Intelligent Science Laboratory Requires the Integration of Cognitive and Embodied AI

Sha Zhang, Suorong Yang, Tong Xie, Xiangyuan Xue, Zixuan Hu, Rui Li, Wenxi Qu, Zhenfei Yin, Tianfan Fu, Di Hu, Andres M Bran, Nian Ran, Bram Hoex, Wangmeng Zuo, Philippe Schwaller, Wanli Ouyang, Lei Bai, Yanyong Zhang, Lingyu Duan, Shixiang Tang, Dongzhan Zhou

机构 * University of Science and Technology of China(中国科学技术大学) Nanjing University(南京大学) University of New South Wales(新南威尔士大学) Shanghai Jiao Tong University(上海交通大学) Peking University(北京大学) Harbin Institute of Technology(哈尔滨工业大学) Tongji University(同济大学) The University of Sydney, Oxford(悉尼大学,牛津) Renmin University of China(中国人民大学) Swiss Federal Institute of Technology Lausanne(苏黎世联邦理工学院) Shanghai Institute of Ceramics, Chinese Academy of Sciences(中国科学院上海硅酸盐研究所) Shanghai AI Laboratory(上海人工智能实验室) Shanghai AI Laboratory & The Chinese University of Hong Kong(上海人工智能实验室 & 香港中文大学)

专题命中 机器人基础模型 :robot foundation model(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.11827 2025-04-17 cs.RO 57%

Towards Forceful Robotic Foundation Models: a Literature Survey

William Xie, Nikolaus Correll

专题命中 机器人基础模型 :robot foundation model(abstract);分类 cs.RO

Comments 20 pages, 9 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.14005 2025-01-28 cs.RO 57%

Neural Scaling Laws in Robotics

Sebastian Sartor, Neil Thompson

专题命中 机器人基础模型 :robot foundation model(abstract);分类 cs.RO

详情

展开后加载摘要…

URL PDF HTML 收藏