VLA / 视觉-语言-动作模型

Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfer

Gemini Robotics 1.5：通过先进的具身推理、思考和运动转移推动通用机器人前沿

Gemini Robotics Team, Abbas Abdolmaleki, Saminda Abeyruwan, Joshua Ainslie, Jean-Baptiste Alayrac, Montserrat Gonzalez Arenas, Ashwin Balakrishna, Nathan Batchelor, Alex Bewley, Jeff Bingham, Michael Bloesch, Konstantinos Bousmalis, Philemon Brakel, Anthony Brohan, Thomas Buschmann, Arunkumar Byravan, Serkan Cabi, Ken Caluwaerts, Federico Casarini, Christine Chan, Oscar Chang, London Chappellet-Volpini, Jose Enrique Chen, Xi Chen, Hao-Tien Lewis Chiang, Krzysztof Choromanski, Adrian Collister, David B. D'Ambrosio, Sudeep Dasari, Todor Davchev, Meet Kirankumar Dave, Coline Devin, Norman Di Palo, Tianli Ding, Carl Doersch, Adil Dostmohamed, Yilun Du, Debidatta Dwibedi, Sathish Thoppay Egambaram, Michael Elabd, Tom Erez, Xiaolin Fang, Claudio Fantacci, Cody Fong, Erik Frey, Chuyuan Fu, Ruiqi Gao, Marissa Giustina, Keerthana Gopalakrishnan, Laura Graesser, Oliver Groth, Agrim Gupta, Roland Hafner, Steven Hansen, Leonard Hasenclever, Sam Haves, Nicolas Heess, Brandon Hernaez, Alex Hofer, Jasmine Hsu, Lu Huang, Sandy H. Huang, Atil Iscen, Mithun George Jacob, Deepali Jain, Sally Jesmonth, Abhishek Jindal, Ryan Julian, Dmitry Kalashnikov, M. Emre Karagozler, Stefani Karp, Matija Kecman, J. Chase Kew, Donnie Kim, Frank Kim, Junkyung Kim, Thomas Kipf, Sean Kirmani, Ksenia Konyushkova, Li Yang Ku, Yuheng Kuang, Thomas Lampe, Antoine Laurens, Tuan Anh Le, Isabel Leal, Alex X. Lee, Tsang-Wei Edward Lee, Guy Lever, Jacky Liang, Li-Heng Lin, Fangchen Liu, Shangbang Long, Caden Lu, Sharath Maddineni, Anirudha Majumdar, Kevis-Kokitsi Maninis, Andrew Marmon, Sergio Martinez, Assaf Hurwitz Michaely, Niko Milonopoulos, Joss Moore, Robert Moreno, Michael Neunert, Francesco Nori, Joy Ortiz, Kenneth Oslund, Carolina Parada, Emilio Parisotto, Amaris Paryag, Acorn Pooley, Thomas Power, Alessio Quaglino, Haroon Qureshi, Rajkumar Vasudeva Raju, Helen Ran, Dushyant Rao, Kanishka Rao, Isaac Reid, David Rendleman, Krista Reymann, Miguel Rivas, Francesco Romano, Yulia Rubanova, Peter Pastor Sampedro, Pannag R Sanketi, Dhruv Shah, Mohit Sharma, Kathryn Shea, Mohit Shridhar, Charles Shu, Vikas Sindhwani, Sumeet Singh, Radu Soricut, Rachel Sterneck, Ian Storz, Razvan Surdulescu, Jie Tan, Jonathan Tompson, Saran Tunyasuvunakool, Jake Varley, Grace Vesom, Giulia Vezzani, Maria Bauza Villalonga, Oriol Vinyals, René Wagner, Ayzaan Wahid, Stefan Welker, Paul Wohlhart, Chengda Wu, Markus Wulfmeier, Fei Xia, Ted Xiao, Annie Xie, Jinyu Xie, Peng Xu, Sichun Xu, Ying Xu, Zhuo Xu, Jimmy Yan, Sherry Yang, Skye Yang, Yuxiang Yang, Hiu Hong Yu, Wenhao Yu, Wentao Yuan, Yuan Yuan, Jingwei Zhang, Tingnan Zhang, Zhiyuan Zhang, Allan Zhou, Guangyao Zhou, Yuxiang Zhou

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

AI总结 Gemini Robotics 1.5通过具身推理、思考和运动转移技术，提升通用机器人在复杂任务中的能力。

Beyond Success: Refining Elegant Robot Manipulation from Mixed-Quality Data via Just-in-Time Intervention

超越成功：通过及时干预从混合质量数据中精炼优雅的机器人操作

Yanbo Mao, Jianlong Fu, Ruoxuan Zhang, Hongxia Xie, Meibao Yao

机构 * Jilin University（吉林大学） ； Microsoft Research Asia（微软亚洲研究院） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

AI总结 本文提出LIBERO-Elegant基准和JITI机制，通过离线校准Q学习训练优雅批评者，提升机器人操作的执行质量与优雅度。

DeeAD: Dynamic Early Exit of Vision-Language Action for Efficient Autonomous Driving

DeeAD: 视觉-语言动作的动态早期退出以实现高效的自动驾驶

Haibo HU, Lianming Huang, Nan Guan, Chun Jason Xue

机构 * City University of Hongkong（香港城市大学） ； Mohamed bin Zayed University of Artificial Intelligence（马尔代夫 bin Zayed 人工智能大学） 纠错

专题命中 VLA模型 ：VLA(abstract)；分类 cs.RO、cs.CV、cs.AI

AI总结 DeeAD通过动态早期退出机制提升自动驾驶中视觉-语言动作模型的效率，实现28%的变换器层稀疏性和29%的延迟减少，同时保持规划质量和安全。

OmniVGGT: Omni-Modality Driven Visual Geometry Grounded Transformer

Haosong Peng, Hao Li, Yalun Dai, Yushi Lan, Yihang Luo, Tianyu Qi, Zhengshen Zhang, Yufeng Zhan, Junfei Zhang, Wenchao Xu, Ziwei Liu

机构 * HKUST（香港科技大学） ； NTU（国立台湾大学） ； SYSU（南方科技大学） ； NUS（国立新加坡大学） ； Alibaba Group（阿里巴巴集团） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.CV

Comments Project Page: https://livioni.github.io/OmniVGGT-official/

MirrorLimb: Implementing hand pose acquisition and robot teleoperation based on RealMirror

Cong Tai, Hansheng Wu, Haixu Long, Zhengbin Long, Zhaoyu Zheng, Haodong Xiang, Tao Shen

机构 * ZTE Terminators Group（ZTE终止者集团） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Driving

Shuang Zeng, Xinyuan Chang, Mengwei Xie, Xinran Liu, Yifan Bai, Zheng Pan, Mu Xu, Xing Wei, Ning Guo

机构 * Xi’an Jiaotong University（西安交通大学） ； Amap, Alibaba Group（阿里巴巴集团） ； DAMO Academy, Alibaba Group（阿里巴巴达摩院） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.CV

Comments Accepted to NeurIPS 2025 as Spotlight Presentation. Code: https://github.com/MIV-XJTU/FSDrive

Visual Spatial Tuning

Rui Yang, Ziyu Zhu, Yanwei Li, Jingjia Huang, Shen Yan, Siyuan Zhou, Zhe Liu, Xiangtai Li, Shuangye Li, Wenqian Wang, Yi Lin, Hengshuang Zhao

机构 * The University of Hong Kong（香港大学） ； Tsinghua University（清华大学） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；action model(abstract)；分类 cs.CV

RoboOS-NeXT: A Unified Memory-based Framework for Lifelong, Scalable, and Robust Multi-Robot Collaboration

Huajie Tan, Cheng Chi, Xiansheng Chen, Yuheng Ji, Zhongxia Zhao, Xiaoshuai Hao, Yaoxu Lyu, Mingyu Cao, Junkai Zhao, Huaihai Lyu, Enshen Zhou, Ning Chen, Yankai Fu, Cheng Peng, Wei Guo, Dong Liang, Zhuo Chen, Mengsi Lyu, Chenrui He, Yulong Ao, Yonghua Lin, Pengwei Wang, Zhongyuan Wang, Shanghang Zhang

机构 * State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University（1 多媒体信息处理国家重点实验室，计算机学院，北京大学） ； Beijing Academy of Artificial Intelligence（2 北京人工智能研究院） ； Institute of Automation, Chinese Academy of Sciences（3 中国科学院自动化研究所） ； Beihang University（4 北航大学） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

Avi: Action from Volumetric Inference

Harris Song, Long Le

机构 * University of California, Los Angeles（加州大学洛杉矶分校） ； University of pennsylvania（宾夕法尼亚大学） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

Comments NeurIPS 2025 Workshop on Embodied World Models for Decision Making. URL: https://avi-3drobot.github.io/

FORGE-Tree: Diffusion-Forcing Tree Search for Long-Horizon Robot Manipulation

Yanjia Huang, Shuo Liu, Sheng Liu, Qingxiao Xu, Mingyang Wu, Xiangbo Gao, Zhengzhong Tu

机构 * Department of Computer Science and Engineering, Texas A&M University（德克萨斯A&M大学计算机科学与工程系） ； Department of Electrical & Computer Engineering, University of Washington（华盛顿大学电气与计算机工程系） ； Karlsruhe Institute of Technology, Germany（德国卡尔斯鲁厄理工学院） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

SITCOM: Scaling Inference-Time COMpute for VLAs

Ayudh Saxena, Harsh Shah, Sandeep Routray, Rishi Rajesh Shah, Esha Pahwa

机构 * Carnegie Mellon University（卡内基梅隆大学） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

Comments Accepted at the NeurIPS 2025 Workshop on Space in Vision, Language, and Embodied AI (SpaVLE). *Equal contribution

Grounding Multimodal LLMs to Embodied Agents that Ask for Help with Reinforcement Learning

Ram Ramrakhya, Matthew Chang, Xavier Puig, Ruta Desai, Zsolt Kira, Roozbeh Mottaghi

机构 * Georgia Institute of Technology（佐治亚理工学院） ； Meta FAIR 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.AI

MUVLA: Learning to Explore Object Navigation via Map Understanding

Peilong Han, Fan Jia, Min Zhang, Yutao Qiu, Hongyao Tang, Yan Zheng, Tiancai Wang, Jianye Hao

机构 * Dexmal 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；action model(abstract)；分类 cs.RO

Emergent World Representations in OpenVLA

Marco Molinari, Leonardo Nevali, Saharsha Navani, Omar G. Younis

机构 * London School of Economics（伦敦经济学院） ； ETH Zurich（苏黎世联邦理工学院） ； Princeton University（普林斯顿大学） ； Department of Computer Science（计算机科学系） ； Mila - Quebec AI Institute（魁北克人工智能研究所） 纠错

专题命中 VLA模型 ：vision language action(abstract)；action model(abstract)；分类 cs.LG

Fast ECoT: Efficient Embodied Chain-of-Thought via Thoughts Reuse

Zhekai Duan, Yuan Zhang, Shikai Geng, Gaowen Liu, Joschka Boedecker, Chris Xiaoxuan Lu

机构 * University College London（伦敦大学学院） ； University of Freiburg（弗赖堡大学） ； Cisco Research（思科研究） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Driving

Yuechen Luo, Fang Li, Shaoqing Xu, Zhiyi Lai, Lei Yang, Qimao Chen, Ziang Luo, Zixun Xie, Shengyin Jiang, Jiaxin Liu, Long Chen, Bing Wang, Zhi-xin Yang

机构 * Tsinghua University（清华大学） ； Xiaomi EV（小米电动车） ； University of Macau（澳门大学） ； Nanyang Technological University（南洋理工大学） ； Peking University（北京大学） 纠错

专题命中 VLA模型 ：vision language action(abstract)；VLA(abstract)；分类 cs.CV

OpenHA: A Series of Open-Source Hierarchical Agentic Models in Minecraft

Zihao Wang, Muyao Li, Kaichen He, Xiangyu Wang, Zhancun Mu, Anji Liu, Yitao Liang

机构 * Peking University（北京大学） ； National University of Singapore（新加坡国立大学） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.AI

RoboChemist: Long-Horizon and Safety-Compliant Robotic Chemical Experimentation

Zongzheng Zhang, Chenghao Yue, Haobo Xu, Minwen Liao, Xianglin Qi, Huan-ang Gao, Ziwei Wang, Hao Zhao

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

Comments Accepted to CoRL 2025, Project Page: https://zzongzheng0918.github.io/RoboChemist.github.io/

Ego-centric Predictive Model Conditioned on Hand Trajectories

Binjie Zhang, Mike Zheng Shou

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.CV

Comments Code: github.com/showlab/Ego-PM

MapleGrasp: Mask-guided Feature Pooling for Language-driven Efficient Robotic Grasping

Vineet Bhat, Naman Patel, Prashanth Krishnamurthy, Ramesh Karri, Farshad Khorrami

机构 * New York University Tandon School of Engineering（纽约大学Tandon工程学院） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；action model(abstract)；分类 cs.RO

Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learning

Wenlong Liang, Rui Zhou, Yang Ma, Bing Zhang, Songlin Li, Yijia Liao, Ping Kuang

机构 * University of Electronic Science and Technology of China（电子科技大学） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

HiBerNAC: Hierarchical Brain-emulated Robotic Neural Agent Collective for Disentangling Complex Manipulation

Hongjun Wu, Heng Zhang, Pengsong Zhang, Jin Wang, Cong Wang

机构 * Johns Hopkins University（约翰霍普金斯大学） ； Italian Institute of Technology（意大利理工学院） ； University of Toronto（多伦多大学） ； Massachusetts General Hospital, Harvard University（哈佛大学麻省总医院） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

Comments 31 pages,5 figures

ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understanding

Yiyang Zhou, Yangfan He, Yaofeng Su, Siwei Han, Joel Jang, Gedas Bertasius, Mohit Bansal, Huaxiu Yao

专题命中 VLA模型 ：vision-language-action(abstract)；action model(abstract)；分类 cs.CV

Comments 31 pages, 18 figures

RFTF: Reinforcement Fine-tuning for Embodied Agents with Temporal Feedback

Junyang Shu, Zhiwei Lin, Yongtao Wang

机构 * Wangxuan Institute of Computer Technology, Peking University, China（北京大学计算机技术研究院） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

ReFineVLA: Reasoning-Aware Teacher-Guided Transfer Fine-Tuning

Tuan Van Vo, Tan Quang Nguyen, Khang Minh Nguyen, Duy Ho Minh Nguyen, Minh Nhat Vu

机构 * VinRobotics ； Max Planck Research School for Intelligent Systems (IMPRS-IS)（Max Planck Research School for Intelligent Systems） ； University of Texas at Arlington（德克萨斯大学阿灵顿分校） ； Automation & Control Institute, TU Wien（技术大学维也纳自动化与控制研究所） ； Austrian Institute of Technology (AIT)（奥地利技术研究所） 纠错

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

Comments 10 pages

Gemini Robotics: Bringing AI into the Physical World

Gemini Robotics Team, Saminda Abeyruwan, Joshua Ainslie, Jean-Baptiste Alayrac, Montserrat Gonzalez Arenas, Travis Armstrong, Ashwin Balakrishna, Robert Baruch, Maria Bauza, Michiel Blokzijl, Steven Bohez, Konstantinos Bousmalis, Anthony Brohan, Thomas Buschmann, Arunkumar Byravan, Serkan Cabi, Ken Caluwaerts, Federico Casarini, Oscar Chang, Jose Enrique Chen, Xi Chen, Hao-Tien Lewis Chiang, Krzysztof Choromanski, David D'Ambrosio, Sudeep Dasari, Todor Davchev, Coline Devin, Norman Di Palo, Tianli Ding, Adil Dostmohamed, Danny Driess, Yilun Du, Debidatta Dwibedi, Michael Elabd, Claudio Fantacci, Cody Fong, Erik Frey, Chuyuan Fu, Marissa Giustina, Keerthana Gopalakrishnan, Laura Graesser, Leonard Hasenclever, Nicolas Heess, Brandon Hernaez, Alexander Herzog, R. Alex Hofer, Jan Humplik, Atil Iscen, Mithun George Jacob, Deepali Jain, Ryan Julian, Dmitry Kalashnikov, M. Emre Karagozler, Stefani Karp, Chase Kew, Jerad Kirkland, Sean Kirmani, Yuheng Kuang, Thomas Lampe, Antoine Laurens, Isabel Leal, Alex X. Lee, Tsang-Wei Edward Lee, Jacky Liang, Yixin Lin, Sharath Maddineni, Anirudha Majumdar, Assaf Hurwitz Michaely, Robert Moreno, Michael Neunert, Francesco Nori, Carolina Parada, Emilio Parisotto, Peter Pastor, Acorn Pooley, Kanishka Rao, Krista Reymann, Dorsa Sadigh, Stefano Saliceti, Pannag Sanketi, Pierre Sermanet, Dhruv Shah, Mohit Sharma, Kathryn Shea, Charles Shu, Vikas Sindhwani, Sumeet Singh, Radu Soricut, Jost Tobias Springenberg, Rachel Sterneck, Razvan Surdulescu, Jie Tan, Jonathan Tompson, Vincent Vanhoucke, Jake Varley, Grace Vesom, Giulia Vezzani, Oriol Vinyals, Ayzaan Wahid, Stefan Welker, Paul Wohlhart, Fei Xia, Ted Xiao, Annie Xie, Jinyu Xie, Peng Xu, Sichun Xu, Ying Xu, Zhuo Xu, Yuxiang Yang, Rui Yao, Sergey Yaroshenko, Wenhao Yu, Wentao Yuan, Jingwei Zhang, Tingnan Zhang, Allan Zhou, Yuxiang Zhou

专题命中 VLA模型 ：vision-language-action(abstract)；VLA(abstract)；分类 cs.RO

Scalable, Training-Free Visual Language Robotics: A Modular Multi-Model Framework for Consumer-Grade GPUs

Marie Samson, Bastien Muraccioli, Fumio Kanehiro

专题命中 VLA模型 ：vision language action(abstract)；VLA(abstract)；分类 cs.RO

Journal ref 2025 IEEE/SICE International Symposium on System Integration

HumanVLA: Towards Vision-Language Directed Object Rearrangement by Physical Humanoid

Xinyu Xu, Yizheng Zhang, Yong-Lu Li, Lei Han, Cewu Lu

专题命中 VLA模型 ：vision-language-action(abstract)；action model(abstract)；分类 cs.RO

Comments NeurIPS 2024

Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking

Jiachen Li, Hengbo Ma, Zhihao Zhang, Jinning Li, Masayoshi Tomizuka

专题命中 VLA模型 ：action model(abstract)；分类 cs.RO、cs.CV、cs.AI

Comments This work has been submitted to the IEEE for possible publication

Automating Robot Failure Recovery Using Vision-Language Models With Optimized Prompts

Hongyi Chen, Yunchao Yao, Ruixuan Liu, Changliu Liu, Jeffrey Ichnowski

专题命中 VLA模型 ：vision-language-action(abstract)；action model(abstract)；分类 cs.RO