VLA / 视觉-语言-动作模型

Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objects

Zirun Zhou, Zhengyang Xiao, Haochuan Xu, Jing Sun, Di Wang, Jingfeng Zhang

机构 * The University of Auckland（奥克兰大学） ； The King Abdullah University of Science and Technology（国王 Abdullah 科学与技术大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.CV、cs.LG

VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators

Hengtao Li, Pengxiang Ding, Runze Suo, Yihao Wang, Zirui Ge, Dongyuan Zang, Kexian Yu, Mingyang Sun, Hongyin Zhang, Donglin Wang, Weihua Su

机构 * Westlake University（西湖大学） ； Zhejiang University（浙江大学） ； OpenHelix Team（OpenHelix团队） ； Fudan University（复旦大学） ； Zhengzhou University（郑州大学） ； BUPT（北京邮电大学） ； Hebei University of Technology（河北工业大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；VLA(title,abstract)；分类 cs.RO、cs.CV

dVLA: Diffusion Vision-Language-Action Model with Multimodal Chain-of-Thought

Junjie Wen, Minjie Zhu, Jiaming Liu, Zhiyuan Liu, Yicun Yang, Linfeng Zhang, Shanghang Zhang, Yichen Zhu, Yi Xu

机构 * Midea Group（美的集团） ； Peking University（北京大学） ； Shanghai Jiaotong University（上海交通大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.CV

Comments technique report

Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Driving

Pengxiang Li, Yinan Zheng, Yue Wang, Huimin Wang, Hang Zhao, Jingjing Liu, Xianyuan Zhan, Kun Zhan, Xianpeng Lang

机构 * LiAuto ； Tsinghua University（清华大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.AI

OmniVLA: An Omni-Modal Vision-Language-Action Model for Robot Navigation

Noriaki Hirose, Catherine Glossop, Dhruv Shah, Sergey Levine

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.LG

Comments 9 pages, 7 figures, 6 tables

The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruning

Titong Jiang, Xuefeng Jiang, Yuan Ma, Xin Wen, Bailin Li, Kun Zhan, Peng Jia, Yahui Liu, Sheng Sun, Xianpeng Lang

机构 * LiAuto Inc.（LiAuto公司） ； School of Vehicle and Mobility, Tsinghua University（清华大学车辆与移动学院） ； Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.CV

Comments Under review. Project site: https://liauto-research.github.io/LightVLA

DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledge

Wenyao Zhang, Hongsi Liu, Zekun Qi, Yunnan Wang, Xinqiang Yu, Jiazhao Zhang, Runpei Dong, Jiawei He, Fan Lu, He Wang, Zhizheng Zhang, Li Yi, Wenjun Zeng, Xin Jin

机构 * SJTU（上海交通大学） ； EIT（欧洲研究所） ； THU（清华大学） ； Galbot ； PKU（北京大学） ； UIUC（伊利诺伊大学香槟分校） ； USTC（中国科学技术大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.CV

Do What? Teaching Vision-Language-Action Models to Reject the Impossible

Wen-Han Hsieh, Elvis Hsieh, Dantong Niu, Trevor Darrell, Roei Herzig, David M. Chan

机构 * University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.AI

Comments 9 pages, 2 figures, 1 table

EndoVLA: Dual-Phase Vision-Language-Action Model for Autonomous Tracking in Endoscopy

Chi Kit Ng, Long Bai, Guankun Wang, Yupeng Wang, Huxin Gao, Kun Yuan, Chenhan Jin, Tieyong Zeng, Hongliang Ren

机构 * The Chinese University of Hong Kong（香港中文大学） ； Technical University of Munich（慕尼黑技术大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.AI

ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceiver

Wenxuan Song, Ziyang Zhou, Han Zhao, Jiayi Chen, Pengxiang Ding, Haodong Yan, Yuxin Huang, Feilong Tang, Donglin Wang, Haoang Li

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.CV

CO-RFT: Efficient Fine-Tuning of Vision-Language-Action Models through Chunked Offline Reinforcement Learning

Dongchi Huang, Zhirui Fang, Tianle Zhang, Yihang Li, Lin Zhao, Chunhe Xia

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.LG

RICL: Adding In-Context Adaptability to Pre-Trained Vision-Language-Action Models

Kaustubh Sridhar, Souradeep Dutta, Dinesh Jayaraman, Insup Lee

机构 * University of Pennsylvania（宾夕法尼亚大学） ； University of British Columbia（不列颠哥伦比亚大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.AI

Comments Conference on Robot Learning 2025 (CoRL 2025), 17 pages

Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics

Taowen Wang, Cheng Han, James Chenhao Liang, Wenhao Yang, Dongfang Liu, Luna Xinyu Zhang, Qifan Wang, Jiebo Luo, Ruixiang Tang

机构 * Rochester Institute of Technology（罗切斯特技术研究所） ； University of Missouri - Kansas City（密苏里大学-凯撒城分校） ； U.S. Naval Research Laboratory（美国海军研究实验室） ； Lamar University（拉马尔大学） ； Meta AI ； University of Rochester（罗切斯特大学） ； Rutgers University（新泽西罗格斯大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.AI

Comments ICCV camera ready; Github: https://github.com/William-wAng618/roboticAttack Homepage: https://vlaattacker.github.io/

EaqVLA: Encoding-aligned Quantization for Vision-Language-Action Models

Feng Jiang, Zihao Zheng, Xiuping Cui, Maoliang Li, JIayu Chen, Xiang Chen

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.CV、cs.LG

Comments There is an error in this paper, and as the author, I request retraction

RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Models

Jacky Kwok, Christopher Agia, Rohan Sinha, Matt Foutter, Shulu Li, Ion Stoica, Azalia Mirhoseini, Marco Pavone

机构 * Stanford University（斯坦福大学） ； UC Berkeley（加州大学伯克利分校） ； NVIDIA Research（NVIDIA研究） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.AI

HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model

Jiaming Liu, Hao Chen, Pengju An, Zhuoyang Liu, Renrui Zhang, Chenyang Gu, Xiaoqi Li, Ziyu Guo, Sixiang Chen, Mengzhen Liu, Chengkai Hou, Mengdi Zhao, KC alex Zhou, Pheng-Ann Heng, Shanghang Zhang

机构 * State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University（多媒体信息处理国家重点实验室，计算机学院，北京大学） ； Beijing Academy of Artificial Intelligence (BAAI)（北京人工智能研究院） ； CUHK（香港中文大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.CV

From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models

Irving Fang, Juexiao Zhang, Shengbang Tong, Chen Feng

机构 * New York University（纽约大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.CV

Comments Under review

SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics

Mustafa Shukor, Dana Aubakirova, Francesco Capuano, Pepijn Kooijmans, Steven Palma, Adil Zouitine, Michel Aractingi, Caroline Pascal, Martino Russi, Andres Marafioti, Simon Alibert, Matthieu Cord, Thomas Wolf, Remi Cadene

机构 * Hugging Face ； Sorbonne University（索邦大学） ； École Normale Supérieure Paris-Saclay（巴黎萨克雷高等师范学院） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.LG

Comments 24 pages. Code and assets: https://github.com/huggingface/lerobot

Survey on Vision-Language-Action Models

Adilzhan Adilkhanov, Amir Yelenov, Assylkhan Seitzhanov, Ayan Mazhitov, Azamat Abdikarimov, Danissa Sandykbayeva, Daryn Kenzhebek, Dinmukhammed Mukashev, Ilyas Umurbekov, Jabrail Chumakov, Kamila Spanova, Karina Burunchina, Madina Yergibay, Margulan Issa, Moldir Zabirova, Nurdaulet Zhuzbay, Nurlan Kabdyshev, Nurlan Zhaniyar, Rasul Yermagambet, Rustam Chibar, Saltanat Seitzhan, Soibkhon Khajikhanov, Tasbolat Taunyazov, Temirlan Galimzhanov, Temirlan Kaiyrbay, Tleukhan Mussin, Togzhan Syrymova, Valeriya Kostyukova, Yerkebulan Massalim, Yermakhan Kassym, Zerde Nurbayeva, Zhanat Kappassov

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.CV、cs.AI

Comments arXiv admin note: This submission has been withdrawn due to serious violation of arXiv policies for acceptable submissions

LoHoVLA: A Unified Vision-Language-Action Model for Long-Horizon Embodied Tasks

Yi Yang, Jiaxuan Sun, Siqi Kou, Yihan Wang, Zhijie Deng

机构 * Fudan University（复旦大学） ； ShanghaiTech University（上海科技大学） ； Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 VLA模型 ：vision-language-action(title)；action model(title)；vision language action(abstract)；VLA(abstract)

Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better

Danny Driess, Jost Tobias Springenberg, Brian Ichter, Lili Yu, Adrian Li-Bell, Karl Pertsch, Allen Z. Ren, Homer Walke, Quan Vuong, Lucy Xiaoyang Shi, Sergey Levine

机构 * Physical Intelligence 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.LG

$π_{0.5}$: a Vision-Language-Action Model with Open-World Generalization

Physical Intelligence, Kevin Black, Noah Brown, James Darpinian, Karan Dhabalia, Danny Driess, Adnan Esmail, Michael Equi, Chelsea Finn, Niccolo Fusai, Manuel Y. Galliker, Dibya Ghosh, Lachy Groom, Karol Hausman, Brian Ichter, Szymon Jakubczak, Tim Jones, Liyiming Ke, Devin LeBlanc, Sergey Levine, Adrian Li-Bell, Mohith Mothukuri, Suraj Nair, Karl Pertsch, Allen Z. Ren, Lucy Xiaoyang Shi, Laura Smith, Jost Tobias Springenberg, Kyle Stachowicz, James Tanner, Quan Vuong, Homer Walke, Anna Walling, Haohuan Wang, Lili Yu, Ury Zhilinsky

机构 * Physical Intelligence 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.LG

MoManipVLA: Transferring Vision-language-action Models for General Mobile Manipulation

Zhenyu Wu, Yuheng Zhou, Xiuwei Xu, Ziwei Wang, Haibin Yan

机构 * Beijing University of Posts and Telecommunications（北京邮电大学） ； Nanyang Technological University（南洋理工大学） ； Tsinghua University（清华大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.CV

Comments Accepted to CVPR 2025. Project Page: https://gary3410.github.io/momanipVLA/

MoRE: Unlocking Scalability in Reinforcement Learning for Quadruped Vision-Language-Action Models

Han Zhao, Wenxuan Song, Donglin Wang, Xinyang Tong, Pengxiang Ding, Xuelian Cheng, Zongyuan Ge

机构 * Zhejiang University（浙江大学） ； Westlake University（西湖大学） ； Monash University（莫纳什大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.AI

Comments Accepted by ICRA 2025

Probing a Vision-Language-Action Model for Symbolic States and Integration into a Cognitive Architecture

Hong Lu, Hengxu Li, Prithviraj Singh Shahani, Stephanie Herbers, Matthias Scheutz

机构 * Tufts University（塔夫茨大学） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.AI

Comments 8 Pages, 4 Figures

Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Tasks

Jiazhao Zhang, Kunyu Wang, Shaoan Wang, Minghan Li, Haoran Liu, Songlin Wei, Zhongyuan Wang, Zhizheng Zhang, He Wang

机构 * Peking University（北京大学） ； Beijing Academy of Artificial Intelligence（北京智源人工智能研究院） 纠错

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.CV

Comments Project page: https://pku-epic.github.io/Uni-NaVid/

ShowUI: One Vision-Language-Action Model for GUI Visual Agent

Kevin Qinghong Lin, Linjie Li, Difei Gao, Zhengyuan Yang, Shiwei Wu, Zechen Bai, Weixian Lei, Lijuan Wang, Mike Zheng Shou

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title,abstract)；分类 cs.CV、cs.AI

Comments Technical Report. Github: https://github.com/showlab/ShowUI

LADEV: A Language-Driven Testing and Evaluation Platform for Vision-Language-Action Models in Robotic Manipulation

Zhijie Wang, Zhehua Zhou, Jiayang Song, Yuheng Huang, Zhan Shu, Lei Ma

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.AI

Comments 8 pages, 4 figures

Run-time Observation Interventions Make Vision-Language-Action Models More Visually Robust

Asher J. Hancock, Allen Z. Ren, Anirudha Majumdar

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.LG

Comments Website: https://aasherh.github.io/byovla/

OpenVLA: An Open-Source Vision-Language-Action Model

Moo Jin Kim, Karl Pertsch, Siddharth Karamcheti, Ted Xiao, Ashwin Balakrishna, Suraj Nair, Rafael Rafailov, Ethan Foster, Grace Lam, Pannag Sanketi, Quan Vuong, Thomas Kollar, Benjamin Burchfiel, Russ Tedrake, Dorsa Sadigh, Sergey Levine, Percy Liang, Chelsea Finn

专题命中 VLA模型 ：vision-language-action(title,abstract)；action model(title)；VLA(abstract)；分类 cs.RO、cs.LG

Comments Website: https://openvla.github.io/