Vision-Language-Action (VLA) models map visual observations and language instructions directly to robotic actions. While effective for simple tasks, standard VLA models often struggle with complex, multi-step tasks requiring logical planning, as well as precise manipulations demanding fine-grained spatial perception. Recent efforts have incorporated Chain-of-Thought (CoT) reasoning to endow VLA models with a ``thinking before acting'' capability. However, current CoT-based VLA models face two critical limitations: 1) an inability to simultaneously capture low-level visual details and high-level logical planning due to their reliance on isolated, single-modal CoT; 2) high inference latency with compounding errors caused by step-by-step autoregressive decoding. To address these limitations, we propose DualCoT-VLA, a visual-linguistic CoT method for VLA models with a parallel reasoning mechanism. To achieve comprehensive multi-modal reasoning, our method integrates a visual CoT for low-level spatial understanding and a linguistic CoT for high-level task planning. Furthermore, to overcome the latency bottleneck, we introduce a parallel CoT mechanism that incorporates two sets of learnable query tokens, shifting autoregressive reasoning to single-step forward reasoning. Extensive experiments demonstrate that our DualCoT-VLA achieves state-of-the-art performance on the LIBERO and RoboCasa GR1 benchmarks, as well as in real-world platforms.
Limited Linguistic Diversity in Embodied AI Datasets
Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室);Institute of Computer Science, University of Tartu(塔尔图大学计算机科学学院);Department of Mechanical Engineering, The University of Texas at Austin(德克萨斯大学奥斯汀分校机械工程系);University of Maryland, Baltimore County(马里兰大学巴尔的摩县分校)
ReFineVLA: Multimodal Reasoning-Aware Generalist Robotic Policies via Teacher-Guided Fine-Tuning
VinRobotics;University of Texas at Arlington(德克萨斯大学阿灵顿分校);Max Planck Research School for Intelligent Systems (IMPRS-IS)(智能系统Max Planck研究学校);Intelligent Autonomous Systems Lab(智能自主系统实验室);TU Darmstadt(德累斯顿技术大学);Automation & Control Institute(自动化与控制研究所);TU Wien(维也纳技术大学);Austrian Institute of Technology (AIT)(奥地利技术研究所)
Mechanistic Finetuning of Vision-Language-Action Models via Few-Shot Demonstrations
Carnegie Mellon University(卡内基梅隆大学);University of Southern California(南加州大学);University of California, Berkeley(加州大学伯克利分校);MIT-IBM Watson AI Lab(麻省理工学院-IBM沃森人工智能实验室)
DAM-VLA: A Dynamic Action Model-Based Vision-Language-Action Framework for Robot Manipulation
Advanced Research Lab, Samsung R&D Institute China-Beijing (SRCB)(三星研发中心中国北京先进研究实验室);Samsung AI Center, DS Division(三星人工智能中心,DS部门);Hanyang University ERICA(翰洋大学ERICA)
ReFineVLA: Reasoning-Aware Teacher-Guided Transfer Fine-Tuning
VinRobotics;Max Planck Research School for Intelligent Systems (IMPRS-IS)(Max Planck Research School for Intelligent Systems);University of Texas at Arlington(德克萨斯大学阿灵顿分校);Automation & Control Institute, TU Wien(技术大学维也纳自动化与控制研究所);Austrian Institute of Technology (AIT)(奥地利技术研究所)
FWBC-VLA: Force-Aware Whole-Body Compensation for Contact-Rich Loco-Manipulation
Zhejiang University(浙江大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Tsinghua University(清华大学);Zhongguancun Academy(中关村学院);Deep Robotics(深度机器人公司);Zhejiang University of Science and Technology(浙江科技大学)
Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future
HKUST(香港科技大学);Zhejiang University(浙江大学);National University of Singapore(新加坡国立大学);HKUST(GZ)(香港科技大学(广州));DAMO Academy, Alibaba(阿里巴巴达摩院);University of California, Los Angeles(加州大学洛杉矶分校);Xiaomi EV(小米电动车);Xi'an Jiaotong University(西安交通大学);Nanyang Technological University, Singapore(新加坡南洋理工大学)
Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics
Rochester Institute of Technology(罗切斯特技术研究所);University of Missouri - Kansas City(密苏里大学-凯撒城分校);U.S. Naval Research Laboratory(美国海军研究实验室);Lamar University(拉马尔大学);Meta AI;University of Rochester(罗切斯特大学);Rutgers University(新泽西罗格斯大学)
Weakly-Supervised 3D Scene Graph Generation via Visual-Linguistic Assisted Pseudo-labeling
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机与软件学院);College of Electronics and Information Engineering, Shenzhen University(深圳大学电子与信息工程学院);Meituan(美团)
AutoFly: Vision-Language-Action Model for UAV Autonomous Navigation in the Wild
Southeast University(东南大学);Purple Mountain Labs(紫金山实验室);The Chinese University of Hong Kong(香港中文大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Fudan University(复旦大学);Shanghai Jiao Tong University(上海交通大学)
SAMoE-VLA: A Scene Adaptive Mixture-of-Experts Vision-Language-Action Model for Autonomous Driving
Institute for AI Industry Research (AIR), Tsinghua University(人工智能产业研究院(AIR),清华大学);School of Instrument Science and Engineering, Southeast University(仪器科学与工程学院,东南大学);Zhili College, Tsinghua University(紫荆学院,清华大学);School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(人工智能与自动化学院,华中科技大学);Department of Automation, University of Science and Technology of China(自动化学院,中国科学技术大学);Department of Automation, University of Science and Technology Beijing(自动化学院,北京科技大学)
Teaching Vision-Language-Action Models What to See and Where to Look
School of Electronic Information Engineering, Beihang University(北京航空航天大学电子信息工程学院);National College for Excellent Engineers, Beihang University(北京航空航天大学卓越工程师学院);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院);DiDi(滴滴出行);State Key Laboratory of Media Convergence and Communication, Communication University of China(中国传媒大学媒体融合与传播国家重点实验室);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);School of Cyber Science and Technology, Beihang University(北京航空航天大学网络安全科学与技术学院);School of Artificial Intelligence, Beihang University(北京航空航天大学人工智能学院)
EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training
Language Technologies Institute, Carnegie Mellon University(卡内基梅隆大学语言技术研究所);Bosch Research North America & Bosch Center for Artificial Intelligence (BCAI)(博世北美研究部及博世人工智能中心(BCAI))
When Alignment Fails: Multimodal Adversarial Attacks on Vision-Language-Action Models
TGAI Lab, School of Engineering, Westlake University(西拉库大学工程学院TGAI实验室);Pennsylvania State University(宾夕法尼亚州立大学);Sony Research, Sony(索尼研究实验室,索尼);Xidian University(西安电子科技大学)