VLA / 视觉-语言-动作模型

VLA-Mark: A cross modal watermark for large vision-language alignment model

Shuliang Liu, Qi Zheng, Jesse Jiaxi Xu, Yibo Yan, Junyan Zhang, He Geng, Aiwei Liu, Peijie Jiang, Jia Liu, Yik-Cheung Tam, Xuming Hu

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）） ； The Hong Kong University of Science and Technology（香港科技大学） ； University of Toronto（多伦多大学） ； Ant Group, Alibaba（蚂蚁集团，阿里巴巴） ； New York University Shanghai（纽约大学上海分校） 纠错

专题命中 VLA模型 ：VLA(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by the main conference, EMNLP 2025

JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse

Muyao Li, Zihao Wang, Kaichen He, Xiaojian Ma, Yitao Liang

机构 * Peking University（北京大学） ； BIGAI（大疆创新） 纠错

专题命中 VLA模型 ：VLA(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by ACL 2025

DyWA: Dynamics-adaptive World Action Model for Generalizable Non-prehensile Manipulation

Jiangran Lyu, Ziming Li, Xuesong Shi, Chaoyi Xu, Yizhou Wang, He Wang

机构 * Center on Frontiers of Computing Studies, School of Computer Science, Peking University（前沿计算研究教育部重点实验室，计算机学院，北京大学） ； Galbot ； Inst. for Artificial Intelligence, Peking University（人工智能研究所，北京大学） ； State Key Laboratory of General Artificial Intelligence, Peking University（通用人工智能国家重点实验室，北京大学） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO、cs.AI

Comments Project Page:https://pku-epic.github.io/DyWA/

Learning Safe Numeric Planning Action Models

Argaman Mordoch, Shahaf S. Shperberg, Roni Stern, Berndan Juba

机构 * Software and Information Systems Engineering, Ben-Gurion University of the Negev（本·古里安大学软件与信息系统工程系） ； Department of Computer Science and Engineering, Washington University（华盛顿大学计算机科学与工程系） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Interpretable Interaction Modeling for Trajectory Prediction via Agent Selection and Physical Coefficient

Shiji Huang, Lei Ye, Min Chen, Wenhai Luo, Dihong Wang, Chenqi Xu, Deyuan Liang

机构 * College of Computer Science and Technology, Zhejiang University of Technology（计算机科学与技术学院，浙江工业大学） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by International Conference on Intelligent Robots and Systems (IROS 2025)

A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks

Thomas Schmied, Thomas Adler, Vihang Patil, Maximilian Beck, Korbinian Pöppel, Johannes Brandstetter, Günter Klambauer, Razvan Pascanu, Sepp Hochreiter

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

LAM SIMULATOR: Advancing Data Generation for Large Action Model Training via Online Exploration and Trajectory Feedback

Thai Hoang, Kung-Hsiang Huang, Shirley Kokane, Jianguo Zhang, Zuxin Liu, Ming Zhu, Jake Grigsby, Tian Lan, Michael S Ryoo, Chien-Sheng Wu, Shelby Heinecke, Huan Wang, Silvio Savarese, Caiming Xiong, Juan Carlos Niebles

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments LAM Simulator framework for agentic data generation

Cross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentation

Zhe Dong, Yuzhe Sun, Tianzhu Liu, Wangmeng Zuo, Yanfeng Gu

机构 * School of Electronics and Information Engineering, Harbin Institute of Technology（电子信息工程学院，哈尔滨工业大学） ； Faculty of Computing, Harbin Institute of Technology（计算机学院，哈尔滨工业大学） ； Peng Cheng Laboratory, Shenzhen（鹏城实验室，深圳） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.CV、cs.AI

Enhancing Knowledge Graph Completion with GNN Distillation and Probabilistic Interaction Modeling

Lingzhi Wang, Pengcheng Huang, Haotian Li, Yuliang Wei, Guodong Xin, Rui Zhang, Donglin Zhang, Zhenzhou Ji, Wei Wang

机构 * Shandong Key Laboratory of Industrial Network Security（山东工业网络安全重点实验室） ； School of Computer Science and Technology, Harbin Institute of Technology（哈尔滨工业大学计算机科学与技术学院） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Unified Video Action Model

Shuang Li, Yihuai Gao, Dorsa Sadigh, Shuran Song

机构 * Stanford University（斯坦福大学） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO、cs.CV

Comments Project website: https://unified-video-action-model.github.io/

RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviour

Valerii Serpiva, Artem Lykov, Artyom Myshlyaev, Muhammad Haris Khan, Ali Alridha Abdulkarim, Oleg Sautenkov, Dzmitry Tsetserukou

专题命中 VLA模型 ：VLA(title,abstract)；分类 cs.RO、cs.AI

Comments 6 pages, 6 figures. Submitted to IROS 2025

Humanoid-VLA: Towards Universal Humanoid Control with Visual Integration

Pengxiang Ding, Jianfei Ma, Xinyang Tong, Binghong Zou, Xinxin Luo, Yiguo Fan, Ting Wang, Hongchao Lu, Panzhong Mo, Jinxin Liu, Yuefan Wang, Huaicheng Zhou, Wenshuo Feng, Jiacheng Liu, Siteng Huang, Donglin Wang

专题命中 VLA模型 ：VLA(title,abstract)；分类 cs.RO、cs.CV

Observe Then Act: Asynchronous Active Vision-Action Model for Robotic Manipulation

Guokang Wang, Hang Li, Shuyuan Zhang, Di Guo, Yanhong Liu, Huaping Liu

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO、cs.CV

Transforming Multimodal Models into Action Models for Radiotherapy

Matteo Ferrante, Alessandra Carosi, Rolando Maria D Angelillo, Nicola Toschi

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Contrastive Learning to Fine-Tune Feature Extraction Models for the Visual Cortex

Alex Mulrooney, Austin J. Brockmeier

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.CV、cs.LG

xLAM: A Family of Large Action Models to Empower AI Agent Systems

Jianguo Zhang, Tian Lan, Ming Zhu, Zuxin Liu, Thai Hoang, Shirley Kokane, Weiran Yao, Juntao Tan, Akshara Prabhakar, Haolin Chen, Zhiwei Liu, Yihao Feng, Tulika Awalgaonkar, Rithesh Murthy, Eric Hu, Zeyuan Chen, Ran Xu, Juan Carlos Niebles, Shelby Heinecke, Huan Wang, Silvio Savarese, Caiming Xiong

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments Technical report for the Salesforce xLAM model series

Vamos: Versatile Action Models for Video Understanding

Shijie Wang, Qi Zhao, Minh Quan Do, Nakul Agarwal, Kwonjoon Lee, Chen Sun

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to ECCV 2024 (European Conference on Computer Vision). Code and models are released at https://brown-palm.github.io/Vamos/

Multi-level Interaction Modeling for Protein Mutational Effect Prediction

Yuanle Mo, Xin Hong, Bowen Gao, Yinjun Jia, Yanyan Lan

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Transforming a Quadruped into a Guide Robot for the Visually Impaired: Formalizing Wayfinding, Interaction Modeling, and Safety Mechanism

J. Taery Kim, Wenhao Yu, Yash Kothari, Jie Tan, Greg Turk, Sehoon Ha

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO、cs.AI

Comments 16 pages, 8 figures

Journal ref Proceedings of The 7th Conference on Robot Learning, PMLR 229:2288-2303, 2023

FIMP: Future Interaction Modeling for Multi-Agent Motion Prediction

Sungmin Woo, Minjung Kim, Donghyeong Kim, Sungjun Jang, Sangyoun Lee

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO、cs.CV

Comments Accepted by ICRA 2024

Interaction Modeling with Multiplex Attention

Fan-Yun Sun, Isaac Kauvar, Ruohan Zhang, Jiachen Li, Mykel Kochenderfer, Jiajun Wu, Nick Haber

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments NeurIPS 2022, project website: https://cs.stanford.edu/~sunfanyun/imma/

Build generally reusable agent-environment interaction models

Jun Jin, Hongming Zhang, Jun Luo

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted in Foundation Models for Decision Making Workshop at Neural Information Processing Systems, 2022. Slides: https://docs.google.com/presentation/d/1PMS2xwTcztP2pPk1bsjqkQscI39Wy5tpmoE5-_ZC7Fo/edit?usp=sharing

Predicting Protein-Ligand Binding Affinity via Joint Global-Local Interaction Modeling

Yang Zhang, Gengmo Zhou, Zhewei Wei, Hongteng Xu

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Neural-Symbolic Descriptive Action Model from Images: The Search for STRIPS

Masataro Asai

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments Technical Report; not going to be submitted to the conference

Action Model Acquisition using LSTM

Ankuj Arora, Humbert Fiorino, Damien Pellier, Sylvie Pesty

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments 13 pages

Learning Action Models: Qualitative Approach

Thomas Bolander, Nina Gierasimczuk

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments 18 pages, accepted for LORI-V: The Fifth International Conference on Logic, Rationality and Interaction, October 28-31, 2015, National Taiwan University, Taipei, Taiwan

Structure and Parameter Learning for Causal Independence and Causal Interaction Models

Christopher Meek, David Heckerman

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments Appears in Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence (UAI1997)

Efficient Sim-to-Real Transfer of World-Action Models from Synthetic Priors

基于合成先验的世界-动作模型的高效仿真到现实迁移

Zixing Wang, Kausik Sivakumar, Jinghuan Shang, Yafei Hu, Zhaoming Xie, Ran Gong, Xiaohan Zhang, Karl Schmeckpeper

机构 * Purdue University（普渡大学） ； Robotics and AI Institute（机器人与人工智能研究所） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO

AI总结 本文研究从合成先验训练世界-动作模型并零样本部署到真实机器人操作，通过域随机化和AnyTask运动规划生成演示，首次成功实现仿真到现实的迁移。

Comments This work is accepted by CVPR'26, Embodied AI Workshop. This paper represent a part of early result of our official world-action model zero-shot sim-to-real transfer work, which will be released soon

ActionStudio: A Lightweight Framework for Data and Training of Large Action Models

Jianguo Zhang, Thai Hoang, Ming Zhu, Zuxin Liu, Shiyu Wang, Tulika Awalgaonkar, Akshara Prabhakar, Haolin Chen, Weiran Yao, Zhiwei Liu, Juntao Tan, Juan Carlos Niebles, Shelby Heinecke, Huan Wang, Silvio Savarese, Caiming Xiong

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI

Comments 16 pages; large action models; xLAM; ActionStudio

Broadband 12-26 GHz Radio Radiation Reveals Evidence for Micro-flares on AU Mic

12-26 GHz宽带射电辐射揭示AU微星上存在微耀斑的证据

Isaiah I. Tristan, Rachel A. Osten, Yuta Notsu, Adina D. Feinstein, Adam F. Kowalski

专题命中 VLA模型 ：VLA(summary_cn,abstract)

AI总结 研究通过VLA对AU微星的12-26 GHz射电观测，发现其存在微耀斑，揭示活跃M型矮星日冕非热射电辐射由连续微耀斑和磁场捕获主导。

Comments 11 pages, 4 figures, 4 tables. Accepted to ApJ