VLA / 视觉-语言-动作模型

SENTINEL: A Fully End-to-End Language-Action Model for Humanoid Whole Body Control

SENTINEL：一种用于人形机器人全身控制的端到端语言-动作模型

Yuxuan Wang, Haobin Jiang, Shiqing Yao, Ziluo Ding, Zongqing Lu

机构 * Peking University（北京大学） ； BeingBeyond 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO、cs.AI

AI总结 SENTINEL是一种端到端语言-动作模型，通过直接映射语言指令和本体感觉输入到低层动作，实现人形机器人全身控制，并支持多模态扩展。

Comments 23 pages, 8 figures, 11 tables

Benchmark on Drug Target Interaction Modeling from a Drug Structure Perspective

Xinnan Zhang, Jialin Wu, Junyi Xie, Tianlong Chen, Kaixiong Zhou

机构 * University of Minnesota（明尼苏达大学） ； University of California San Diego（加州大学圣地亚哥分校） ； UNC Chapel Hill（北卡罗来纳大学教堂山分校） ； North Carolina State University（北卡罗来纳州立大学） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

What Do Latent Action Models Actually Learn?

Chuheng Zhang, Tim Pearce, Pushi Zhang, Kaixin Wang, Xiaoyu Chen, Wei Shen, Li Zhao, Jiang Bian

机构 * Microsoft Research（微软研究院） ； Tsinghua University（清华大学） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by NeurIPS-25

Bi-VLA: Bilateral Control-Based Imitation Learning via Vision-Language Fusion for Action Generation

Masato Kobayashi, Thanpimon Buamanee

机构 * D3 Center, The University of Osaka（大阪大学D3中心） ； Graduate School of Information Science and Technology, The University of Osaka（大阪大学信息科学与技术研究生院） ； Graduate School of Maritime Sciences, Kobe University（兵库大学海运研究生院） 纠错

专题命中 VLA模型 ：VLA(title,abstract)；分类 cs.RO、cs.LG

VLA-Mark: A cross modal watermark for large vision-language alignment model

Shuliang Liu, Qi Zheng, Jesse Jiaxi Xu, Yibo Yan, Junyan Zhang, He Geng, Aiwei Liu, Peijie Jiang, Jia Liu, Yik-Cheung Tam, Xuming Hu

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）） ； The Hong Kong University of Science and Technology（香港科技大学） ； University of Toronto（多伦多大学） ； Ant Group, Alibaba（蚂蚁集团，阿里巴巴） ； New York University Shanghai（纽约大学上海分校） 纠错

专题命中 VLA模型 ：VLA(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by the main conference, EMNLP 2025

JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse

Muyao Li, Zihao Wang, Kaichen He, Xiaojian Ma, Yitao Liang

机构 * Peking University（北京大学） ； BIGAI（大疆创新） 纠错

专题命中 VLA模型 ：VLA(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by ACL 2025

DyWA: Dynamics-adaptive World Action Model for Generalizable Non-prehensile Manipulation

Jiangran Lyu, Ziming Li, Xuesong Shi, Chaoyi Xu, Yizhou Wang, He Wang

机构 * Center on Frontiers of Computing Studies, School of Computer Science, Peking University（前沿计算研究教育部重点实验室，计算机学院，北京大学） ； Galbot ； Inst. for Artificial Intelligence, Peking University（人工智能研究所，北京大学） ； State Key Laboratory of General Artificial Intelligence, Peking University（通用人工智能国家重点实验室，北京大学） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO、cs.AI

Comments Project Page:https://pku-epic.github.io/DyWA/

Learning Safe Numeric Planning Action Models

Argaman Mordoch, Shahaf S. Shperberg, Roni Stern, Berndan Juba

机构 * Software and Information Systems Engineering, Ben-Gurion University of the Negev（本·古里安大学软件与信息系统工程系） ； Department of Computer Science and Engineering, Washington University（华盛顿大学计算机科学与工程系） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Interpretable Interaction Modeling for Trajectory Prediction via Agent Selection and Physical Coefficient

Shiji Huang, Lei Ye, Min Chen, Wenhai Luo, Dihong Wang, Chenqi Xu, Deyuan Liang

机构 * College of Computer Science and Technology, Zhejiang University of Technology（计算机科学与技术学院，浙江工业大学） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by International Conference on Intelligent Robots and Systems (IROS 2025)

A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks

Thomas Schmied, Thomas Adler, Vihang Patil, Maximilian Beck, Korbinian Pöppel, Johannes Brandstetter, Günter Klambauer, Razvan Pascanu, Sepp Hochreiter

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

LAM SIMULATOR: Advancing Data Generation for Large Action Model Training via Online Exploration and Trajectory Feedback

Thai Hoang, Kung-Hsiang Huang, Shirley Kokane, Jianguo Zhang, Zuxin Liu, Ming Zhu, Jake Grigsby, Tian Lan, Michael S Ryoo, Chien-Sheng Wu, Shelby Heinecke, Huan Wang, Silvio Savarese, Caiming Xiong, Juan Carlos Niebles

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments LAM Simulator framework for agentic data generation

Cross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentation

Zhe Dong, Yuzhe Sun, Tianzhu Liu, Wangmeng Zuo, Yanfeng Gu

机构 * School of Electronics and Information Engineering, Harbin Institute of Technology（电子信息工程学院，哈尔滨工业大学） ； Faculty of Computing, Harbin Institute of Technology（计算机学院，哈尔滨工业大学） ； Peng Cheng Laboratory, Shenzhen（鹏城实验室，深圳） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.CV、cs.AI

Enhancing Knowledge Graph Completion with GNN Distillation and Probabilistic Interaction Modeling

Lingzhi Wang, Pengcheng Huang, Haotian Li, Yuliang Wei, Guodong Xin, Rui Zhang, Donglin Zhang, Zhenzhou Ji, Wei Wang

机构 * Shandong Key Laboratory of Industrial Network Security（山东工业网络安全重点实验室） ； School of Computer Science and Technology, Harbin Institute of Technology（哈尔滨工业大学计算机科学与技术学院） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Unified Video Action Model

Shuang Li, Yihuai Gao, Dorsa Sadigh, Shuran Song

机构 * Stanford University（斯坦福大学） 纠错

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO、cs.CV

Comments Project website: https://unified-video-action-model.github.io/

RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviour

Valerii Serpiva, Artem Lykov, Artyom Myshlyaev, Muhammad Haris Khan, Ali Alridha Abdulkarim, Oleg Sautenkov, Dzmitry Tsetserukou

专题命中 VLA模型 ：VLA(title,abstract)；分类 cs.RO、cs.AI

Comments 6 pages, 6 figures. Submitted to IROS 2025

Humanoid-VLA: Towards Universal Humanoid Control with Visual Integration

Pengxiang Ding, Jianfei Ma, Xinyang Tong, Binghong Zou, Xinxin Luo, Yiguo Fan, Ting Wang, Hongchao Lu, Panzhong Mo, Jinxin Liu, Yuefan Wang, Huaicheng Zhou, Wenshuo Feng, Jiacheng Liu, Siteng Huang, Donglin Wang

专题命中 VLA模型 ：VLA(title,abstract)；分类 cs.RO、cs.CV

Observe Then Act: Asynchronous Active Vision-Action Model for Robotic Manipulation

Guokang Wang, Hang Li, Shuyuan Zhang, Di Guo, Yanhong Liu, Huaping Liu

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO、cs.CV

Transforming Multimodal Models into Action Models for Radiotherapy

Matteo Ferrante, Alessandra Carosi, Rolando Maria D Angelillo, Nicola Toschi

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Contrastive Learning to Fine-Tune Feature Extraction Models for the Visual Cortex

Alex Mulrooney, Austin J. Brockmeier

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.CV、cs.LG

xLAM: A Family of Large Action Models to Empower AI Agent Systems

Jianguo Zhang, Tian Lan, Ming Zhu, Zuxin Liu, Thai Hoang, Shirley Kokane, Weiran Yao, Juntao Tan, Akshara Prabhakar, Haolin Chen, Zhiwei Liu, Yihao Feng, Tulika Awalgaonkar, Rithesh Murthy, Eric Hu, Zeyuan Chen, Ran Xu, Juan Carlos Niebles, Shelby Heinecke, Huan Wang, Silvio Savarese, Caiming Xiong

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments Technical report for the Salesforce xLAM model series

Vamos: Versatile Action Models for Video Understanding

Shijie Wang, Qi Zhao, Minh Quan Do, Nakul Agarwal, Kwonjoon Lee, Chen Sun

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to ECCV 2024 (European Conference on Computer Vision). Code and models are released at https://brown-palm.github.io/Vamos/

Multi-level Interaction Modeling for Protein Mutational Effect Prediction

Yuanle Mo, Xin Hong, Bowen Gao, Yinjun Jia, Yanyan Lan

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Transforming a Quadruped into a Guide Robot for the Visually Impaired: Formalizing Wayfinding, Interaction Modeling, and Safety Mechanism

J. Taery Kim, Wenhao Yu, Yash Kothari, Jie Tan, Greg Turk, Sehoon Ha

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO、cs.AI

Comments 16 pages, 8 figures

Journal ref Proceedings of The 7th Conference on Robot Learning, PMLR 229:2288-2303, 2023

FIMP: Future Interaction Modeling for Multi-Agent Motion Prediction

Sungmin Woo, Minjung Kim, Donghyeong Kim, Sungjun Jang, Sangyoun Lee

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.RO、cs.CV

Comments Accepted by ICRA 2024

Interaction Modeling with Multiplex Attention

Fan-Yun Sun, Isaac Kauvar, Ruohan Zhang, Jiachen Li, Mykel Kochenderfer, Jiajun Wu, Nick Haber

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments NeurIPS 2022, project website: https://cs.stanford.edu/~sunfanyun/imma/

Build generally reusable agent-environment interaction models

Jun Jin, Hongming Zhang, Jun Luo

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted in Foundation Models for Decision Making Workshop at Neural Information Processing Systems, 2022. Slides: https://docs.google.com/presentation/d/1PMS2xwTcztP2pPk1bsjqkQscI39Wy5tpmoE5-_ZC7Fo/edit?usp=sharing

Predicting Protein-Ligand Binding Affinity via Joint Global-Local Interaction Modeling

Yang Zhang, Gengmo Zhou, Zhewei Wei, Hongteng Xu

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Neural-Symbolic Descriptive Action Model from Images: The Search for STRIPS

Masataro Asai

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments Technical Report; not going to be submitted to the conference

Action Model Acquisition using LSTM

Ankuj Arora, Humbert Fiorino, Damien Pellier, Sylvie Pesty

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments 13 pages

Learning Action Models: Qualitative Approach

Thomas Bolander, Nina Gierasimczuk

专题命中 VLA模型 ：action model(title,abstract)；分类 cs.AI、cs.LG

Comments 18 pages, accepted for LORI-V: The Fifth International Conference on Logic, Rationality and Interaction, October 28-31, 2015, National Taiwan University, Taipei, Taiwan