arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.13476cs.ROcs.LG
收藏

AsyncVLA: 一种异步VLA用于边缘设备上的快速稳健导航

AsyncVLA: An Asynchronous VLA for Fast and Robust Navigation on the Edge

University of California, Berkeley(加州大学伯克利分校);Toyota Motor North America(丰田汽车北美公司);Princeton University(普林斯顿大学)

Noriaki Hirose, Catherine Glossop, Dhruv Shah, Sergey Levine

AI总结:

AsyncVLA通过异步框架结合远程大模型与本地轻量级模块,实现边缘设备上的高效稳健导航,成功率达40%。

摘要:

机器人基础模型通过利用互联网级的视觉-语言表示实现强大的泛化能力,但其巨大的计算成本构成了一个根本性的瓶颈:高推理延迟。在动态环境中,这种延迟会破坏控制回路,使强大的模型在实时部署中变得不安全。我们提出了AsyncVLA,一种异步控制框架,将语义推理与反应执行解耦。受分层控制的启发,AsyncVLA在远程工作站上运行大型基础模型以提供高层指导,同时一个轻量级的 onboard Edge Adapter 高频持续优化动作。为了弥合这些异步流之间的领域差距,我们引入了端到端微调协议和轨迹再加权策略,优先考虑动态交互。我们在具有通信延迟高达6秒的真实世界视觉导航任务上评估了我们的方法。AsyncVLA的成功率比最先进的基线高40%,有效弥合了大型模型的语义智能与边缘机器人所需的反应性之间的差距。

英文摘要:

Robotic foundation models achieve strong generalization by leveraging internet-scale vision-language representations, but their massive computational cost creates a fundamental bottleneck: high inference latency. In dynamic environments, this latency breaks the control loop, rendering powerful models unsafe for real-time deployment. We propose AsyncVLA, an asynchronous control framework that decouples semantic reasoning from reactive execution. Inspired by hierarchical control, AsyncVLA runs a large foundation model on a remote workstation to provide high-level guidance, while a lightweight, onboard Edge Adapter continuously refines actions at high frequency. To bridge the domain gap between these asynchronous streams, we introduce an end-to-end finetuning protocol and a trajectory re-weighting strategy that prioritizes dynamic interactions. We evaluate our approach on real-world vision-based navigation tasks with communication delays up to 6 seconds. AsyncVLA achieves a 40% higher success rate than state-of-the-art baselines, effectively bridging the gap between the semantic intelligence of large models and the reactivity required for edge robotics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑