尽早共享,延迟保存:带宽受限协作式视觉语言导航中的同步驱动通信门控
Early to Share, Late to Save: Synchronisation-Driven Communication Gating in Bandwidth-Constrained Cooperative VLN
AI总结:
研究带宽受限协作式VLN,提出事后诸葛亮门控,通过循环隐藏状态对齐解释智能体通信模式,实验表明该方法能在带宽受限下实现高效通信,为具身智能体建立新通信机制。
摘要:
大多数协作式视觉语言导航(VLN)方法假定通信不受限,未考虑带宽受限且信息效率至关重要的实际应用。我们引入带宽受限协作式VLN并提出事后诸葛亮门控:一种轻量级监督门,能根据导航失败事后标记关键通信步骤,避免REINFORCE的高方差。与直觉相反,我们观察到一致的反直觉模式:训练后的门主要在早期步骤触发,且在智能体自信时更频繁触发。我们通过循环隐藏状态对齐来解释这一现象,早期通信注入的基础轨迹表示通过后续门控循环单元(GRU)更新持续并复合。实验表明,在B = 3次传输时实现了+0.072的累积对齐增益,比随机门控和基于熵的门控效率分别高260%和320%,接近无约束通信。结果为带宽受限的具身智能体建立了新的通信机制:早期同步表示,后期独立导航。
英文摘要:
Most cooperative Vision-Language Navigation (VLN) methods assume unlimited communication, not considering real-world applications where bandwidth is restricted and information efficiency is critical. We introduce \textbf{bandwidth-constrained cooperative VLN} and propose \textbf{hindsight gating}: a lightweight supervised gate that labels communication-critical steps post-hoc from navigation failures, avoiding the high variance of REINFORCE. Contrary to the intuition that agents should communicate when uncertain, we observe a consistent counter-intuitive pattern: trained gates fire predominantly in early episode steps and more often when agents are confident, across all budget levels ($B \in \{1,3,5\}$). We explain this through \textbf{recurrent hidden-state alignment}: early communication injects grounded trajectory representations that persist and compound through subsequent Gated Recurrent Unit (GRU) updates, achieving $+0.072$ cumulative alignment gain with $B{=}3$ transmissions, approaching unconstrained communication ($+0.078$) at 260\% greater alignment efficiency than random gating ($+0.020$) and 320\% greater efficiency than entropy-based gating ($+0.017$). Our results establish a new communication regime for bandwidth-limited embodied agents: synchronise representations early, navigate independently later. Our codebase is available at: https://github.com/AravG13/bandwidth-constrained-cooperative-vln
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。