arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.11565cs.CV

移动关键内容:基于最优传输流的参数高效域适应用于协同感知

Move What Matters: Parameter-Efficient Domain Adaptation via Optimal Transport Flow for Collaborative Perception

School of Future Science and Engineering, Soochow University(苏州大学未来科学与工程学院);City University of Hong Kong(香港城市大学)

Zesheng Jia, Jin Wang, Siao Liu, Lingzhi Li, Ziyao Huang, Yunjiang Xu, Jianping Wang

AI总结:

本文提出FlowAdapt框架,通过最优传输理论减少信息传输成本,解决多智能体设置中域适应的性能退化问题,实现高效参数利用和语义保持。

摘要:

快速的域适应仍然是在车辆到一切(V2X)协同感知中部署多智能体系统的核心挑战。尽管参数高效微调(PEFT)在自然语言处理和传统视觉任务中取得成功,但直接将其应用于多智能体设置会导致显著的性能退化和训练不稳定。在本文中,我们进行了详尽分析,识别出两个关键因素:(i)异构感官流中的帧间冗余,以及(ii)在PEFT适应下深度层表示中语义的侵蚀。为了解决这些问题,我们提出了FlowAdapt,一种基于最优传输理论的参数高效框架,它通过数据分布和网络层次结构之间的信息传输成本最小化。具体而言,我们引入了Wasserstein贪心采样策略,通过有界的覆盖半径选择性过滤冗余样本。此外,设计了渐进知识转移模块,通过可学习路径逐步将压缩的早期阶段表示注入到后期阶段,缓解后期阶段适应中的语义退化。在三个基准上的广泛实验表明,FlowAdapt仅使用1%的可训练参数,实现了最先进的性能,有效桥接域差距,具有优越的样本效率和泛化能力。

英文摘要:

Efficient domain adaptation remains a fundamental challenge for deploying multi-agent systems across diverse environments in Vehicle-to-Everything (V2X) collaborative perception. Despite the success of Parameter-Efficient Fine-Tuning (PEFT) in natural language processing and conventional vision tasks, directly applying PEFT to collaborative perception recovers only a limited portion of the performance lost to domain shift. In this work, we identify two complementary bottlenecks that limit this recovery: (i) inter-frame redundancy within a collaborative sequence, which makes the effectiveness of scarce labels sensitive to frame selection, and (ii) foreground cues that become less linearly decodable in deeper-stage representations of a frozen backbone. To address these issues, we propose FlowAdapt, a parameter-efficient framework grounded in optimal transport. Wasserstein Greedy Sampling casts frame selection as minimizing the $W_{\infty}$ distance from the sequence to the retained subset, which equals its covering radius, so a farthest first traversal returns a subset provably within twice the optimum. Progressive Knowledge Transfer then routes compressed early-stage features into the deeper stages, gating each stage-local correction by that early evidence. Extensive experiments across target domains and fusion architectures show that FlowAdapt achieves state-of-the-art adaptation performance with about 1\% trainable parameters, and maintains this lead under localization noise.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑