arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.01540cs.CV
收藏

FSCA-Net:用于鲁棒多数据集训练的特征分离交叉注意力网络

FSCA-Net: Feature-Separated Cross-Attention Network for Robust Multi-Dataset Training

School of Automation Science and Engineering, Xi’an Jiaotong University(自动化科学与工程学院,西安交通大学);Institute for Low-Altitude Regulation, School of Electronics and Information Engineering, Xi’an Jiaotong University(低空调控研究所,电子与信息工程学院,西安交通大学);Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(人工智能与机器人研究所,西安交通大学)

Yuehai Chen

AI总结:

FSCA-Net通过特征分离和交叉注意力机制,有效解决多数据集训练中的负迁移问题,实现跨数据集的鲁棒泛化。

摘要:

人群计数在公共安全、交通管理及智能城市管理中发挥着重要作用。然而,尽管CNN和Transformer模型取得了显著进展,但当应用于不同环境时,其性能往往会因严重的领域差异而下降。直接在多个数据集上联合训练,直观上应提高泛化能力,但反而导致负迁移,因为共享和领域特定的表示变得纠缠。为了解决这一挑战,我们提出了特征分离和交叉注意力网络FSCA-Net,一个统一的框架,明确将特征表示分解为领域不变和领域特定的组件。一个新颖的交叉注意力融合模块适配地建模这些组件之间的交互,确保有效知识转移同时保持数据集特定的判别性。此外,引入了一个互信息优化目标,以最大化领域不变特征之间的一致性,并最小化领域特定特征之间的冗余,促进互补的共享-私有表示。在多个人群计数基准上的广泛实验表明,FSCA-Net有效缓解了负迁移,并实现了跨数据集泛化的最佳性能,提供了一个稳健且可扩展的解决方案,用于现实世界的人群分析。

英文摘要:

Crowd counting plays a vital role in public safety, traffic regulation, and smart city management. However, despite the impressive progress achieved by CNN- and Transformer-based models, their performance often deteriorates when applied across diverse environments due to severe domain discrepancies. Direct joint training on multiple datasets, which intuitively should enhance generalization, instead results in negative transfer, as shared and domain-specific representations become entangled. To address this challenge, we propose the Feature Separation and Cross-Attention Network FSCA-Net, a unified framework that explicitly disentangles feature representations into domain-invariant and domain-specific components. A novel cross-attention fusion module adaptively models interactions between these components, ensuring effective knowledge transfer while preserving dataset-specific discriminability. Furthermore, a mutual information optimization objective is introduced to maximize consistency among domain-invariant features and minimize redundancy among domain-specific ones, promoting complementary shared-private representations. Extensive experiments on multiple crowd counting benchmarks demonstrate that FSCA-Net effectively mitigates negative transfer and achieves state-of-the-art cross-dataset generalization, providing a robust and scalable solution for real-world crowd analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑