arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.01583cs.CV
收藏

面向通用向后兼容的表示学习

Towards Universal Backward-Compatible Representation Learning

Tsinghua University(清华大学);Tencent PCG(腾讯平台与内容事业群);AWS/Amazon AI(亚马逊云科技/亚马逊人工智能);AI Technology Center of Tencent Video(腾讯视频人工智能技术中心)

Binjie Zhang, Yixiao Ge, Yantao Shen, Shupeng Su, Fanzi Wu, Chun Yuan, Xuyuan Xu, Yexin Wang, Ying Shan

摘要:

传统的视觉搜索系统的模型升级需要通过将图库图像馈送到新模型中(称为“回填”)来离线刷新图库特征,这是耗时且昂贵的,特别是在大规模应用中。因此,引入向后兼容的表示学习任务来支持无回填模型升级,其中新的查询功能与旧的图库功能可互操作。尽管取得了成功,但以前的工作只研究了一个封闭的训练场景(即,新的训练集与旧的训练集共享相同的类),并且受到更现实和更具挑战性的开放集场景的限制。为此,我们首先引入了一个通用向后兼容的表示学习的新问题,涵盖了模型升级中所有可能的数据分裂。我们进一步提出了一种简单而有效的方法,称为通用向后兼容训练(UniBCT)与一种新的结构原型细化算法,学习兼容的表示在各种模型升级基准在一个统一的方式。在大规模人脸识别数据集MS 1 Mv 3和IJB-C上的综合实验充分证明了该方法的有效性。

英文摘要:

Conventional model upgrades for visual search systems require offline refresh of gallery features by feeding gallery images into new models (dubbed as "backfill"), which is time-consuming and expensive, especially in large-scale applications. The task of backward-compatible representation learning is therefore introduced to support backfill-free model upgrades, where the new query features are interoperable with the old gallery features. Despite the success, previous works only investigated a close-set training scenario (i.e., the new training set shares the same classes as the old one), and are limited by more realistic and challenging open-set scenarios. To this end, we first introduce a new problem of universal backward-compatible representation learning, covering all possible data split in model upgrades. We further propose a simple yet effective method, dubbed as Universal Backward-Compatible Training (UniBCT) with a novel structural prototype refinement algorithm, to learn compatible representations in all kinds of model upgrading benchmarks in a unified manner. Comprehensive experiments on the large-scale face recognition datasets MS1Mv3 and IJB-C fully demonstrate the effectiveness of our method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑