arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.08381cs.CV
收藏

基于实例级时间周期混淆的鲁棒目标检测

Robust Object Detection via Instance-Level Temporal Cycle Confusion

Microsoft Research(微软研究院);ETH Zürich(苏黎世联邦理工学院);University of Washington(华盛顿大学);UC San Diego(加州大学圣迭戈分校);UC Berkeley(加州大学伯克利分校)

Xin Wang, Thomas E. Huang, Benlin Liu, Fisher Yu, Xiaolong Wang, Joseph E. Gonzalez, Trevor Darrell

摘要:

构建可靠的对象检测器,这些检测器对域变化(例如上下文、视点和对象外观的各种变化)具有鲁棒性,对于现实世界的应用至关重要。在这项工作中,我们研究了辅助自我监督任务的有效性,以提高对象检测器的分布外泛化。受最大熵原理的启发,我们引入了一种新的自监督任务,实例级时间周期混淆(CycConf),它对对象检测器的区域特征进行操作。对于每个对象,任务是在视频中的相邻帧中找到最不同的对象建议,然后循环回到自身进行自我监督。CycConf鼓励对象检测器在各种运动下跨实例探索不变结构,这导致在测试时在看不见的域中提高模型鲁棒性。当在大规模视频数据集(BDD 100K和Waymo开放数据)上训练对象检测器与自监督任务时,我们观察到一致的域外性能改进。联合训练框架还建立了标准无监督域自适应检测基准(Cityscapes,Foggy Cityscapes和Sim10K)的最新技术水平。代码和模型可在https://github.com/xinw1012/cycle-confusion上获得。

英文摘要:

Building reliable object detectors that are robust to domain shifts, such as various changes in context, viewpoint, and object appearances, is critical for real-world applications. In this work, we study the effectiveness of auxiliary self-supervised tasks to improve the out-of-distribution generalization of object detectors. Inspired by the principle of maximum entropy, we introduce a novel self-supervised task, instance-level temporal cycle confusion (CycConf), which operates on the region features of the object detectors. For each object, the task is to find the most different object proposals in the adjacent frame in a video and then cycle back to itself for self-supervision. CycConf encourages the object detector to explore invariant structures across instances under various motions, which leads to improved model robustness in unseen domains at test time. We observe consistent out-of-domain performance improvements when training object detectors in tandem with self-supervised tasks on large-scale video datasets (BDD100K and Waymo open data). The joint training framework also establishes a new state-of-the-art on standard unsupervised domain adaptative detection benchmarks (Cityscapes, Foggy Cityscapes, and Sim10K). The code and models are available at https://github.com/xinw1012/cycle-confusion.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑