Detecting Everything in the Open World: Towards Universal Object Detection
Tsinghua University(清华大学);Beijing National Research Center for Information Science and Technology (BNRist)(北京信息科学与技术国家研究中心(BNRist));The University of Hong Kong(香港大学);Meta AI;Massachusetts Institute of Technology(麻省理工学院)
Zhenyu Wang, Yali Li, Xi Chen, Ser-Nam Lim, Antonio Torralba, Hengshuang Zhao, Shengjin Wang
In this paper, we formally address universal object detection, which aims to detect every scene and predict every category. The dependence on human annotations, the limited visual information, and the novel categories in the open world severely restrict the universality of traditional detectors. We propose UniDetector, a universal object detector that has the ability to recognize enormous categories in the open world. The critical points for the universality of UniDetector are: 1) it leverages images of multiple sources and heterogeneous label spaces for training through the alignment of image and text spaces, which guarantees sufficient information for universal representations. 2) it generalizes to the open world easily while keeping the balance between seen and unseen classes, thanks to abundant information from both vision and language modalities. 3) it further promotes the generalization ability to novel categories through our proposed decoupling training manner and probability calibration. These contributions allow UniDetector to detect over 7k categories, the largest measurable category size so far, with only about 500 classes participating in training. Our UniDetector behaves the strong zero-shot generalization ability on large-vocabulary datasets like LVIS, ImageNetBoxes, and VisualGenome - it surpasses the traditional supervised baselines by more than 4\% on average without seeing any corresponding images. On 13 public detection datasets with various scenes, UniDetector also achieves state-of-the-art performance with only a 3\% amount of training data.
Pose for Everything: Towards Category-Agnostic Pose Estimation
The Chinese University of Hong Kong(香港中文大学);SenseTime Research(商汤科技研究院);The University of Hong Kong(香港大学);Shanghai AI Laboratory(上海人工智能实验室);The University of Sydney(悉尼大学)
Changzhou University(常州大学);Hefei Comprehensive National Science Center, Institute of Artificial Intelligence(合肥综合性国家科学中心人工智能研究院);Northwestern Polytechnical University(西北工业大学);The University of Sheffield(谢菲尔德大学)
Universal Barcode Detector via Semantic Segmentation
ABBYY Production LLC(ABBYY 产品有限责任公司);Moscow Institute of Physics and Technology (National Research University)(莫斯科物理技术学院(国立研究大学))
条形码用于许多商业应用中,因此快速和可靠的读取非常重要。有许多不同类型的条形码,其中一些看起来相似,而另一些则完全不同。本文介绍了一种基于语义分割方法的快速、鲁棒的深度学习检测器。它能够通过单个模型在文档扫描和野外同时检测任何类型的条形码。该检测器在ArTe-Lab 1D Medium Barcode Dataset上实现了最先进的结果,检测率为0.995。此外,开发的探测器可以处理更复杂的物体形状,如很长但很窄或很小的条形码。所提出的方法还可以识别检测到的条形码的类型,并在CPU环境下以比以前的最先进的方法快得多的实时速度执行。
Detecting AI-Generated Images via Distributional Deviations from Real Images
Henan Key Laboratory of Big Data Analysis and Processing, School of Computer and Information Engineering, Henan University(河南大数据分析与处理重点实验室,计算机与信息工程学院,河南大学)