Labeling datasets for supervised object detection is a dull and time-consuming task. Errors can be easily introduced during annotation and overlooked during review, yielding inaccurate benchmarks and performance degradation of deep neural networks trained on noisy labels. In this work, we for the first time introduce a benchmark for label error detection methods on object detection datasets as well as a label error detection method and a number of baselines. We simulate four different types of randomly introduced label errors on train and test sets of well-labeled object detection datasets. For our label error detection method we assume a two-stage object detector to be given and consider the sum of both stages' classification and regression losses. The losses are computed with respect to the predictions and the noisy labels including simulated label errors, aiming at detecting the latter. We compare our method to three baselines: a naive one without deep learning, the object detector's score and the entropy of the classification softmax distribution. We outperform all baselines and demonstrate that among the considered methods, ours is the only one that detects label errors of all four types efficiently. Furthermore, we detect real label errors a) on commonly used test datasets in object detection and b) on a proprietary dataset. In both cases we achieve low false positives rates, i.e., we detect label errors with a precision for a) of up to 71.5% and for b) with 97%.
Fusion of Global-Local Features for Image Quality Inspection of Shipping Label
Korea Institute of Science and Technology Europe Forschungsgesellschaft mbH(韩国科学技术研究院欧洲有限公司);TU Kaiserslautern(凯泽斯劳滕工业大学);German Research Center for Artificial Intelligence(德国人工智能研究中心)
Hybrid Synthetic Data Generation with Domain Randomization Enables Zero-Shot Vision-Based Part Inspection Under Extreme Class Imbalance
Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI 48109, USA;Materials \& Manufacturing Systems Research Lab, General Motors, Warren, MI 48092, USA
Zero-Shot Multi-Criteria Visual Quality Inspection for Semi-Controlled Industrial Environments via Real-Time 3D Digital Twin Simulation
Mercedes-Benz AG(梅赛德斯-奔驰股份公司);Costa Rica Institute of Technology(哥斯达黎加理工学院);Gestalt Automation GmbH(Gestalt Automation有限公司);Technical University Berlin(柏林工业大学)
How Does Urban Context Relate to Residential Building Health? A Vision-POI Fusion Framework for Building-Level Housing Inspection
School of Information Management, Qingdao University of Technology(青岛理工大学信息管理学院);Embodied AI & Robot Research Institute, Qingdao University of Technology(青岛理工大学具身人工智能与机器人研究所);College of Architecture and Urban Planning, Qingdao University of Technology(青岛理工大学建筑与城乡规划学院);Innovation Institute for Sustainable Maritime Architecture Research and Technology (iSMART), Qingdao University of Technology(青岛理工大学可持续海洋建筑研究与技术创新研究所);Department of Urban Planning and Design, Xi’an Jiaotong-Liverpool University(西交利物浦大学城市规划与设计系)
Attention-Enhanced Prototypical Learning for Few-Shot Infrastructure Defect Segmentation
Canizaro Livingston Gulf States Center for Environmental Informatics, the University of New Orleans(Canizaro Livingston Gulf States Center for Environmental Informatics,新奥尔良大学);Graz University of Technology(格拉茨技术大学);US Army Corps of Engineers, Engineer Research and Development Center(美国陆军工程兵团,工程研究与发展中心)
FedTR: Federated Learning Framework with Transfer Learning for Industrial Visual Inspection
HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University(惠普-南洋理工大学数字制造联合实验室,南洋理工大学);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院);Department of Computer Science, Norwegian University of Science and Technology(挪威科技大学计算机科学系);HP Inc.(惠普公司);HP Singapore(惠普新加坡公司)
Attention Modules Improve Image-Level Anomaly Detection for Industrial Inspection: A DifferNet Case Study
Voxar Labs, Centro de Informática, Universidade Federal de Pernambuco(佩南布科联邦大学信息学中心 Voxar 实验室);Visual Computing Lab, DC, Universidade Federal Rural de Pernambuco(佩南布科联邦农村大学 DC 视觉计算实验室);Chemnitz University of Technology(开姆尼茨工业大学)
Multimodal Benchmark for Safety Assessment in Industrial Inspection Scenarios
Department of Automation, Tsinghua University(清华大学自动化系);Institute for Embodied Intelligence and Robotics, Tsinghua University(清华大学具身智能与机器人研究所);TetraBOT Intelligence Co., Ltd.(天博智能科技有限公司);DAMO Academy, Alibaba Group(阿里巴巴达摩院);School of Automation, Southeast University(东南大学自动化学院)
Enhanced Sample Selection with Confidence Tracking: Identifying Correctly Labeled yet Hard-to-Learn Samples in Noisy Data
School of Computer Science and Technology, Huazhong University of Science and Technology(华中科技大学计算机科学与技术学院);Joint Laboratory of HUST and Pingan Property & Casualty Research (HPL)(华中科技大学与平安财产保险研究联合实验室);School of Computing and Information Systems, Singapore Management University(新加坡管理大学计算与信息系统学院);State Grid Fujian Electric Power Co.(国网福建省电力有限公司)
Unsupervised Learning for Industrial Defect Detection: A Case Study on Shearographic Data
Trier, University of Applied Science(特里尔应用科学大学);RPTU University Kaiserslautern-Landau(科隆-兰道大学);Department of Physics(物理系);research center OPTIMAS(OPTIMAS研究中心);University of Luxembourg(卢森堡大学);Fraunhofer Institute for Industrial Mathematics ITWM(弗劳恩霍夫工业数学研究所ITWM)