arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.14404cs.CV
收藏

精确度和置信度的桥梁:校准目标检测的训练时间损失

Bridging Precision and Confidence: A Train-Time Loss for Calibrating Object Detection

Mohamed bin Zayed University of AI(穆罕默德·本·扎耶德人工智能大学);Information Technology University(信息技术大学);Australian National University(澳大利亚国立大学);Linköping University(林雪平大学)

Muhammad Akhtar Munir, Muhammad Haris Khan, Salman Khan, Fahad Shahbaz Khan

摘要:

深度神经网络(DNN)在几个基于视觉的问题上取得了惊人的进展。尽管显示出很高的预测准确性,但最近,一些作品显示,它们倾向于提供过于自信的预测,因此校准不良。大多数解决DNN误校准的工作都属于分类的范围,并且只考虑域内预测。然而,在研究基于DNN的目标检测模型的校准方面几乎没有进展,这是许多基于视觉的安全关键应用的核心。在本文中,受训练时间校准方法的启发,我们提出了一种新的辅助损失公式,其明确旨在将边界框的类置信度与预测的准确性(即精度)对齐。由于损失的原始公式取决于小批量中真阳性和假阳性的计数,因此我们开发了损失的可微分代理,可以在训练期间使用其他特定于应用的损失函数。我们使用六个基准数据集(包括MS-COCO,Cityscapes,Sim 10 k和BDD 100 k)对具有挑战性的域内和域外场景进行了广泛的实验。我们的研究结果表明,我们的训练时间损失超过强大的校准基线,减少校准误差的域内外的情况。我们的源代码和预训练模型可在https://github.com/akhtarvision/bpc_calibration上获得

英文摘要:

Deep neural networks (DNNs) have enabled astounding progress in several vision-based problems. Despite showing high predictive accuracy, recently, several works have revealed that they tend to provide overconfident predictions and thus are poorly calibrated. The majority of the works addressing the miscalibration of DNNs fall under the scope of classification and consider only in-domain predictions. However, there is little to no progress in studying the calibration of DNN-based object detection models, which are central to many vision-based safety-critical applications. In this paper, inspired by the train-time calibration methods, we propose a novel auxiliary loss formulation that explicitly aims to align the class confidence of bounding boxes with the accurateness of predictions (i.e. precision). Since the original formulation of our loss depends on the counts of true positives and false positives in a minibatch, we develop a differentiable proxy of our loss that can be used during training with other application-specific loss functions. We perform extensive experiments on challenging in-domain and out-domain scenarios with six benchmark datasets including MS-COCO, Cityscapes, Sim10k, and BDD100k. Our results reveal that our train-time loss surpasses strong calibration baselines in reducing calibration error for both in and out-domain scenarios. Our source code and pre-trained models are available at https://github.com/akhtarvision/bpc_calibration

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑