arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1406.5653cs.CV
收藏

交互式测试驱动对象检测器:估计未标记数据的性能

Interactively Test Driving an Object Detector: Estimating Performance on Unlabeled Data

Arizona State University(亚利桑那州立大学)

Rushil Anirudh, Pavan Turaga

摘要:

在本文中,我们研究了检测器的“试驾”问题,即允许人类用户快速了解检测器对他们的特定要求的概括程度。为此,我们提出了第一个系统,估计检测器的性能交互式没有广泛的地面使用人在回路中的真实。我们的做法,这是一个估计比例的问题,并表明,它是可以作出准确的推断,在一个大的数据汇集内的类或组的比例,只观察$5-10\%$的样本数据。在估计错误检测(为了精确)时,仔细地选择样本,使得保留数据汇集的总体特征。接下来,受其在估计疾病传播中的使用的启发,我们应用合并测试方法来估计来自数据集的遗漏检测(用于召回)。这样获得的估计接近于使用地面实况获得的估计,从而减少了对昂贵且耗时的大量标记的需要。

英文摘要:

In this paper, we study the problem of `test-driving' a detector, i.e. allowing a human user to get a quick sense of how well the detector generalizes to their specific requirement. To this end, we present the first system that estimates detector performance interactively without extensive ground truthing using a human in the loop. We approach this as a problem of estimating proportions and show that it is possible to make accurate inferences on the proportion of classes or groups within a large data collection by observing only $5-10\%$ of samples from the data. In estimating the false detections (for precision), the samples are chosen carefully such that the overall characteristics of the data collection are preserved. Next, inspired by its use in estimating disease propagation we apply pooled testing approaches to estimate missed detections (for recall) from the dataset. The estimates thus obtained are close to the ones obtained using ground truth, thus reducing the need for extensive labeling which is expensive and time consuming.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑