DiverseNet:当一个正确的答案是不够的
DiverseNet: When One Right Answer is not Enough
摘要:
机器视觉中的许多结构化预测任务都有一组可接受的答案,而不是一个明确的地面真相答案。例如,图像的分割受到人类标记偏差的影响。类似地,存在多个可能的像素值,这些像素值可以可重复地完成被遮挡的图像区域。最先进的监督学习方法通常被优化为对每个查询进行单个测试时间预测,无法在输出空间中找到其他模式。允许采样的现有方法通常牺牲速度或准确性。我们介绍了一个简单的方法来训练一个神经网络,它使不同的结构化预测,为每个测试时查询。对于一个单一的输入,我们学会预测一系列可能的答案。我们比较有利的方法,寻求多样性,通过一个合奏的网络。这种随机多项选择学习面临模式坍塌,其中一个或多个系综成员无法接收任何训练信号。我们的最佳性能解决方案可用于各种任务,只需对现有的单模架构、损失函数和训练机制进行小的修改。我们证明了我们的方法在三个具有挑战性的任务:2D图像完成,3D体积估计和流量预测的定量改善。
英文摘要:
Many structured prediction tasks in machine vision have a collection of acceptable answers, instead of one definitive ground truth answer. Segmentation of images, for example, is subject to human labeling bias. Similarly, there are multiple possible pixel values that could plausibly complete occluded image regions. State-of-the art supervised learning methods are typically optimized to make a single test-time prediction for each query, failing to find other modes in the output space. Existing methods that allow for sampling often sacrifice speed or accuracy. We introduce a simple method for training a neural network, which enables diverse structured predictions to be made for each test-time query. For a single input, we learn to predict a range of possible answers. We compare favorably to methods that seek diversity through an ensemble of networks. Such stochastic multiple choice learning faces mode collapse, where one or more ensemble members fail to receive any training signal. Our best performing solution can be deployed for various tasks, and just involves small modifications to the existing single-mode architecture, loss function, and training regime. We demonstrate that our method results in quantitative improvements across three challenging tasks: 2D image completion, 3D volume estimation, and flow prediction.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。