arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2202.04112cs.CV
收藏

将显著性检测分解到级联细节建模和实体填充中

Disentangle Saliency Detection into Cascaded Detail Modeling and Body Filling

University of Trento(特伦托大学);ETH Zurich(苏黎世联邦理工学院)

Yue Song, Hao Tang, Nicu Sebe, Wei Wang

摘要:

显著目标检测已经被长期研究以识别图像/视频中最具视觉吸引力的对象。最近,越来越多的方法已经被提出,所有这些都依赖于轮廓/边缘信息,以提高检测性能。边缘标签要么直接放入损失中,要么用作额外的监督。边缘和身体也可以单独学习,然后融合。这两种方法要么导致边缘附近的高预测误差,要么不能以端到端的方式进行训练。另一个问题是,现有的方法可能无法检测各种大小的对象,由于缺乏高效和有效的特征融合机制。在这项工作中,我们建议分解的显着性检测任务分为两个级联的子任务,\emph{i.e.},详细建模和身体填充。具体地说,细节建模的重点是捕捉对象的边缘,通过监督明确分解的细节标签,由嵌套在边缘和边缘附近的像素。然后,身体填充学习身体部分,将填充到细节图中,以生成更准确的显著图。为了有效地融合特征并处理不同尺度的对象,我们还提出了两种新的多尺度细节注意和身体注意块,用于精确的细节和身体建模。实验结果表明,我们的方法在六个公共数据集上实现了最先进的性能。

英文摘要:

Salient object detection has been long studied to identify the most visually attractive objects in images/videos. Recently, a growing amount of approaches have been proposed all of which rely on the contour/edge information to improve detection performance. The edge labels are either put into the loss directly or used as extra supervision. The edge and body can also be learned separately and then fused afterward. Both methods either lead to high prediction errors near the edge or cannot be trained in an end-to-end manner. Another problem is that existing methods may fail to detect objects of various sizes due to the lack of efficient and effective feature fusion mechanisms. In this work, we propose to decompose the saliency detection task into two cascaded sub-tasks, \emph{i.e.}, detail modeling and body filling. Specifically, the detail modeling focuses on capturing the object edges by supervision of explicitly decomposed detail label that consists of the pixels that are nested on the edge and near the edge. Then the body filling learns the body part which will be filled into the detail map to generate more accurate saliency map. To effectively fuse the features and handle objects at different scales, we have also proposed two novel multi-scale detail attention and body attention blocks for precise detail and body modeling. Experimental results show that our method achieves state-of-the-art performances on six public datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑