arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.06951cs.CV
收藏

无监督深度学习符合Chan-Vese模型

Unsupervised Deep Learning Meets Chan-Vese Model

Tsinghua University(清华大学);Yanqi Lake Beijing Institute of Mathematical Sciences and Applications(北京雁栖湖应用数学研究院);Stony Brook University(石溪大学)

Dihan Zheng, Chenglong Bao, Zuoqiang Shi, Haibin Ling, Kaisheng Ma

摘要:

Chan-Vese(CV)模型是一种经典的基于区域的图像分割方法。然而,它的分段常数假设并不总是成立的实际应用。虽然已经提出了许多改进措施,但这个问题仍然远远没有得到很好的解决。在这项工作中,我们提出了一种无监督的图像分割方法,该方法将CV模型与深度神经网络相结合,显著提高了原始CV模型的分割精度。我们的基本思想是应用一个深度神经网络,将图像映射到一个潜在的空间,以减轻图像空间中的分段常数假设的违反。我们制定了这个想法下的经典贝叶斯框架近似的可能性与证据下限(ELBO)的条款,同时保持在CV模型的先验项。因此,我们的模型只需要输入图像本身,不需要外部数据集的预训练。此外,我们的想法扩展到多阶段的情况下,基于数据集的无监督图像分割。大量的实验验证了我们的模型的有效性,并表明该方法是显着优于其他无监督分割方法。

英文摘要:

The Chan-Vese (CV) model is a classic region-based method in image segmentation. However, its piecewise constant assumption does not always hold for practical applications. Many improvements have been proposed but the issue is still far from well solved. In this work, we propose an unsupervised image segmentation approach that integrates the CV model with deep neural networks, which significantly improves the original CV model's segmentation accuracy. Our basic idea is to apply a deep neural network that maps the image into a latent space to alleviate the violation of the piecewise constant assumption in image space. We formulate this idea under the classic Bayesian framework by approximating the likelihood with an evidence lower bound (ELBO) term while keeping the prior term in the CV model. Thus, our model only needs the input image itself and does not require pre-training from external datasets. Moreover, we extend the idea to multi-phase case and dataset based unsupervised image segmentation. Extensive experiments validate the effectiveness of our model and show that the proposed method is noticeably better than other unsupervised segmentation approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑