arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.18201cs.CV
收藏

学习用于超像素生成的不变像素间相关性

Learning Invariant Inter-pixel Correlations for Superpixel Generation

Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学研究所);Beijing Key Laboratory of Advanced Information Science and Network Technology(北京市高级信息科学与网络技术重点实验室);Frontiers Science Center for Smart High-speed Railway System, Beijing Jiaotong University(北京交通大学智慧高铁系统前沿科学中心);DaoAI Robotics Inc.(道智机器人公司)

Sen Xu, Shikui Wei, Tao Ruan, Lixin Liao

AI总结:

针对深度超像素易受训练数据统计风格影响的问题,提出CDS算法,通过辅助模态、局部网格相关性对齐和全局风格互信息最小化学习不变像素间关系,提升边界贴合、泛化与效率。

摘要:

深度超像素算法通过用可学习特征替代手工特征取得了显著进展。然而,我们观察到,现有深度超像素方法作为中层表示操作,仍对训练数据集中嵌入的统计属性(如颜色分布、高层语义)敏感。因此,可学习特征表现出受限的判别能力,导致像素分组性能不理想,尤其是在不可训练的应用场景中。为解决该问题,我们提出 Content Disentangle Superpixel(CDS,内容解耦超像素)算法,以选择性地分离不变的像素间相关性与统计属性(即风格噪声)。具体而言,我们首先构建与原始 RGB 图像同源但具有显著风格变化的辅助模态。随后,在互信息驱动下,我们提出跨模态的局部网格相关性对齐,以减少自适应选择特征的分布差异,并学习不变的像素间相关性。之后,我们执行全局风格互信息最小化,以强制分离不变内容与训练数据风格。在四个基准数据集上的实验结果表明,我们的方法在边界贴合度、泛化性和效率方面优于现有最先进方法。代码和预训练模型可在 https://github.com/rookiie/CDSpixel 获取。

英文摘要:

Deep superpixel algorithms have made remarkable strides by substituting hand-crafted features with learnable ones. Nevertheless, we observe that existing deep superpixel methods, serving as mid-level representation operations, remain sensitive to the statistical properties (e.g., color distribution, high-level semantics) embedded within the training dataset. Consequently, learnable features exhibit constrained discriminative capability, resulting in unsatisfactory pixel grouping performance, particularly in untrainable application scenarios. To address this issue, we propose the Content Disentangle Superpixel (CDS) algorithm to selectively separate the invariant inter-pixel correlations and statistical properties, i.e., style noise. Specifically, We first construct auxiliary modalities that are homologous to the original RGB image but have substantial stylistic variations. Then, driven by mutual information, we propose the local-grid correlation alignment across modalities to reduce the distribution discrepancy of adaptively selected features and learn invariant inter-pixel correlations. Afterwards, we perform global-style mutual information minimization to enforce the separation of invariant content and train data styles. The experimental results on four benchmark datasets demonstrate the superiority of our approach to existing state-of-the-art methods, regarding boundary adherence, generalization, and efficiency. Code and pre-trained model are available at https://github.com/rookiie/CDSpixel.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑