基于粒状球计算的正方形超像素生成与表征学习
Square Superpixel Generation and Representation Learning via Granular Ball Computing
AI总结:
本文提出一种基于粒状球计算的正方形超像素生成方法,通过多尺度正方形块近似超像素,解决不规则形状带来的计算难题,实现高效并行处理和可学习特征提取。
摘要:
超像素提供了一种紧凑的基于区域的表示,能够保持物体边界和局部结构,因此被广泛应用于各种视觉任务以降低计算成本。然而,大多数现有超像素算法生成不规则形状的区域,这些形状与卷积等常规操作不匹配。因此,超像素通常被用作离线预处理步骤,限制了并行实现并阻碍了深度学习流水线中的端到端优化。受粒状球计算的自适应表示和覆盖性质的启发,我们开发了一种正方形超像素生成方法。具体而言,我们使用多尺度正方形块近似超像素,以避免不规则形状引起的计算和实现困难,从而实现高效的并行处理和可学习特征提取。对于每个块,基于像素强度相似性计算纯度分数,并据此选择高质量的块。所得到的正方形超像素可以方便地集成为图神经网络(GNN)中的图节点或作为视觉变换器(ViT)中的标记,促进多尺度信息聚合和结构化视觉表示。在下游任务上的实验结果表明,一致的性能提升验证了所提方法的有效性。
英文摘要:
Superpixels provide a compact region-based representation that preserves object boundaries and local structures, and have therefore been widely used in a variety of vision tasks to reduce computational cost. However, most existing superpixel algorithms produce irregularly shaped regions, which are not well aligned with regular operators such as convolutions. Consequently, superpixels are often treated as an offline preprocessing step, limiting parallel implementation and hindering end-to-end optimization within deep learning pipelines. Motivated by the adaptive representation and coverage property of granular-ball computing, we develop a square superpixel generation approach. Specifically, we approximate superpixels using multi-scale square blocks to avoid the computational and implementation difficulties induced by irregular shapes, enabling efficient parallel processing and learnable feature extraction. For each block, a purity score is computed based on pixel-intensity similarity, and high-quality blocks are selected accordingly. The resulting square superpixels can be readily integrated as graph nodes in graph neural networks (GNNs) or as tokens in Vision Transformers (ViTs), facilitating multi-scale information aggregation and structured visual representation. Experimental results on downstream tasks demonstrate consistent performance improvements, validating the effectiveness of the proposed method.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。