arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2606.20390cs.CV

几何感知超像素图变换器结合元数据用于皮肤病变分类

Geometry-Aware Superpixel Graph Transformer with Metadata for Skin Lesion Classification

Edge Hill University(埃奇希尔大学)

Muhammad Azeem, Tanveer Hussain, Amr Ahmed, Ardhendu Behera

AI总结:

提出一种基于区域的图学习框架,将病变建模为超像素图,利用几何边属性和元数据上下文节点,通过边缘感知图变换器实现多模态融合,在四个公开数据集上取得优于现有方法的分类性能。

摘要:

由于病变结构异质性、类内变异大以及良恶性病例间细微视觉差异,从皮肤镜图像进行自动化皮肤癌分类仍然具有挑战性。现有的CNN/ViT流程通常依赖全局或补丁级特征,并常通过后期融合结合患者元数据,这限制了空间基础的多模态推理。我们提出一种新颖的基于区域的图学习框架,将病变显式建模为空间连贯的超像素区域图,这些区域表示为冻结的CNN特征。为了捕捉细粒度的病变排列,我们将区域间几何编码为边属性,并引入一个与所有区域相连的专用元数据上下文节点,从而在同一关系空间内结构化地整合人口统计学/临床变量。节点表示通过我们的边缘感知图变换器进行更新,随后进行注意力驱动的传播,最终生成用于良恶性分类的图级嵌入。在四个公开基准上的实验表明,显式的区域级关系建模和图原生多模态融合相较于现有技术取得了持续改进。因此,我们建立了一种新的以图为中心的视角,其中CNN特征被建模为关系节点,并通过上下文整合得到改进,从而产生更具表现力和鲁棒性的分类结果。

英文摘要:

Automated skin cancer classification from dermoscopic images remains challenging due to heterogeneous lesion structure, strong intra-class variability, and subtle visual differences between benign and malignant cases. Existing CNN/ViT pipelines typically rely on global or patch-level features and often combine patient metadata via late fusion, which limits spatially grounded multimodal reasoning. We present a novel region-based graph learning framework that explicitly models lesions as graphs of spatially coherent superpixel regions represented as frozen CNN features. To capture fine-grained lesion arrangements, we encode inter-regional geometry as edge attributes and introduce a dedicated metadata context node connected to all regions, providing structured integration of demographic/clinical variables within the same relational space. Node representations are updated using our edge-aware graph transformer followed by attention-driven propagation, and a final graph-level embedding for benign-malignant classification. Experiments on four public benchmarks demonstrate that explicit region-level relational modeling and graph-native multimodal fusion yield consistent gains over the state-of-the-art. Consequently, we establish a new graph-centric perspective in which CNN features are modeled as relational nodes and improved through contextual integration, yielding more expressive and robust classifications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑