arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.04525cs.CVcs.AI

SLUM-i: 非正规住区城市制图的半监督学习与数据质量基准测试

SLUM-i: Semi-supervised Learning for Urban Mapping of Informal Settlements and Data Quality Benchmarking

School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST)(电气工程与计算机科学学院,国立科学与技术大学(NUST));Smart Data & Knowledge Services, German Research Center for Artificial Intelligence (DFKI)(智能数据与知识服务,德国人工智能研究中心(DFKI))

Muhammad Taha Mukhtar, Syed Musa Ali Kazmi, Khola Naseem, Muhammad Ali Chattha, Andreas Dengel, Sheraz Ahmed, Muhammad Naseer Bajwa, Muhammad Imran Malik

AI总结:

针对非正规住区制图中标注稀缺和数据质量挑战,提出半监督分割框架,集成类别自适应阈值和DINOv2过滤机制,在跨三大洲七城市实验中mIoU提升最高5.9个百分点。

摘要:

快速的城市扩张推动了低收入和中等收入国家主要城市非正规住区的增长,巴基斯坦的拉合尔和卡拉奇以及印度的孟买就是突出的例子。然而,这些住区的大规模制图不仅受到标注稀缺的严重限制,还受到固有数据质量挑战的制约,特别是正式与非正式结构之间的高光谱模糊性和显著的标注噪声。我们通过引入一个从头构建的拉合尔基准数据集,以及从经过验证的行政边界导出的卡拉奇和孟买配套数据集来解决这一问题,这些数据集总计约900平方公里的城市区域。该集合还补充了来自撒哈拉以南非洲和拉丁美洲先前文献中的四个城市,并为每个城市提供了全面的数据质量评估。我们还提出了一个半监督分割框架,旨在缓解标准半监督学习流程中固有的类别不平衡和分布不匹配问题。我们的方法集成了类别自适应阈值机制,该机制动态调整置信度阈值以防止少数类抑制,以及基于DINOv2的未标记池过滤器,该过滤器在训练前移除分布外的图块以减少协变量偏移。跨越三大洲七个城市、重复五个随机种子的广泛实验表明,与最先进的半监督基线相比,mIoU最高提升5.9个百分点,且两个组件均与架构无关,不增加推理开销。

英文摘要:

Very-high-resolution remote-sensing imagery provides a scalable basis for delineating informal settlements, but sparse annotations, severe imbalance between informal-settlement and background pixels, and cross-city heterogeneity in urban morphology and image--mask correspondence complicate model development. We present SLUM-i, a semi-supervised semantic segmentation framework together with a geographically diverse seven-city Earth observation benchmark spanning three continents. The benchmark combines a newly annotated Lahore dataset and companion Karachi and Mumbai datasets with four publicly released city datasets, totaling 14,458 RGB image--mask tiles. We quantify cross-city heterogeneity using class composition, boundary morphology, grayscale separability, correspondence between mask boundaries and image edges, and divergence between measured feature distributions. For label-efficient mapping, SLUM-i combines representation-guided unlabeled-pool curation, using embeddings from a vision foundation model (DINOv2-Small) to remove the least-similar tiles, and Class-Aware Adaptive Thresholding, which adapts pseudo-label acceptance by class through global mean-confidence and per-class mean-softmax exponential moving averages. Experiments at 10%, 20%, and 30% label budgets, using convolutional and vision-transformer backbones and five random seeds, demonstrate improvements over the corresponding UniMatch baselines in multiple city--budget settings, reaching +5.9 percentage points in mean intersection-over-union. At the 30% budget, the ResNet-101 configuration matches or exceeds its corresponding fully labeled supervised baseline in four of seven cities. Both components operate only during training and add no inference overhead.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑