arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.08083cs.CV

UV-SAM:适配Segment Anything Model用于城中村识别

UV-SAM: Adapting Segment Anything Model for Urban Village Identification

Tsinghua University(清华大学)

Xin Zhang, Yu Liu, Yuming Lin, Qingmin Liao, Yong Li

AI总结:

针对现有城中村卫星图像检测方法边界识别精度不足的问题,提出适配Segment Anything Model的UV-SAM方法,通过小型模型生成混合提示实现细粒度分割,性能优于基线,还揭示了城中村数量与面积逐年下降的趋势。

摘要:

城中村指城市中心内部或周边的非正式居住区,以基础设施不足、居住条件差为特征,与贫困、适足住房、可持续城市相关的可持续发展目标(SDGs)密切相关。传统上政府高度依赖实地调查方法监测城中村,但这类方法耗时耗力,且可能存在滞后性。得益于广泛可用且及时更新的卫星图像,近期研究开发了计算机视觉技术以高效检测城中村,但现有研究要么聚焦于简单的城中村图像分类,要么无法提供准确的边界信息。为从卫星图像中准确识别城中村边界,我们利用视觉基础模型的能力,将Segment Anything Model(SAM)适配于城中村分割任务,命名为UV-SAM。具体而言,UV-SAM首先利用一个小型语义分割模型生成城中村的混合提示,包括掩码、边界框和图像表征,随后将其输入SAM以进行细粒度边界识别。在中国两个数据集上的大量实验结果表明,UV-SAM的性能优于现有基线模型;跨多年的识别结果显示,城中村的数量和面积均随时间推移呈下降趋势,这为城中村的发展趋势提供了更深入的见解,也为面向可持续城市的视觉基础模型研究提供了思路。本研究的数据集和代码可在https://github.com/tsinghua-fib-lab/UV-SAM获取。

英文摘要:

Urban villages, defined as informal residential areas in or around urban centers, are characterized by inadequate infrastructures and poor living conditions, closely related to the Sustainable Development Goals (SDGs) on poverty, adequate housing, and sustainable cities. Traditionally, governments heavily depend on field survey methods to monitor the urban villages, which however are time-consuming, labor-intensive, and possibly delayed. Thanks to widely available and timely updated satellite images, recent studies develop computer vision techniques to detect urban villages efficiently. However, existing studies either focus on simple urban village image classification or fail to provide accurate boundary information. To accurately identify urban village boundaries from satellite images, we harness the power of the vision foundation model and adapt the Segment Anything Model (SAM) to urban village segmentation, named UV-SAM. Specifically, UV-SAM first leverages a small-sized semantic segmentation model to produce mixed prompts for urban villages, including mask, bounding box, and image representations, which are then fed into SAM for fine-grained boundary identification. Extensive experimental results on two datasets in China demonstrate that UV-SAM outperforms existing baselines, and identification results over multiple years show that both the number and area of urban villages are decreasing over time, providing deeper insights into the development trends of urban villages and sheds light on the vision foundation models for sustainable cities. The dataset and codes of this study are available at https://github.com/tsinghua-fib-lab/UV-SAM.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑