arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.14589cs.CV
收藏

URSimulator:基于人类感知驱动的提示调优,通过扩散模型增强虚拟城市更新

URSimulator: Human-Perception-Driven Prompt Tuning for Enhanced Virtual Urban Renewal via Diffusion Models

University at Albany, State University of New York(纽约州立大学奥尔巴尼分校);Google(谷歌公司)

Chuanbo Hu, Shan Jia, Xin Li

AI总结:

本文提出URSimulator框架,结合文本驱动的Stable Diffusion与人类感知反馈进行提示调优,通过迭代编辑街景图像模拟城市更新,显著提升了环境的安全、美感和活力感知,为城市规划提供量化评估工具。

摘要:

解决城市物理失序问题(如废弃建筑、垃圾、杂乱植被、涂鸦)至关重要,因为它会对社区的安全、福祉和心理状态产生负面影响。城市更新是复兴城市中被忽视和衰败区域的过程,旨在改善居民的物质环境和生活质量。有效的城市更新工作能够改变这些环境,提升其吸引力和宜居性。然而,目前的研究缺乏能够定量评估和可视化更新工作影响的模拟工具,往往依赖主观判断。此类工具对于规划和实施有效策略至关重要,因为它们能清晰展示潜在变化及其影响。本文提出了一个新颖的框架来解决这一空白,该框架利用人类感知反馈来模拟街道环境的改善。我们开发了一种提示调优方法,将文本驱动的Stable Diffusion与人类感知反馈相结合,迭代编辑街景图像的局部区域,以更好地契合对美感、活力和安全性的感知。我们的实验表明,该框架显著改善了对城市环境的感知,其中安全性提升了17.60%,美感提升了31.15%,活力提升了28.82%。相比之下,DiffEdit等先进方法仅分别实现了2.31%、11.87%和15.84%的提升。我们将该框架应用于各种虚拟场景,包括社区改善、建筑重建、绿地扩建和社区花园创建。结果证明了其在模拟城市更新方面的有效性,为城市规划和政策制定提供了有价值的见解。

英文摘要:

Tackling Urban Physical Disorder (e.g., abandoned buildings, litter, messy vegetation, graffiti) is essential, as it negatively impacts the safety, well-being, and psychological state of communities. Urban Renewal is the process of revitalizing these neglected and decayed areas within a city to improve the physical environment and quality of life for residents. Effective urban renewal efforts can transform these environments, enhancing their appeal and livability. However, current research lacks simulation tools that can quantitatively assess and visualize the impacts of renewal efforts, often relying on subjective judgments. Such tools are crucial for planning and implementing effective strategies by providing a clear visualization of potential changes and their impacts. This paper presents a novel framework addressing this gap by using human perception feedback to simulate street environment enhancement. We develop a prompt tuning approach that integrates text-driven Stable Diffusion with human perception feedback, iteratively editing local areas of street view images to better align with perceptions of beauty, liveliness, and safety. Our experiments show that this framework significantly improves perceptions of urban environments, with increases of 17.60% in safety, 31.15% in beauty, and 28.82% in liveliness. In contrast, advanced methods like DiffEdit achieve only 2.31%, 11.87%, and 15.84% improvements, respectively. We applied this framework across various virtual scenarios, including neighborhood improvement, building redevelopment, green space expansion, and community garden creation. The results demonstrate its effectiveness in simulating urban renewal, offering valuable insights for urban planning and policy-making.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑