用于可视化抽象社会过程的生成模型:以贫困指数引导StyleGAN2的街景图像合成
Generative models for visualising abstract social processes: Guiding streetview image synthesis of StyleGAN2 with indices of deprivation
AI总结:
本文利用StyleGAN2对伦敦街景图像进行训练与反演,结合多重贫困指数映射潜在空间中的社会视觉特征,并实现条件化图像合成,展示了生成模型用于社会科学研究的潜力。
摘要:
本文提出了一种生成对抗网络(GANs)在研究社会过程视觉方面的新应用。我在一个包含14,564张伦敦图像的定制数据集上训练了一个StyleGAN2模型,这些图像来源于在伦敦拍摄的Google街景。训练完成后,我对训练集中的图像进行反演,在模型潜在空间中找到与它们对应的点,并比较了三种反演技术的结果。我将每个数据点与多重贫困指数(Indices of Multiple Deprivation)的元数据相连接,这些元数据描述了拍摄照片所在地区的收入、健康和环境质量。由此可以映射模型潜在空间中哪些部分编码了对健康、收入和环境质量具有区分性的视觉特征,并基于这些因素条件化地合成新图像。所生成的合成图像反映了此前未知且难以研究的社会过程的视觉特征,描述了伦敦贫困地区与富裕地区之间反复出现的视觉差异。GANs以其能够产生呈现视觉差异的连续图像范围而闻名。本文测试了如何通过静态图像中的视觉比较以及一个交互式网站来利用这一能力,用户可以在该网站上通过滑块引导图像合成。尽管条件化合成存在局限性且结果难以验证,但本文指出了生成模型被重新用作社会科学方法组成部分的潜力。
英文摘要:
This paper presents a novel application of Generative Adverserial Networks (GANs) to study visual aspects of social processes. I train a a StyleGAN2-model on a custom dataset of 14,564 images of London, sourced from Google Streetview taken in London. After training, I invert the images in the training set, finding points in the model's latent space that correspond to them, and compare results from three inversion techniques. I connect each data point with metadata from the Indices of Multiple Deprivation, describing income, health and environmental quality in the area where the photographs were taken. It is then possible to map which parts of the model's latent space encode visual features that are distinctive for health, income and environmental quality, and condition the synthesis of new images based on these factors. The synthetic images created reflect visual features of social processes that were previously unknown and difficult to study, describing recurring visual differences between deprived and privileged areas in London. GANs are known for their capability to produce a continuous range of images that exhibit visual differences. The paper tests how to exploit this ability through visual comparisons in still images as well as through an interactive website where users can guide image synthesis with sliders. Though conditioned synthesis has its limitations and the results are difficult to validate, the paper points to the potential for generative models to be repurposed to be parts of social scientific methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。