arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1608.01769cs.CV
收藏

深度学习城市:在全球范围内量化城市感知

Deep Learning the City : Quantifying Urban Perception At A Global Scale

Indian Institute of Technology Delhi(印度理工学院德里分校);Virginia Tech(弗吉尼亚理工大学);MIT Media Lab(麻省理工学院媒体实验室)

Abhimanyu Dubey, Nikhil Naik, Devi Parikh, Ramesh Raskar, César A. Hidalgo

摘要:

量化城市环境感知的计算机视觉方法越来越多地用于研究城市外观与居民行为和健康之间的关系。然而,目前方法的吞吐量太有限,无法量化世界各地城市的感知。为了应对这一挑战,我们引入了一个新的众包数据集,其中包含来自56个城市的110,988张图像,以及由81,630名在线志愿者提供的1,170,000个成对比较,以及六个感知属性:安全,活泼,无聊,富有,令人沮丧和美丽。使用这些数据,我们训练一个类似于暹罗的卷积神经架构,它从联合分类和排名损失中学习,以预测人类对成对图像比较的判断。我们的研究结果表明,众包与神经网络相结合,可以在全球范围内产生城市感知数据。

英文摘要:

Computer vision methods that quantify the perception of urban environment are increasingly being used to study the relationship between a city's physical appearance and the behavior and health of its residents. Yet, the throughput of current methods is too limited to quantify the perception of cities across the world. To tackle this challenge, we introduce a new crowdsourced dataset containing 110,988 images from 56 cities, and 1,170,000 pairwise comparisons provided by 81,630 online volunteers along six perceptual attributes: safe, lively, boring, wealthy, depressing, and beautiful. Using this data, we train a Siamese-like convolutional neural architecture, which learns from a joint classification and ranking loss, to predict human judgments of pairwise image comparisons. Our results show that crowdsourcing combined with neural networks can produce urban perception data at the global scale.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑