Given the size of modern cities in the urbanising age, it is beyond the perceptual capacity of most people to develop a good knowledge about the beauty and ugliness of the city at every street corner. Correspondingly, for planners, it is also difficult to accurately answer questions like 'where are the worst-looking places in the city that regeneration should give first consideration', or 'in the fast urbanising cities, how is the city appearance changing', etc. To address this issue, we here present a computer vision method for the large-scale and automatic evaluation of the urban visual environment, by leveraging state-of-the-art machine learning techniques and the wide-coverage street view images. From the various factors that are at work, we choose two key features, the visual quality of street facade and the continuity of street wall, as the starting point of this line of analysis. In order to test the validity of this method, we further compare the machine ratings with ratings collected on site from 752 passers-by on fifty-six locations. We show that the machine learning model can produce a good estimation of people's real visual experience, and it holds much potential for various tasks in terms of urban design evaluation, culture identification, etc.
Urban Visual Intelligence: Studying Cities with AI and Street-level Imagery
Massachusetts Institute of Technology(麻省理工学院);The Hong Kong University of Science and Technology(香港科技大学);Nanjing Normal University(南京师范大学);Peking University(北京大学);University College London(伦敦大学学院)
From Street View to Visual Network: Mapping the Visibility of Urban Landmarks with Vision-Language Models
organization= Department of Architecture, National University of Singapore , country= Singapore;organization= Research \& Development Institute, Takenaka Corporation , country= Japan;organization= Urban Analytics Subject Group, Urban Studies \& Social Policy Division, University of Glasgow , country= United Kingdom;organization= Institute of Remote Sensing;GIS, Peking University , country= China;organization= Department of Real Estate, National University of Singapore , country= Singapore
Diagnosing Urban Street Vitality via a Visual-Semantic and Spatiotemporal Framework for Street-Level Economics
School of Economics and Management, Southeast University(经济管理学院,东南大学);School of Information Science and Engineering, Southeast University(信息科学与工程学院,东南大学);School of Architecture, Southeast University(建筑学院,东南大学)
Designing streetscapes from street-view imagery using diffusion models
Department of Urban and Regional Planning, University of Florida(城市与区域规划系,佛罗里达大学);Singapore-MIT Alliance for Research and Technology Centre (SMART)(新加坡-麻省理工联合研究中心(SMART));Department of Landscape Architecture and Urban Planning, Texas A&M University(景观建筑与城市规划系,德克萨斯大学安德森分校);Department of Agronomy, University of Florida(农业系,佛罗里达大学)
Towards General Urban Monitoring with Vision-Language Models: A Review, Evaluation, and a Research Agenda
ALGORITMI Research Centre/LASI(ALGORITMI研究机构/LASI);University of Minho(明霍大学);Logimade(Logimade公司);INESC TEC(INESC TEC研究机构);Ai, School of Technology(2Ai技术学院);IPCA
Cross-Modal Urban Sensing: Evaluating Sound-Vision Alignment Across Street-Level and Aerial Imagery
Department of Geography, University of South Carolina(南卡罗来纳大学地理系);Department of Environmental Sciences, Emory University(埃默里大学环境科学系);University of Canterbury(坎特伯雷大学);School of Resource and Environmental Sciences, Wuhan University(武汉大学资源与环境科学学院)
Plant Doctor: A hybrid machine learning and image segmentation software to quantify plant damage in video footage
Waseda University(早稻田大学);Kyoto Prefecture Momoyama High School(京都府立桃山高等学校);Kyushu University(九州大学);The University of Tokyo Hospital(东京大学医学部附属医院);Ryukoku University(龙谷大学)
NavAgent: Multi-scale Urban Street View Fusion For UAV Embodied Vision-and-Language Navigation
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);University of Chinese Academy of Sciences(中国科学院大学);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院)