Proc-GS: Procedural Building Generation for City Assembly with 3D Gaussians
The Chinese University of Hong Kong(香港中文大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Brown University(布朗大学);Cornell University(康奈尔大学);The University of Hong Kong(香港大学)
Yixuan Li, Xingjian Ran, Linning Xu, Tao Lu, Mulin Yu, Zhenzhi Wang, Yuanbo Xiangli, Dahua Lin, Bo Dai
Buildings are primary components of cities, often featuring repeated elements such as windows and doors. Traditional 3D building asset creation is labor-intensive and requires specialized skills to develop design rules. Recent generative models for building creation often overlook these patterns, leading to low visual fidelity and limited scalability. Drawing inspiration from procedural modeling techniques used in the gaming and visual effects industry, our method, Proc-GS, integrates procedural code into the 3D Gaussian Splatting (3D-GS) framework, leveraging their advantages in high-fidelity rendering and efficient asset management from both worlds. By manipulating procedural code, we can streamline this process and generate an infinite variety of buildings. This integration significantly reduces model size by utilizing shared foundational assets, enabling scalable generation with precise control over building assembly. We showcase the potential for expansive cityscape generation while maintaining high rendering fidelity and precise control on both real and synthetic cases.
Imagine a City: CityGenAgent for Procedural 3D City Generation
Lingnan University, Hong Kong SAR, China(岭南大学);Zhejiang University, Hangzhou, China(浙江大学);The Chinese University of Hong Kong, Hong Kong SAR, China(香港中文大学);Autodesk AI Lab, Canada(Autodesk AI实验室);The University of Hong Kong, Hong Kong SAR, China(香港大学)
CityX: Controllable Procedural Content Generation for Unbounded 3D Cities
University of Chinese Academy of Sciences(中国科学院大学);China University of Geosciences (Beijing)(中国地质大学(北京));Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所);Shandong University(山东大学);University of Science and Technology Beijing(北京科技大学)
Can You Learn to See Without Images? Procedural Warm-Up for Vision Transformers
Australian Institute for Machine Learning (AIML), University of Adelaide, Australia(澳大利亚机器学习研究所(AIML),阿德莱德大学,澳大利亚);École Polytechnique Fédérale de Lausanne (EPFL), Switzerland(瑞士联邦理工学院(EPFL));Idiap Research Institute, Switzerland(日内瓦研究所)