ControLRM: Fast and Controllable 3D Generation via Large Reconstruction Model
South China University of Technology(华南理工大学);Alibaba Group(阿里巴巴集团);University of Chinese Academy of Sciences(中国科学院大学);National University of Singapore(新加坡国立大学)
Hongbin Xu, Weitao Chen, Zhipeng Zhou, Feng Xiao, Baigui Sun, Mike Zheng Shou, Wenxiong Kang
Despite recent advancements in 3D generation methods, achieving controllability still remains a challenging issue. Current approaches utilizing score-distillation sampling are hindered by laborious procedures that consume a significant amount of time. Furthermore, the process of first generating 2D representations and then mapping them to 3D lacks internal alignment between the two forms of representation. To address these challenges, we introduce ControLRM, an end-to-end feed-forward model designed for rapid and controllable 3D generation using a large reconstruction model (LRM). ControLRM comprises a 2D condition generator, a condition encoding transformer, and a triplane decoder transformer. Instead of training our model from scratch, we advocate for a joint training framework. In the condition training branch, we lock the triplane decoder and reuses the deep and robust encoding layers pretrained with millions of 3D data in LRM. In the image training branch, we unlock the triplane decoder to establish an implicit alignment between the 2D and 3D representations. To ensure unbiased evaluation, we curate evaluation samples from three distinct datasets (G-OBJ, GSO, ABO) rather than relying on cherry-picking manual generation. The comprehensive experiments conducted on quantitative and qualitative comparisons of 3D controllability and generation quality demonstrate the strong generalization capacity of our proposed approach.
eBIRD: Event-based Intensity Image Reconstruction Using Controllable Diffusion Models
Institute of Engineering Sciences, Universidad de O’Higgins(奥伊金斯大学工程科学学院);The Iniciativa de Datos e Inteligencia Artificial, University of Chile(智利大学数据与人工智能倡议)
DecoyFace: Beyond Obfuscation via Controllable and Imperceptible Identity Misdirection for Privacy-Preserving Face Recognition
School of Information and Communications Engineering, Xi’an Jiaotong University(西安交通大学信息与通信工程学院);Shaanxi Key Laboratory of Deep Space Exploration Intelligent Information Technology(陕西省深空探测智能信息技术重点实验室)
SesaHand: Enhancing 3D Hand Reconstruction via Controllable Generation with Semantic and Structural Alignment
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));The Hong Kong University of Science and Technology(香港科学与技术大学);Communication University of China(中国通信大学)
Sparse Gain Radio Map Reconstruction With Geometry Priors and Uncertainty-Guided Measurement Selection
National Key Laboratory of Wireless Communications, University of Electronic Science and Technology of China (UESTC)(电子科技大学通信抗干扰全国重点实验室);University of Electronic Science and Technology of China (UESTC)(电子科技大学);Department of Information Science Technology, University of Houston(休斯顿大学信息科学与技术系);School of Science, Technology and Engineering, University of the Sunshine Coast(阳光海岸大学科学、技术与工程学院);ZGC Institute of Ubiquitous-X Innovation and Applications(中关村泛在融合创新研究院)
DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatars
University of Tübingen(图宾根大学);Tübingen AI Center(图宾根人工智能中心);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Max Planck Institute for Informatics(马克斯·普朗克信息研究所);Zuse School ELIZA(祖斯学校ELIZA)
Layout-your-3D: Controllable and Precise 3D Generation with 2D Blueprint
Huazhong University of Science and Technology(华中科技大学);NVIDIA(英伟达);Wuhan University(武汉大学);Insta360 Research(影石创新研究院);UC Merced(加州大学默塞德分校);Yonsei University(延世大学)
ZeroScene: A Zero-Shot Framework for 3D Scene Generation from a Single Image and Controllable Texture Editing
Harbin Institute of Technology, Shenzhen, China(哈尔滨工业大学(深圳));Pengcheng Laboratory, China(鹏城实验室);Harbin Institute of Technology, China(哈尔滨工业大学);Harbin Institute of Technology, Suzhou Research Institute, China(哈尔滨工业大学苏州市研究院)
BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation
Department of Biomedical Data Science, Stanford University School of Medicine(斯坦福大学医学院生物医学数据科学系);Department of Mathematical Modelling, Statistics & Bioinformatics, Ghent University(根特大学数学建模、统计与生物信息学系);Department of Electrical Engineering, Stanford University(斯坦福大学电气工程系)
NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generation
Simon Fraser University(西蒙弗雷泽大学);National Yang Ming Chiao Tung University(国家阳明交通大学);Simon Fraser University, CIFAR AI Chair, Amii(西蒙弗雷泽大学、CIFAR人工智能主席、Amii)