Recently, many works have been proposed to utilize the neural radiance field for novel view synthesis of human performers. However, most of these methods require hours of training, making them difficult for practical use. To address this challenging problem, we propose IntrinsicNGP, which can train from scratch and achieve high-fidelity results in few minutes with videos of a human performer. To achieve this target, we introduce a continuous and optimizable intrinsic coordinate rather than the original explicit Euclidean coordinate in the hash encoding module of instant-NGP. With this novel intrinsic coordinate, IntrinsicNGP can aggregate inter-frame information for dynamic objects with the help of proxy geometry shapes. Moreover, the results trained with the given rough geometry shapes can be further refined with an optimizable offset field based on the intrinsic coordinate.Extensive experimental results on several datasets demonstrate the effectiveness and efficiency of IntrinsicNGP. We also illustrate our approach's ability to edit the shape of reconstructed subjects.
Learning Heterogeneous Mixture of Scene Experts for Large-scale Neural Radiance Fields
Department of Computer Science and Engineering, The Hong Kong University of Science and Technology(计算机科学与工程系,香港科学与技术大学);Inspur Cloud Information Technology Co, Ltd(Inspur云信息技术有限公司)
Progressive Volume Distillation with Active Learning for Efficient NeRF Architecture Conversion
School of Electrical Information Engineering, Beihang University(北京航空航天大学电子信息工程学院);Institute of Unmanned System, Beihang University(北京航空航天大学无人系统研究院);Megvii Research, Megvii Inc.(旷视科技研究院)
Audio-Driven Talking Face Generation with Blink Embedding and Hash Grid Landmarks Encoding
Department of Control Science and Engineering, University of Shanghai for Science and Technology(控制科学与工程系,上海科学技术大学);School of Psychology and Neuroscience, University of Glasgow(心理学与神经科学学院,格拉斯哥大学)
NeRF-based CBCT Reconstruction needs Normalization and Initialization
School of Biomedical Engineering, Division of Life Sciences;Medicine, University of Science;Technology of China (USTC), Hefei, 230026, China Center for Medical Imaging, Robotics, Analytic Computing \& Learning (MIRACLE), Suzhou Institute for Advance Research, USTC, Suzhou, 215123, China Computer Aided Medical Procedures (CAMP), TU Munich, 80333, Germany Key Laboratory of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS, Beijing, 100190, China Jiangsu Provincial Key Laboratory of Multimodal Digital Twin Technology, Suzhou, 215123, China State Key Laboratory of Precision \& Intelligent Chemistry, USTC, Hefei, China Munich Center for Machine Learning (MCML), Munich, Germany
Lagrangian Hashing for Compressed Neural Field Representations
Simon Fraser University(西蒙菲莎大学);University of Trento(特伦托大学);University of Toronto(多伦多大学);University of British Columbia(不列颠哥伦比亚大学);Google DeepMind(谷歌DeepMind)
NG-GS: NeRF-Guided 3D Gaussian Splatting Segmentation
Key Laboratory of Big Data and Artificial Intelligence in Transportation, Ministry of Education(交通大数据与人工智能联合实验室,教育部);School of Computer and Information Technology, Beijing Jiaotong University(北京交通大学计算机与信息学院);Department of Artificial Intelligence, Westlake University(西湖大学人工智能学院)
Explicit-NeRF-QA: A Quality Assessment Database for Explicit NeRF Model Compression
Cooperative MediaNet Innovation Center, Shanghai Jiao Tong University(上海交通大学合作媒体网络创新中心);Department of Computer Science and Electrical Engineering, University of Missouri-Kansas City(密苏里大学堪萨斯城分校计算机科学与电气工程系)
Affine-Equivariant Kernel Space Encoding for NeRF Editing
Poznan University of Technology, Institute of Robotics and Machine Intelligence(波兹南技术大学机器人与机器智能研究所);Jagiellonian University, Faculty of Mathematics and Computer Science(雅盖隆大学数学与计算机科学学院);IDEAS Research Institute(IDEAS研究所)
BathyFacto: Refraction-Aware Two-Media Neural Radiance Fields for Bathymetry
Department of Geodesy and Geoinformation, TU Wien(维也纳技术大学测绘与地理信息系);Institute of Photogrammetry and Remote Sensing (IPF), Karlsruhe Institute of Technology (KIT)(卡尔斯鲁厄理工学院测绘与遥感研究所);Unit of Geometry and Surveying, University of Innsbruck(因斯布鲁克大学几何与测绘单位)
Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction
Finnish Center for Artificial Intelligence (FCAI)(芬兰人工智能中心);ELLIS Unit Helsinki(欧洲学习与智能系统研究所赫尔辛基分部);University of Helsinki(赫尔辛基大学);Institute for Urban Studies (Urbaria)(城市研究所);Institute of Sustainability Science (HELSUS)(可持续发展科学研究所)