On Optimal Sampling for Learning SDF Using MLPs Equipped with Positional Encoding
University of Hong Kong(香港大学);University of British Columbia(不列颠哥伦比亚大学);City University of Hong Kong(香港城市大学);Zhejiang University(浙江大学);Texas A&M University(德克萨斯农工大学)
Guying Lin, Lei Yang, Yuan Liu, Congyi Zhang, Junhui Hou, Xiaogang Jin, Taku Komura, John Keyser, Wenping Wang
Neural implicit fields, such as the neural signed distance field (SDF) of a shape, have emerged as a powerful representation for many applications, e.g., encoding a 3D shape and performing collision detection. Typically, implicit fields are encoded by Multi-layer Perceptrons (MLP) with positional encoding (PE) to capture high-frequency geometric details. However, a notable side effect of such PE-equipped MLPs is the noisy artifacts present in the learned implicit fields. While increasing the sampling rate could in general mitigate these artifacts, in this paper we aim to explain this adverse phenomenon through the lens of Fourier analysis. We devise a tool to determine the appropriate sampling rate for learning an accurate neural implicit field without undesirable side effects. Specifically, we propose a simple yet effective method to estimate the intrinsic frequency of a given network with randomized weights based on the Fourier analysis of the network's responses. It is observed that a PE-equipped MLP has an intrinsic frequency much higher than the highest frequency component in the PE layer. Sampling against this intrinsic frequency following the Nyquist-Sannon sampling theorem allows us to determine an appropriate training sampling rate. We empirically show in the setting of SDF fitting that this recommended sampling rate is sufficient to secure accurate fitting results, while further increasing the sampling rate would not further noticeably reduce the fitting error. Training PE-equipped MLPs simply with our sampling strategy leads to performances superior to the existing methods.
CASA-SDF: Curriculum-Aware Spatial Adaptation with Curvature-Guided Density for Neural Implicit Surface Reconstruction
School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);School of Automation, Nanjing University of Science and Technology(南京理工大学自动化学院)
Efficient Point Cloud Processing with High-Dimensional Positional Encoding and Non-Local MLPs
School of Artificial Intelligence and Robotics, Quanzhou Institute of Industrial Design and Machine Intelligence Innovation, Hunan University(人工智能与机器人学院、泉州工业设计与智能机械创新研究院、湖南大学);College of Engineering and Design, Hunan Normal University(工程与设计学院、湖南师范大学);College of Intelligence Science and Technology, National University of Defense Technology(智能科学与技术学院、国防科技大学);School of Computing and Information Systems, The University of Melbourne(计算与信息学院、墨尔本大学)
Parameterization of Cross-Token Relations with Relative Positional Encoding for Vision MLP
University of Science and Technology of China(中国科学技术大学);Institute of Microelectronics, Chinese Academy of Sciences(中国科学院微电子研究所);Singapore Management University(新加坡管理大学);University of Manchester(曼彻斯特大学)
Every Feedforward Neural Network Definable in an o-Minimal Structure Has Finite Sample Complexity
Department of Mathematics & Statistics, McMaster University(数学与统计学系,麦斯特大学);Department of Mathematics & Statistics, Concordia University(数学与统计学系,康科迪亚大学);University of Cambridge(剑桥大学);Graduate School of Engineering, The University of Tokyo(东京大学工学研究院)
TaylorGrid: Towards Fast and High-Quality Implicit Field Learning via Direct Taylor-based Grid Optimization
School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院)
PS-NeRV: Patch-wise Stylized Neural Representations for Videos
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Shanghai AI Laboratory(上海人工智能实验室)
Pixel2ISDF: Implicit Signed Distance Fields based Human Body Model from Multi-view and Multi-pose Images
Dalian University of Technology(大连理工大学);University of California, Merced(加州大学默塞德分校);Northwestern Polytechnical University(西北工业大学);ZMO AI Inc.(ZMO人工智能公司)