Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains
University of California, Berkeley(加州大学伯克利分校);Google Research(谷歌研究院);University of California, San Diego(加州大学圣地亚哥分校)
Matthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T. Barron, Ren Ng
We show that passing input points through a simple Fourier feature mapping enables a multilayer perceptron (MLP) to learn high-frequency functions in low-dimensional problem domains. These results shed light on recent advances in computer vision and graphics that achieve state-of-the-art results by using MLPs to represent complex 3D objects and scenes. Using tools from the neural tangent kernel (NTK) literature, we show that a standard MLP fails to learn high frequencies both in theory and in practice. To overcome this spectral bias, we use a Fourier feature mapping to transform the effective NTK into a stationary kernel with a tunable bandwidth. We suggest an approach for selecting problem-specific Fourier features that greatly improves the performance of MLPs for low-dimensional regression tasks relevant to the computer vision and graphics communities.
General Fourier Feature Physics-Informed Extreme Learning Machine (GFF-PIELM) for High-Frequency PDEs
Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院));Shandong Institute of Mechanical Design and Research(山东省机械设计研究院);Yale University(耶鲁大学);Shandong University(山东大学);University of Leeds(利兹大学)
Adaptive Local Frequency Filtering for Fourier-Encoded Implicit Neural Representations
College of Computer Science (College of Software), Inner Mongolia University(内蒙古大学计算机科学学院(软件学院));Institute of Computational Imaging, Beijing Information Science and Technology University(北京信息科技大学计算成像研究所);School of Mathematics and Statistics, Wuhan University(武汉大学数学与统计学院)
Content-Aware Frequency Encoding for Implicit Neural Representations with Fourier-Chebyshev Features
School of Mathematics and Statistics, Hunan Normal University(湖南师范大学数学与统计学学院);Department of Statistics and Data Science, Southern University of Science and Technology(南方科技大学统计与数据科学系)
Deep Fourier-embedded Network for RGB and Thermal Salient Object Detection
Faculty of Robot Science and Engineering, Northeastern University(机器人科学与工程学院,东北大学);College of Computing and Data Science, Nanyang Technological University(计算与数据科学学院,南洋理工大学)
Wavelet-based Mamba with Fourier Adjustment for Low-light Image Enhancement
School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology(上海理工大学光电信息与计算机工程学院);School of computer science and artificial intelligence, Liaoning Normal University(辽宁师范大学计算机与人工智能学院);College of computer science and technology, Jilin University(吉林大学计算机科学与技术学院);School of Computer, National University of Dense Technology(国防科技大学计算机学院)