Recent advancements in visualizing deep neural networks provide insights into their structures and mesh extraction from Continuous Piecewise Affine (CPWA) functions. Meanwhile, developments in neural surface representation learning incorporate non-linear positional encoding, addressing issues like spectral bias; however, this poses challenges in applying mesh extraction techniques based on CPWA functions. Focusing on trilinear interpolating methods as positional encoding, we present theoretical insights and an analytical mesh extraction, showing the transformation of hypersurfaces to flat planes within the trilinear region under the eikonal constraint. Moreover, we introduce a method for approximating intersecting points among three hypersurfaces contributing to broader applications. We empirically validate correctness and parsimony through chamfer distance and efficiency, and angular distance, while examining the correlation between the eikonal loss and the planarity of the hypersurfaces.
Polyhedral Geometry of Time-to-First-Spike Neural Networks
Ludwig-Maximilians-Universität München(慕尼黑大学);Munich Center for Machine Learning(慕尼黑机器学习中心);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Max Planck Institute for Mathematics in the Sciences, Leipzig(马克斯·普朗克数学科学研究所);University of Tromsø(特罗姆瑟大学)
AffineLens: Capturing the Continuous Piecewise Affine Functions of Neural Networks
State Key Laboratory of Novel Software Technology School of Intelligence Science and Technology Nanjing University, Jiangsu, China(软件新技术国家重点实验室 智能科学与技术学院 南京大学 江苏 中国);AI for Good Istituto Italiano di Tecnologia, Genoa, Italy DITEN University of Genoa, Genoa, Italy(AI for Good 意大利技术研究院,热那亚,意大利 DITEN 热那亚大学,热那亚,意大利);State Key Laboratory of Novel Software Technology School of Artificial Intelligence Nanjing University, Jiangsu, China(软件新技术国家重点实验室 人工智能学院 南京大学 江苏 中国);AI for Good Istituto Italiano di Tecnologia, Genoa, Italy Department of Computer Science University of Verona, Verona, Italy(AI for Good 意大利技术研究院,热那亚,意大利 计算机科学系 热那亚大学,热那亚,意大利)
Time to Spike? Understanding the Representational Power of Spiking Neural Networks in Discrete Time
Department of Mathematics, Ludwig-Maximilians-Universität München, Germany(慕尼黑大学数学系);Munich Center for Machine Learning (MCML), Munich, Germany(慕尼黑机器学习中心);Institute of Robotics and Mechatronics, DLR-German Aerospace Center, Germany(德国航空航天中心机器人与机电研究所);Department of Physics and Technology, University of Tromsø, Tromsø, Norway(特罗姆瑟大学物理与技术系)
Towards Lower Bounds on the Depth of ReLU Neural Networks
London School of Economics and Political Science(伦敦政治经济学院);Johns Hopkins University(约翰斯·霍普金斯大学);Università degli Studi di Padova(帕多瓦大学);Technische Universität Berlin(柏林工业大学)
Depth-Bounds for Neural Networks via the Braid Arrangement
Max Planck Institute for Mathematics in the Sciences(马克斯·普朗克数学研究所);University of Technology Nuremberg(纽伦堡技术大学);Freie Universität Berlin(柏林自由大学);University of Twente(埃因霍温理工大学)