The Kolmogorov-Arnold Network (KAN) has recently gained attention as an alternative to traditional multi-layer perceptrons (MLPs), offering improved accuracy and interpretability by employing learnable activation functions on edges. In this paper, we introduce the Kolmogorov-Arnold Auto-Encoder (KAE), which integrates KAN with autoencoders (AEs) to enhance representation learning for retrieval, classification, and denoising tasks. Leveraging the flexible polynomial functions in KAN layers, KAE captures complex data patterns and non-linear relationships. Experiments on benchmark datasets demonstrate that KAE improves latent representation quality, reduces reconstruction errors, and achieves superior performance in downstream tasks such as retrieval, classification, and denoising, compared to standard autoencoders and other KAN variants. These results suggest KAE's potential as a useful tool for representation learning. Our code is available at \url{https://github.com/SciYu/KAE/}.
Institute of Fundamental and Frontier Sciences, University of Electronic Science and Technology of China(电子科技大学基础与前沿科学研究所);Potsdam Institute for Climate Impact Research(波茨坦气候影响研究所);Department of Physics, Humboldt University Berlin(柏林洪堡大学物理系);Research Institute of Intelligent Complex Systems, Fudan University(复旦大学智能复杂系统研究所);School of Physics, University of Electronic Science and Technology of China(电子科技大学物理学院);Key Laboratory of Quantum Physics and Photonic Quantum Information, Ministry of Education, University of Electronic Science and Technology of China(电子科技大学教育部量子物理与光子量子信息重点实验室);Non-classical Information Science Basic Discipline Research Center of Sichuan Province, University of Electronic Science and Technology of China(电子科技大学四川省非经典信息科学基础学科研究中心)
Can KAN CANs? Input-convex Kolmogorov-Arnold Networks (KANs) as hyperelastic constitutive artificial neural networks (CANs)
Department of Materials Science and Engineering, Delft University of Technology(材料科学与工程系,代尔夫特理工大学);Department of Biomechanical Engineering, Delft University of Technology(生物机械工程系,代尔夫特理工大学)
University of Twente(特文特大学);Leiden University(莱顿大学)
There is a longstanding debate whether the Kolmogorov-Arnold representation theorem can explain the use of more than one hidden layer in neural networks. The Kolmogorov-Arnold representation decomposes a multivariate function into an interior and an outer function and therefore has indeed a similar structure as a neural network with two hidden layers. But there are distinctive differences. One of the main obstacles is that the outer function depends on the represented function and can be wildly varying even if the represented function is smooth. We derive modifications of the Kolmogorov-Arnold…
Columbia University(哥伦比亚大学);National University of Singapore(新加坡国立大学)
We prove a theorem concerning the approximation of multivariate functions by deep ReLU networks, for which the curse of the dimensionality is lessened. Our theorem is based on a constructive proof of the Kolmogorov--Arnold superposition theorem, and on a subset of multivariate continuous functions whose outer superposition functions can be efficiently approximated by deep ReLU networks.
Inferring hidden forcing in a biological oscillator using Kolmogorov-Arnold networks
Universidad de Buenos Aires(布宜诺斯艾利斯大学);CONICET - Universidad de Buenos Aires(阿根廷国家科研委员会-布宜诺斯艾利斯大学);Instituto de Física Interdisciplinaria y Aplicada (INFINA)(跨学科与应用物理研究所(INFINA))
Physics Informed Kolmogorov-Arnold Neural Networks for Dynamical Analysis via Efficent-KAN and WAV-KAN
Indian Institute of Technology, Delhi(印度理工学院德里分校);Indian Institute of Technology, Dhanbad(印度理工学院丹巴德分校);Sun Moon University(日月大学);Amrita Vishwa Vidyapeetham(阿米塔大学);United States DEVCOM Army Research Laboratory(美国DEVCOM陆军研究实验室);University of Massachusetts at Boston(马萨诸塞大学波士顿分校);Tulane University(杜兰大学)
Kolmogorov Arnold Informed neural network: A physics-informed deep learning framework for solving forward and inverse problems based on Kolmogorov Arnold Networks
Tsinghua University(清华大学);Bauhaus-Universität Weimar(魏玛包豪斯大学);CNPC Engineering Technology RD Company Limited(中国石油集团工程技术研究院有限公司);Queensland University of Technology(昆士兰科技大学);Leibniz University Hannover(汉诺威莱布尼茨大学)
Kolmogorov-Arnold networks for metal surface defect classification
AGH University of Krakow(克拉科夫AGH大学);Systems Research Institute, Polish Academy of Sciences(波兰科学院系统研究所);University of Technology Sydney(悉尼科技大学);Óbuda University(欧布达大学);NASK National Research Institute(NASK国家研究院)
Finite basis Kolmogorov-Arnold networks: domain decomposition for data-driven and physics-informed problems
Pacific Northwest National Laboratory(太平洋西北国家实验室);University of North Carolina, Charlotte(北卡罗来纳大学夏洛特分校);Delft University of Technology(代尔夫特理工大学);University of Washington, Applied Mathematics(华盛顿大学应用数学系);Brown University, Applied Mathematics(布朗大学应用数学系)
HKAN: Hierarchical Kolmogorov-Arnold Network without Backpropagation
the Faculty of Electrical Engineering, Czestochowa University of Technology(捷斯托霍瓦技术大学电子工程系);the Faculty of Mathematics and Computer Science, University of Lodz(罗兹大学数学与计算机科学系);the Centre for Data Analysis, Modelling and Computational Sciences (CAMINO), University of Lodz(罗兹大学数据分析、建模与计算科学中心)
Chebyshev Polynomial-Based Kolmogorov-Arnold Networks: An Efficient Architecture for Nonlinear Function Approximation
Indian Institute of Science Education and Research Mohali(印度科学教育与研究研究所莫哈利分校);Indian Institute of Science Education and Research Thiruvananthapuram(印度科学教育与研究研究所蒂鲁文南特布勒姆分校)