School of Information Science and Engineering, Southeast University(东南大学信息科学与工程学院);School of Economics and Management, Southeast University(东南大学经济管理学院)
In this paper, we compare the performance of Kolmogorov-Arnold Networks (KAN) and Multi-Layer Perceptron (MLP) networks on irregular or noisy functions. We control the number of parameters and the size of the training samples to ensure a fair comparison. For clarity, we categorize the functions into six types: regular functions, continuous functions with local non-differentiable points, functions with jump discontinuities, functions with singularities, functions with coherent oscillations, and noisy functions. Our experimental results indicate that KAN does not always perform best. For some types of functions, MLP outperforms or performs comparably to KAN. Furthermore, increasing the size of training samples can improve performance to some extent. When noise is added to functions, the irregular features are often obscured by the noise, making it challenging for both MLP and KAN to extract these features effectively. We hope these experiments provide valuable insights for future neural network research and encourage further investigations to overcome these challenges.
School of Advanced Interdisciplinary Sciences, UCAS(中国科学院大学前沿交叉科学学院);Academy of Mathematics and Systems Science, CAS(中国科学院数学与系统科学研究院);University of Chinese Academy of Sciences(中国科学院大学);Institute of Software, CAS(中国科学院软件研究所)
Is the Statistical Advantage Worth the Cost? An Empirical Comparison of KANs and MLPs for Structured Data Classification
Institute of Computer Science, University of the Philippines Los Baños(菲律宾大学洛斯巴尼奥斯分校计算机科学研究所);Machine Learning and Artificial Intelligence Applications Lab, University of the Philippines Los Baños(菲律宾大学洛斯巴尼奥斯分校机器学习与人工智能应用实验室)
MLPs and KANs for data-driven learning in physical problems: A performance comparison
The Oden Institute for Computational Engineering and Sciences(奥登计算工程与科学学院);Texas Advanced Computing Center (TACC)(德克萨斯高级计算中心);Department of Civil, Architecture and Environmental Engineering(土木、建筑与环境工程系);The University of Texas at Austin(德克萨斯大学奥斯汀分校)
Kolmogorov Arnold networks (KAN) for aerodynamic prediction: a comparison with MLPs and GNNs
ETSIAE-UPM-School of Aeronautics, Universidad Politécnica de Madrid(马德里理工大学航空学院);Center for Computational Simulation, Universidad Politécnica de Madrid(马德里理工大学计算模拟中心);Institute for Cross-Disciplinary Physics and Complex Systems (IFISC, CSIC-UIB)(跨学科物理与复杂系统研究所(IFISC,CSIC-UIB))
A Practitioner's Guide to Kolmogorov-Arnold Networks
Department of Mathematics, Hong Kong Baptist University(香港 Baptist大学数学系);Institution for Foundations of Data Science, Yale University(数据科学基础研究所,耶鲁大学);Robotics and Technology of Computers Lab., Universidad de Sevilla(机器人与计算机技术实验室,塞维利亚大学)
Multilevel Training for Kolmogorov Arnold Networks
Theoretical Division, Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室理论 division);Center for Computing Research, Sandia National Laboratories(桑迪亚国家实验室计算研究中心)
KANQAS: Kolmogorov-Arnold Network for Quantum Architecture Search
University of Helsinki(赫尔辛基大学);Polish Academy of Sciences(波兰科学院);Silesian University of Technology(西里西亚工业大学);Advanced Research Centre(高级研究中心);Delft University of Technology(代尔夫特理工大学);Raman Research Institute(拉曼研究所);International Institute of Information Technology, Hyderabad(海得拉巴国际信息技术学院)
Exploring the Limitations of Kolmogorov-Arnold Networks in Classification: Insights to Software Training and Hardware Implementation
Nara Institute of Science and Technology(奈良科学技术研究所);University of Information Technology - VNUHCM(胡志明市国家大学信息学院);Le Quy Don technical University(黎贵敦工业大学)
Enhancing Burmese News Classification with Kolmogorov-Arnold Network Head Fine-tuning
Language Understanding Laboratory, Myanmar(缅甸语言理解实验室);Department of Computer Engineering, KMITL, Bangkok, Thailand(泰国曼谷KMITL计算机工程系);Language and Semantic Technology Research Team, NECTEC, Bangkok, Thailand(泰国曼谷NECTEC语言与语义技术研究团队)
Hybrid Parallel Bessel KAN Model: a Kolmogorov Arnold Network: integrated framework for developing a novel architecture to reconstruct the fused-basis approach via a parameter free quadratic interaction
Tezpur University(提斯普尔大学);Pandit Deendayal Energy University(潘迪特·迪恩戴亚尔能源大学)
Kolmogorov-Arnold Networks for Personal Context Recognition on ExtraSensory
University of Information Technology, Ho Chi Minh City, Vietnam(胡志明市信息技术大学);Vietnam National University Ho Chi Minh City, Ho Chi Minh City, Vietnam(越南国立大学胡志明市分校)