PowerMLP：KAN的一个高效版本
PowerMLP: An Efficient Version of KAN
AI总结：
针对KAN训练缓慢的问题，提出新型MLP型神经网络PowerMLP，采用非迭代样条函数表示，在理论上具有更强表达能力，训练速度比KAN快约40倍且精度更高。
摘要：
Kolmogorov-Arnold Network（KAN）是一种新型网络架构，以在函数拟合和PDE求解等多项任务中的高精度而闻名。KAN卓越的表达能力源于Kolmogorov-Arnold表示定理和可学习的样条函数。然而，样条函数的计算涉及多次迭代，这使得KAN明显慢于MLP，从而增加了模型训练和部署的成本。KAN的作者也指出：“KAN的最大瓶颈在于其训练缓慢。在参数数量相同的情况下，KAN通常比MLP慢10倍。”为了解决这个问题，我们提出了一种新型MLP型神经网络PowerMLP，它采用更简单的非迭代样条函数表示，提供了与MLP近似的训练时间，同时在理论上展现出比KAN更强的表达能力。此外，我们比较了KAN和PowerMLP的FLOPs，量化了PowerMLP更快的计算速度。我们的综合实验表明，在各种任务中，PowerMLP通常能获得更高的精度，并且训练速度比KAN快约40倍。
英文摘要：
The Kolmogorov-Arnold Network (KAN) is a new network architecture known for its high accuracy in several tasks such as function fitting and PDE solving. The superior expressive capability of KAN arises from the Kolmogorov-Arnold representation theorem and learnable spline functions. However, the computation of spline functions involves multiple iterations, which renders KAN significantly slower than MLP, thereby increasing the cost associated with model training and deployment. The authors of KAN have also noted that ``the biggest bottleneck of KANs lies in its slow training. KANs are usually 10x slower than MLPs, given the same number of parameters.'' To address this issue, we propose a novel MLP-type neural network PowerMLP that employs simpler non-iterative spline function representation, offering approximately the same training time as MLP while theoretically demonstrating stronger expressive power than KAN. Furthermore, we compare the FLOPs of KAN and PowerMLP, quantifying the faster computation speed of PowerMLP. Our comprehensive experiments demonstrate that PowerMLP generally achieves higher accuracy and a training speed about 40 times faster than KAN in various tasks.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
