arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2509.24472cs.LG

FS-KAN:通过函数共享构建置换等变的 Kolmogorov-Arnold 网络

FS-KAN: Permutation Equivariant Kolmogorov-Arnold Networks via Function Sharing

Technion – Israel Institute of Technology(技术离子-以色列理工学院);NVIDIA Research(NVIDIA研究)

Ran Elbaz, Guy Bar-Shalom, Yam Eitan, Fabrizio Frasca, Haggai Maron

AI总结:

本文提出 FS-KAN,通过函数共享构建等变的 Kolmogorov-Arnold 网络,提升数据效率并保持可解释性。

摘要:

置换等变神经网络通过参数共享方案在利用广泛的数据对称性方面展现出了强大的模型能力,显著提升了所得到模型的泛化能力和计算效率。最近,Kolmogorov-Arnold 网络(KANs)因其比基于 MLP 的传统架构更高的可解释性和表达能力而展现出前景。尽管近期文献中已经探索了等变 KANs 在少数特定数据类型上的应用,但缺乏一个系统性的框架将它们应用于具有置换对称性的数据中。本文提出 Function Sharing KAN(FS-KAN),一种系统性的方法,用于构建适用于任意置换对称群的等变和不变的 KA 层,统一并显著扩展了该领域的先前工作。我们通过将参数共享方案推广到 Kolmogorov-Arnold 框架中,推导出这些 FS-KAN 层的基本构造,并提供理论分析,证明 FS-KANs 的表达能力与使用标准参数共享层的网络相同,使我们能够将已知的重要表达性结果从参数共享网络转移到 FS-KANs。在多种数据类型和对称群上的实验证明,FS-KANs 相比标准参数共享层在数据效率上表现更优,在某些情况下差距显著,同时保持了 KANs 的可解释性和适应性,使其在低数据环境下成为优秀的架构选择。

英文摘要:

Permutation equivariant neural networks employing parameter-sharing schemes have emerged as powerful models for leveraging a wide range of data symmetries, significantly enhancing the generalization and computational efficiency of the resulting models. Recently, Kolmogorov-Arnold Networks (KANs) have demonstrated promise through their improved interpretability and expressivity compared to traditional architectures based on MLPs. While equivariant KANs have been explored in recent literature for a few specific data types, a principled framework for applying them to data with permutation symmetries in a general context remains absent. This paper introduces Function Sharing KAN (FS-KAN), a principled approach to constructing equivariant and invariant KA layers for arbitrary permutation symmetry groups, unifying and significantly extending previous work in this domain. We derive the basic construction of these FS-KAN layers by generalizing parameter-sharing schemes to the Kolmogorov-Arnold setup and provide a theoretical analysis demonstrating that FS-KANs have the same expressive power as networks that use standard parameter-sharing layers, allowing us to transfer well-known and important expressivity results from parameter-sharing networks to FS-KANs. Empirical evaluations on multiple data types and symmetry groups show that FS-KANs exhibit superior data efficiency compared to standard parameter-sharing layers, by a wide margin in certain cases, while preserving the interpretability and adaptability of KANs, making them an excellent architecture choice in low-data regimes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑