arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2405.11318cs.LGcond-mat.dis-nncs.AIstat.ML

平滑Kolmogorov-Arnold网络实现结构知识表示

Smooth Kolmogorov Arnold networks enabling structural knowledge representation

Institute for Computational Biomedicine, RWTH Aachen University(亚琛工业大学计算生物医学研究所)

Moein E. Samadi, Younes Müller, Andreas Schuppert

AI总结:

本文提出平滑且结构化的KAN可在特定函数类中媲美MLP,利用结构知识减少训练数据并降低幻觉预测,提升计算生物医学模型的可靠性。

摘要:

Kolmogorov-Arnold网络(KANs)因其有限的网络拓扑结构,为传统多层感知器(MLP)架构提供了一种高效且可解释的替代方案。然而,根据Kolmogorov和Vitushkin的结果,使用受限于有限数量截止点的解析函数实现的KAN,无法精确表示一般平滑函数。因此,KAN在训练过程中的收敛性可能受到限制。本文探讨了平滑性在KAN中的相关性,提出平滑且具有结构信息的KAN可以在特定函数类别中实现与MLP的等价性。通过利用固有的结构知识,KAN可以减少训练所需的数据,并降低生成幻觉预测的风险,从而增强计算生物医学中模型的可靠性和性能。

英文摘要:

Kolmogorov-Arnold Networks (KANs) offer an efficient and interpretable alternative to traditional multi-layer perceptron (MLP) architectures due to their finite network topology. However, according to the results of Kolmogorov and Vitushkin, the representation of generic smooth functions by KAN implementations using analytic functions constrained to a finite number of cutoff points cannot be exact. Hence, the convergence of KAN throughout the training process may be limited. This paper explores the relevance of smoothness in KANs, proposing that smooth, structurally informed KANs can achieve equivalence to MLPs in specific function classes. By leveraging inherent structural knowledge, KANs may reduce the data required for training and mitigate the risk of generating hallucinated predictions, thereby enhancing model reliability and performance in computational biomedicine.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑