arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2410.02077cs.LGcs.AIcs.CV

Kolmogorov-Arnold 网络自编码器

Kolmogorov-Arnold Network Autoencoders

Arizona State University(亚利桑那州立大学);Clarkson University(克拉克森大学)

Mohammadamin Moradi, Shirin Panahi, Erik Bollt, Ying-Cheng Lai

AI总结:

本文研究用Kolmogorov-Arnold网络构建自编码器,并在MNIST、SVHN和CIFAR-10上与CNN比较,证明其在重建精度上具有竞争力,可作为有效的数据表示与分析工具。

摘要:

深度学习模型已经彻底改变了众多领域,其中多层感知机(MLPs)是数据回归和图像分类等任务的基础。然而,最近一项研究引入了Kolmogorov-Arnold网络(KANs),将其作为MLPs的有前景的替代方案,利用放置在边而非节点上的激活函数。这种结构上的转变使KANs与Kolmogorov-Arnold表示定理紧密对齐,可能同时提升模型准确性和可解释性。在本研究中,我们探索了KANs在通过自编码器进行数据表示方面的有效性,并在MNIST、SVHN和CIFAR-10数据集上将其性能与传统卷积神经网络(CNNs)进行比较。我们的结果表明,基于KAN的自编码器在重建精度方面取得了具有竞争力的表现,从而表明它们作为数据分析任务中有效工具的可行性。

英文摘要:

Deep learning models have revolutionized various domains, with Multi-Layer Perceptrons (MLPs) being a cornerstone for tasks like data regression and image classification. However, a recent study has introduced Kolmogorov-Arnold Networks (KANs) as promising alternatives to MLPs, leveraging activation functions placed on edges rather than nodes. This structural shift aligns KANs closely with the Kolmogorov-Arnold representation theorem, potentially enhancing both model accuracy and interpretability. In this study, we explore the efficacy of KANs in the context of data representation via autoencoders, comparing their performance with traditional Convolutional Neural Networks (CNNs) on the MNIST, SVHN, and CIFAR-10 datasets. Our results demonstrate that KAN-based autoencoders achieve competitive performance in terms of reconstruction accuracy, thereby suggesting their viability as effective tools in data analysis tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑