arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2501.00420cs.LG

KAE:用于表示学习的Kolmogorov-Arnold自编码器

KAE: Kolmogorov-Arnold Auto-Encoder for Representation Learning

The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shenzhen Research Institute of Big Data(深圳大数据研究院)

Fangchen Yu, Ruilizhen Hu, Yidong Lin, Yuqi Ma, Zhenghao Huang, Wenye Li

AI总结:

本文提出KAE,将KAN与自编码器结合,利用可学习多项式激活函数提升表示学习质量,在检索、分类和去噪任务上优于标准自编码器及其他KAN变体。

摘要:

Kolmogorov-Arnold网络(KAN)作为传统多层感知器(MLP)的替代方案,通过在边上采用可学习的激活函数,提供了更高的准确性和可解释性,因而近年来受到关注。本文提出Kolmogorov-Arnold自编码器(KAE),将KAN与自编码器(AE)相结合,以增强面向检索、分类和去噪任务的表示学习。借助KAN层中灵活的多项式函数,KAE能够捕捉复杂的数据模式和非线性关系。在基准数据集上的实验表明,与标准自编码器及其他KAN变体相比,KAE提高了潜在表示质量,降低了重构误差,并在检索、分类和去噪等下游任务中取得了更优性能。这些结果表明KAE有潜力成为表示学习的有用工具。代码见https://github.com/SciYu/KAE/。

英文摘要:

The Kolmogorov-Arnold Network (KAN) has recently gained attention as an alternative to traditional multi-layer perceptrons (MLPs), offering improved accuracy and interpretability by employing learnable activation functions on edges. In this paper, we introduce the Kolmogorov-Arnold Auto-Encoder (KAE), which integrates KAN with autoencoders (AEs) to enhance representation learning for retrieval, classification, and denoising tasks. Leveraging the flexible polynomial functions in KAN layers, KAE captures complex data patterns and non-linear relationships. Experiments on benchmark datasets demonstrate that KAE improves latent representation quality, reduces reconstruction errors, and achieves superior performance in downstream tasks such as retrieval, classification, and denoising, compared to standard autoencoders and other KAN variants. These results suggest KAE's potential as a useful tool for representation learning. Our code is available at \url{https://github.com/SciYu/KAE/}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑