arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2605.12306cs.LGcs.AIcs.CV

KAN-CL:基于Kolmogorov-Arnold网络的每结点重要性正则化用于持续学习

KAN-CL: Per-Knot Importance Regularization for Continual Learning with Kolmogorov-Arnold Networks

Sejong University Department of Computer Science and Engineering(世宗大学计算机科学与工程系)

Minjong Cheon

AI总结:

KAN-CL利用Kolmogorov-Arnold网络的紧凑支持样条参数化,在每结点粒度上进行重要性加权锚定,有效减少持续学习中的灾难性遗忘,同时保持高准确率。

摘要:

灾难性遗忘仍然是持续学习(CL)的核心障碍:跨任务共享的参数相互干扰,现有正则化方法如EWC和SI应用统一惩罚而无法识别参数所服务的输入区域。我们提出KAN-CL,一种持续学习框架,利用Kolmogorov-Arnold网络(KANs)的紧凑支持样条参数化,在每结点粒度上进行重要性加权锚定。部署为卷积主干上的分类头,并在主干上应用标准EWC正则化(bbEWC),KAN-CL在Split-CIFAR-10/5T和Split-CIFAR-100/10T基准上分别比仅头部KAN基线减少88%和93%的遗忘,同时在两者上匹配或超过所有基线的准确率。我们进一步提供神经切线核(NTK)分析,显示KAN的样条局部性在跨任务NTK中诱导结构秩缺陷,产生即使在特征学习阶段也成立的遗忘界。这些结果表明,结合具有自然参数局部性的架构(KAN头部)与互补主干正则化器(bbEWC)可产生一种组合且原理化的灾难性遗忘解决方案。

英文摘要:

Catastrophic forgetting remains the central obstacle in continual learning (CL): parameters shared across tasks interfere with one another, and existing regularization methods such as EWC and SI apply uniform penalties without awareness of which input region a parameter serves. We propose KAN-CL, a continual learning framework that exploits the compact-support spline parameterization of Kolmogorov-Arnold Networks (KANs) to perform importance-weighted anchoring at per-knot granularity. Deployed as a classification head on a convolutional backbone with standard EWC regularization on the backbone (bbEWC) KAN-CL achieves forgetting reductions of 88% and 93% over a head-only KAN baseline on Split-CIFAR-10/5T and Split-CIFAR-100/10T respectively, while matching or exceeding the accuracy of all baselines on both benchmarks. We further provide a Neural Tangent Kernel (NTK) analysis showing that KAN's spline locality induces a structural rank deficit in the cross-task NTK, yielding a forgetting bound that holds even in the feature-learning regime. These results establish that combining an architecture with natural parameter locality (KAN head) with a complementary backbone regularizer (bbEWC) yields a compositional and principled approach to catastrophic forgetting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑