arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2502.11927cs.LG

持续学习应超越增量分类

Continual Learning Should Move Beyond Incremental Classification

TU Darmstadt(达姆施塔特工业大学);Hessian Center for AI(黑森人工智能中心);Polytechnic University of Turin(都灵理工大学);Italian Institute of Technology(意大利技术研究院);University of Pisa(比萨大学);University of Cambridge(剑桥大学);Bielefeld University(比勒费尔德大学);University of Bremen(不来梅大学);KU Leuven(鲁汶大学);German Research Center for AI(德国人工智能研究中心)
Rupert Mitchell, Antonio Alliegro, Raffaello Camoriano, Dustin Carrión-Ojeda, Antonio Carta, Georgia Chalvatzaki, Nikhil Churamani, Carlo D'Eramo, Samin Hamidi,… 展开作者

Rupert Mitchell, Antonio Alliegro, Raffaello Camoriano, Dustin Carrión-Ojeda, Antonio Carta, Georgia Chalvatzaki, Nikhil Churamani, Carlo D'Eramo, Samin Hamidi, Robin Hesse, Fabian Hinder, Roshni Ramanna Kamath, Vincenzo Lomonaco, Subarnaduti Paul, Francesca Pistilli, Tinne Tuytelaars, Gido M van de Ven, Kristian Kersting, Simone Schaub-Meyer, Martin Mundt

AI总结:

本文立场指出持续学习不应局限于增量分类,并通过多类非分类场景分析三大核心挑战,提出形式化时间动态、连续任务空间及生成式目标等建议。

摘要:

持续学习(CL)是机器学习的一个子领域,关注在动态环境中积累知识。迄今为止,CL研究主要集中于增量分类任务,即模型学习对新类别进行分类,同时保留对先前已学类别的知识。本文认为,维持这种关注会限制CL方法的理论发展和实际适用性。通过对具体示例的详细分析——包括多目标分类、具有受限输出空间的机器人学、连续任务领域中的学习以及更高层次的概念记忆——我们展示了当前CL方法在应用于标准分类之外时往往会失败。我们识别出三个基本挑战:(C1)学习问题中连续性的本质,(C2)选择合适的空间和度量来衡量相似性,以及(C3)分类之外学习目标的作用。针对每个挑战,我们提供了具体建议以推动该领域发展,包括通过分布过程将时间动态形式化、为连续任务空间开发有原则的方法,以及纳入密度估计和生成式目标。通过这些工作,本立场论文旨在拓宽CL研究的范围,同时加强其理论基础,使其更适用于现实世界问题。

英文摘要:

Continual learning (CL) is the sub-field of machine learning concerned with accumulating knowledge in dynamic environments. So far, CL research has mainly focused on incremental classification tasks, where models learn to classify new categories while retaining knowledge of previously learned ones. Here, we argue that maintaining such a focus limits both theoretical development and practical applicability of CL methods. Through a detailed analysis of concrete examples - including multi-target classification, robotics with constrained output spaces, learning in continuous task domains, and higher-level concept memorization - we demonstrate how current CL approaches often fail when applied beyond standard classification. We identify three fundamental challenges: (C1) the nature of continuity in learning problems, (C2) the choice of appropriate spaces and metrics for measuring similarity, and (C3) the role of learning objectives beyond classification. For each challenge, we provide specific recommendations to help move the field forward, including formalizing temporal dynamics through distribution processes, developing principled approaches for continuous task spaces, and incorporating density estimation and generative objectives. In so doing, this position paper aims to broaden the scope of CL research while strengthening its theoretical foundations, making it more applicable to real-world problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑