Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training
机构 * Mila – Quebec AI Institute(魁北克人工智能研究所) ; Concordia University(康科迪亚大学) ; Université de Montréal(蒙特利尔大学)
专题命中 评测与基准 :language model(abstract);分类 cs.LG
Comments Accepted (oral) at Fourth Conference on Lifelong Learning Agents - CoLLAs 2025