AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation
机构 * Key Laboratory of Big Data & Artificial Intelligence in Transportation, (Beijing Jiaotong University), Ministry of Education(大数据与人工智能交通运输联合实验室,(北京交通大学)教育部) ; School of Computer Science and Technology, Beijing Jiaotong University, Beijing, China(计算机科学与技术学院,北京交通大学,北京,中国) ; Tencent Inc, China(腾讯公司,中国)
专题命中 偏好对齐 :alignment(title,abstract);RLHF(abstract);DPO(abstract);分类 cs.CL、cs.AI、cs.LG
Comments ACL 2025 Main Conference, code available at: https://github.com/songmzhang/AlignDistil