GATES: Self-Distillation under Privileged Context with Consensus Gating
GATES: 在特权上下文中通过共识门进行自我蒸馏
机构 * University of Maryland, College Park(马里兰大学 College Park 分校)
AI总结 GATES通过在特权上下文中利用共识门进行自我蒸馏,提升无文档学生在问题回答任务中的性能。
Comments 10 Pages of main text with an additional 7 pages of supplementary material