Learning to Route Queries to Heads for Attention-based Re-ranking with Large Language Models
基于大语言模型的注意力重排序中查询依赖的头部选择学习
机构 * McGill University \& MILA Montreal Canada ; McGill University \& MILA
AI总结 本文提出RouteHead方法,通过学习轻量级路由器选择最优头部集合以提升注意力重排序性能,实验表明优于现有基线。
Comments Accepted by SIGIR 2026