晚期交互动力学工作笔记：分析晚期交互模型的目标行为
Working Notes on Late Interaction Dynamics: Analyzing Targeted Behaviors of Late Interaction Models
AI总结：
本文研究了晚期交互检索中长度偏差和最大相似性操作符外的相似性分布，揭示了因果模型和双向模型的实际性能瓶颈。
摘要：
尽管晚期交互模型在检索性能上表现强劲，但其底层动力学仍存在研究空白，可能隐藏性能瓶颈。本文聚焦晚期交互检索中的两个问题：使用多向量评分时出现的长度偏差，以及最大相似性操作符（MaxSim）所聚合的最高分数之外的相似性分布。我们分析了当前最先进的模型在NanoBEIR基准上的行为。结果表明，尽管因果晚期交互模型的理论长度偏差在实践中成立，双向模型在极端情况下也会受到其影响。我们还注意到，没有显著的相似性趋势出现在前1文档token之外，验证了MaxSim操作符高效利用token级相似性分数。
英文摘要：
While Late Interaction models exhibit strong retrieval performance, many of their underlying dynamics remain understudied, potentially hiding performance bottlenecks. In this work, we focus on two topics in Late Interaction retrieval: a length bias that arises when using multi-vector scoring, and the similarity distribution beyond the best scores pooled by the MaxSim operator. We analyze these behaviors for state-of-the-art models on the NanoBEIR benchmark. Results show that while the theoretical length bias of causal Late Interaction models holds in practice, bi-directional models can also suffer from it in extreme cases. We also note that no significant similarity trend lies beyond the top-1 document token, validating that the MaxSim operator efficiently exploits the token-level similarity scores.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
