MAGIC：基于最优传输的边缘引导压缩用于高效视觉文档检索
MAGIC: Marginal-Guided Compression with Optimal Transport for Efficient Visual Document Retrieval
- The Hong Kong Polytechnic University（香港理工大学）
- Southern University of Science and Technology（南方科技大学）
机构由 AI 辅助整理，请以论文原文为准。
AI总结：
针对视觉文档检索中多向量嵌入存储和评分开销大的问题，提出基于最优传输的边缘引导压缩方法MAGIC，无需训练即可高效压缩，在ViDoRe基准上优于现有事后压缩器。
AI中文摘要：
最近的视觉文档检索（VDR）系统（如ColPali）使用多向量页面嵌入，其中补丁级向量能够实现细粒度的证据匹配，但会带来大量的索引存储和MaxSim评分开销。事后合并提供了一种实用的高效VDR途径，通过在不重新训练检索器的情况下降低这一成本，但其统一的重建目标与晚期交互检索所引发的稀疏、非均匀的补丁使用模式对齐不佳。在激进压缩下，这种错位可能会保留很少使用的补丁，同时将检索活动集中在过少的保留代表上。为了解决这种错位问题，我们提出了基于最优传输的边缘引导压缩（MAGIC），一种无需训练的、用于冻结多向量嵌入的高效检索的事后压缩器。MAGIC推导出一个MaxSim诱导的压缩替代目标，并通过双边缘熵最优传输公式对其进行优化，其中检索需求源边缘优先考虑高使用率的补丁，而平衡的目标边缘则规范保留方面的使用。在ViDoRe基准、保留比率和检索骨干网络上，MAGIC始终优于强有力的事后压缩器，在激进压缩场景中尤其取得了显著提升；组件消融实验验证了其两个边缘的互补效果。我们在以下网址发布了代码：此https URL。
英文摘要：
Recent visual document retrieval (VDR) systems such as ColPali use multi-vector page embeddings, in which patch-level vectors enable fine-grained evidence matching but incur substantial index storage and MaxSim scoring overhead. Post-hoc merging offers a practical route to efficient VDR by reducing this cost without retraining the retriever, but its uniform reconstruction objectives are poorly aligned with the sparse, non-uniform patch usage induced by late-interaction retrieval. Under aggressive compression, this misalignment can preserve rarely used patches while concentrating retrieval activity on too few retained representatives. To address this misalignment, we propose Marginal-Guided Compression with Optimal Transport (MAGIC), a training-free post-hoc compressor for efficient retrieval with frozen multi-vector embeddings. MAGIC derives a MaxSim-induced compression surrogate and optimizes it through a two-marginal entropic optimal-transport formulation, where a retrieval-demand source marginal prioritizes high-use patches and a balanced target marginal regularizes retained-facet usage. Across ViDoRe benchmarks, keep ratios, and retrieval backbones, MAGIC consistently outperforms strong post-hoc compressors, with particularly large gains in the aggressive-compression regime; component ablations verify the complementary effects of its two marginals. We release the code at: https://github.com/xandery-geek/MAGIC.
