arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

AutoConcept:无需训练的概念引导重排序,用于元数据可用的组合图像检索

AutoConcept: Training-Free Concept-Guided Reranking for Metadata-Available Composed Image Retrieval

Tianyu Wang, Tianjiao Wu

arXiv 2609.01456首次发表:更新:

发表机构

School of Computer Science and Technology, Soochow University; INSTITUT NATIONAL DES SCIENCES APPLIQUEES DE LYON(苏州大学计算机科学与技术学院; 里昂国立应用科学学院)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

本文提出无需训练的AutoConcept重排序器,用于元数据可用的组合图像检索,通过过滤噪声概念、激活正约束等方式提升检索效果,在FashionIQ等数据集上取得显著增益,验证了概念级重排序的有效性。

AI 中文摘要

组合图像检索(CIR)从参考图像和文本修改中检索目标图像。本文研究元数据可用的CIR重排序:先由固定CIR模型返回候选池,再利用图库元数据进行第二阶段的概念引导评分。我们提出AutoConcept,这是一种无需训练的重排序器,可将概念证据转换为可解释的内存。AutoConcept过滤噪声概念,通过辅助负惩罚激活查询相关的正约束,并通过推理时校准将基础检索分数与基于元数据的概念-候选对齐相结合。在FashionIQ数据集上,AutoConcept相比WeiMoCIR在早期排名上取得显著提升,在LinCIR候选池上实现一致的插件增益。元数据感知控制实验表明,结构化概念内存能提供超出直接查询文本和提取属性匹配的信号,仅查询的变体进一步验证了概念级重排序的有效性。补充的真实人类概念标签研究显示,该内存接口可使用参与者提供的证据。这些结果表明AutoConcept是适用于具有可用元数据的产品风格CIR图库的可解释概念内存重排序器。

英文摘要

Composed image retrieval (CIR) retrieves a target image from a reference image and a text modification. This paper studies metadata-available CIR reranking, where a fixed CIR model first returns a candidate pool and gallery metadata is then used for second-stage concept-guided scoring. We introduce AutoConcept, a training-free reranker that converts concept evidence into an interpretable memory. AutoConcept filters noisy concepts, activates query-relevant positive constraints with an auxiliary negative penalty, and combines base retrieval scores with metadata-based concept-candidate alignment through inference-time calibration. On FashionIQ, AutoConcept yields significant early-rank improvements over WeiMoCIR and consistent plug-in gains on LinCIR candidate pools. Metadata-aware controls show that structured concept memory adds signal beyond direct query-text and extracted-attribute matching, while a query-only variant further supports the effectiveness of concept-level reranking. A supplementary real-human concept-label study indicates that the same memory interface can consume participant-provided evidence. These results position AutoConcept as an interpretable concept-memory reranker for product-style CIR galleries with available metadata.

CommentsAccepted regular paper at PRICAI 2026. 16 pages, 4 figures

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑