发表机构
Institute of Advanced Intelligence and Computing (IAIC), Agency for Science, Technology and Research (A*STAR)(科技研究局(A*STAR)高级智能与计算研究所(IAIC))
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
AiSearch是一个利用视觉语言模型零样本能力进行图像和视频自然语言搜索的交互式多模态检索框架,支持用户反馈优化和跨模型基准测试。
AI 中文摘要
现代检索系统必须既自动化又具交互性,允许用户实时搜索并优化结果。我们提出AiSearch,一个灵活的多模态检索框架,利用视觉语言模型(VLMs)的零样本能力对图像和视频进行自然语言搜索。AiSearch支持通过用户反馈进行交互式搜索优化,以根据用户意图定制结果,并允许在多个VLM之间进行视觉基准测试,使用户能为任务选择最合适的模型。
英文摘要
Modern retrieval systems must both be automated and interactive, allowing users to search and refine results in real time. We present AiSearch, a flexible multimodal retrieval framework that leverages the zero shot capabilities of Vision Language Models (VLMs) for natural language search over images and videos. AiSearch supports interactive search refinement through user feedback to tailor results to the user's intent, and allows visual benchmarking across multiple VLMs, enabling users to select the most suitable model for their task.
CommentsThe demo paper with 1 page main paper, 7 pages supplementary material accepted and presented in ECCV 2026