arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.04402cs.IRcs.CL
收藏

SearchGym: 一个用于跨平台基准测试和混合搜索编排的模块化基础设施

SearchGym: A Modular Infrastructure for Cross-Platform Benchmarking and Hybrid Search Orchestration

Cornell University(康奈尔大学)

Jerome Tze-Hou Hsu

AI总结:

SearchGym通过模块化设计实现跨平台基准测试和混合搜索编排,揭示信息检索中通用性与可优化性的张力。

摘要:

检索增强生成(RAG)的快速增长导致了工具包的繁荣,但实验原型与稳健、生产就绪系统之间仍存在根本性差距。我们提出了SearchGym,一个用于跨平台基准测试和混合搜索编排的模块化基础设施。与现有以模型为中心的框架不同,SearchGym将数据表示、嵌入策略和检索逻辑解耦为具有状态的抽象:Dataset、VectorSet和App。这种分离使得可以使用组合配置代数,允许设计者从分层配置中合成整个系统,同时确保完美可重现性。此外,我们分析了混合检索管道中的

英文摘要:

The rapid growth of Retrieval-Augmented Generation (RAG) has created a proliferation of toolkits, yet a fundamental gap remains between experimental prototypes and robust, production-ready systems. We present SearchGym, a modular infrastructure designed for cross-platform benchmarking and hybrid search orchestration. Unlike existing model-centric frameworks, SearchGym decouples data representation, embedding strategies, and retrieval logic into stateful abstractions: Dataset, VectorSet, and App. This separation enables a Compositional Config Algebra, allowing designers to synthesize entire systems from hierarchical configurations while ensuring perfect reproducibility. Moreover, we analyze the "Top-$k$ Cognizance" in hybrid retrieval pipelines, demonstrating that the optimal sequence of semantic ranking and structured filtering is highly dependent on filter strength. Evaluated on the LitSearch expert-annotated benchmark, SearchGym achieves a 70% Top-100 retrieval rate. SearchGym reveals a design tension between generalizability and optimizability, presenting the potential where engineering optimization may serve as a tool for uncovering the causal mechanisms inherent in information retrieval across heterogeneous domains. An open-source implementation of SearchGym is available at: https://github.com/JeromeTH/search-gym

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑