arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.09321cs.IR
收藏

OpenIIR:信息检索研究的开放模拟平台

OpenIIR: An Open Simulation Platform for Information Retrieval Research

University of Passau(帕绍大学)

Saber Zerhoudi

AI总结:

OpenIIR通过参数化、可重复的LLM驱动人物模拟,提供多代理研究框架,支持四种研究类型,并通过共享核心和模块化扩展推动信息检索研究。

摘要:

OpenIIR运行数百个由LLM驱动的人物作为参数化、可重复的信息检索研究实验。研究人员在多种先验假设、轮次和约束下配置代理,研究四种多代理场景( deliberative panels, social platforms, curated recommender feeds, and evolutionary co-evolution between content producers and credibility detectors)。人物预算、检索策略、排序器选择、干预时间、突变率等参数在实验前声明,同一研究可在不同设置下重新运行以比较结果。每次运行生成结构化输出(论证图、曝光日志、适应轨迹、转录文本),下游评估者可直接消费。新研究是共享核心(代理运行时、世界模型存储、检索原语、声明提取器、人物本体)上的200-400行插件。贡献包括:(i)共享核心;(ii)可插拔场景的类型接口;(iii)四种发布的类型及其参考运行(Panel, Social-Media, Curated-Feed, Multi-Generational);(iv)六个模块化扩展针对开放信息检索研究问题。

英文摘要:

OpenIIR runs hundreds of LLM-driven personas as parameterised, reproducible IR research experiments. Researchers configure agents across four kinds of multi-agent study (deliberative panels, social platforms, curated recommender feeds, and evolutionary co-evolution between content producers and credibility detectors) under many priors, rounds, and constraints. Persona budgets, retrieval policies, ranker choices, intervention timings, and mutation rates are declared up front, and the same study can be re-run under different settings to compare outcomes side by side. Every run produces structured outputs (argument graphs, exposure logs, fitness traces, transcripts) that a downstream evaluator can consume directly, and a new study is a 200--400 line plug-in over a shared core (agent runtime, world-model store, retrieval primitives, claim extractor, persona ontology). The contributions are: (i) the shared core; (ii) a type interface for pluggable scenarios; (iii) four released types with reference runs (Panel, Social-Media, Curated-Feed, Multi-Generational); and (iv) six modular extensions sketched against open IR research questions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑