arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.21729cs.IRcs.AI
收藏

CustomIR:面向已知文档语料的稠密嵌入无监督微调

CustomIR: Unsupervised Fine-Tuning of Dense Embeddings for Known Document Corpora

Valkyrie Andromeda(瓦尔基里安德墨达)

Nathan Paull

AI总结:

针对稠密嵌入模型在专业语料上性能下降的问题,提出CustomIR框架,借助LLM生成合成查询-文档对与难负例实现无监督领域适配,实验显示小模型Recall@10最高提升2.3点,可媲美大模型,提供了可扩展的低成本领域性能提升方案。

摘要:

稠密嵌入模型已成为现代信息检索(尤其是RAG流水线)的核心组件,但当应用于预训练分布之外的专业语料时,其性能往往会下降。为解决这一问题,我们提出CustomIR——一种利用合成生成的查询-文档对,将预训练语言嵌入模型无监督适配到特定领域语料的框架。CustomIR借助大语言模型(LLM)生成基于已知目标语料的多样化查询,并搭配经LLM验证的难负例,无需昂贵的人工标注。在企业电子邮件和消息数据集上的实验表明,CustomIR持续提升检索效果,小模型的Recall@10最高提升2.3个点。这一性能提升使这些小模型可与大得多的替代模型性能相媲美,从而实现更经济的RAG部署。这些结果凸显出,针对性的合成微调是提升特定领域性能的一种可扩展且高性价比的策略。

英文摘要:

Dense embedding models have become critical for modern information retrieval, particularly in RAG pipelines, but their performance often degrades when applied to specialized corpora outside their pre-training distribution. To address thi we introduce CustomIR, a framework for unsupervised adaptation of pre-trained language embedding models to domain-specific corpora using synthetically generated query-document pairs. CustomIR leverages large language models (LLMs) to create diverse queries grounded in a known target corpus, paired with LLM-verified hard negatives, eliminating the need for costly human annotation. Experiments on enterprise email and messaging datasets show that CustomIR consistently improves retrieval effectiveness with small models gaining up to 2.3 points in Recall@10. This performance increase allows these small models to rival the performance of much larger alternatives, allowing for cheaper RAG deployments. These results highlight that targeted synthetic fine-tuning offers a scalable and cost-efficient strategy for increasing domain-specific performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑