arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2310.13001cs.IRcs.AIcs.CEcs.CLcs.LG

对话式因子信息检索模型(ConFIRM)

Conversational Factor Information Retrieval Model (ConFIRM)

IRAI Labs(IRAI实验室);LORA Research(LORA研究中心)

Stephen Choi, William Gazeley, Siu Ho Wong, Tingting Li

AI总结:

针对专业领域检索数据稀缺问题,提出基于人格五因素模型生成合成数据的ConFIRM方法,金融领域实验显示微调后的Llama-2-7b模型分类准确率达91%,可提升检索系统准确性与个性化程度。

摘要:

本文提出了对话式因子信息检索方法(ConFIRM),这是一种针对领域特定检索任务微调大语言模型(LLM)的新方法。ConFIRM利用人格五因素模型生成能准确反映目标人群特征的合成数据集,解决了专业领域的数据稀缺问题。我们通过金融领域的案例研究验证了ConFIRM的有效性:使用来自PolyU-Asklora金融科技采纳指数的人格对齐数据微调Llama-2-7b模型。所得模型在金融查询分类任务中达到91%的准确率,在NVIDIA A100 GPU上的平均推理时间为0.61秒。ConFIRM有望在各领域打造更准确、更个性化的AI驱动信息检索系统,有望缓解已部署大语言模型的幻觉和信息过时问题。

英文摘要:

This paper introduces the Conversational Factor Information Retrieval Method (ConFIRM), a novel approach to fine-tuning large language models (LLMs) for domain-specific retrieval tasks. ConFIRM leverages the Five-Factor Model of personality to generate synthetic datasets that accurately reflect target population characteristics, addressing data scarcity in specialized domains. We demonstrate ConFIRM's effectiveness through a case study in the finance sector, fine-tuning a Llama-2-7b model using personality-aligned data from the PolyU-Asklora Fintech Adoption Index. The resulting model achieved 91% accuracy in classifying financial queries, with an average inference time of 0.61 seconds on an NVIDIA A100 GPU. ConFIRM shows promise for creating more accurate and personalized AI-driven information retrieval systems across various domains, potentially mitigating issues of hallucinations and outdated information in LLMs deployed

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑