arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.19352cs.AI
收藏

OMuleT:为可实用的对话式推荐编排多种工具

OMuleT: Orchestrating Multiple Tools for Practicable Conversational Recommendation

University of California, San Diego(加利福尼亚大学圣迭戈分校);Roblox(Roblox公司)

Se-eun Yoon, Xiaokai Wei, Yexi Jiang, Rachit Pareek, Frank Ong, Kevin Gao, Julian McAuley, Michelle Gong

AI总结:

本文提出OMuleT,通过为LLMs配备超过10种工具来构建可实用的对话式推荐系统,并在真实用户数据上验证其能生成更相关、新颖且多样的推荐。

摘要:

在本文中,我们系统地设计、评估并实现了一个现实的对话式推荐系统(CRS)。该系统的目标是允许用户输入自由形式的文本来请求推荐,然后接收一个相关且多样化的物品列表。以往基于合成查询的工作通常只用1到3个工具来增强大语言模型(LLMs),而我们认为,要有效处理真实用户请求,需要一个更广泛的工具箱。因此,我们提出了一种新方法,为LLMs配备超过10种工具,使其能够访问生产环境中使用的内部知识库和API调用。我们在一个由真实用户构成的数据集上评估了我们的模型,并表明与普通LLMs相比,它能够生成相关、新颖且多样化的推荐。此外,我们进行了消融研究,以证明使用工具箱中全部工具的有效性。我们分享了在内部alpha版本部署该系统时的设计和经验教训。我们的贡献在于解决了可实用CRS的全部四个关键方面:(1)真实用户请求,(2)用多种工具增强LLMs,(3)广泛评估,以及(4)部署见解。

英文摘要:

In this paper, we present a systematic effort to design, evaluate, and implement a realistic conversational recommender system (CRS). The objective of our system is to allow users to input free-form text to request recommendations, and then receive a list of relevant and diverse items. While previous work on synthetic queries augments large language models (LLMs) with 1-3 tools, we argue that a more extensive toolbox is necessary to effectively handle real user requests. As such, we propose a novel approach that equips LLMs with over 10 tools, providing them access to the internal knowledge base and API calls used in production. We evaluate our model on a dataset of real users and show that it generates relevant, novel, and diverse recommendations compared to vanilla LLMs. Furthermore, we conduct ablation studies to demonstrate the effectiveness of using the full range of tools in our toolbox. We share our designs and lessons learned from deploying the system for internal alpha release. Our contribution is the addressing of all four key aspects of a practicable CRS: (1) real user requests, (2) augmenting LLMs with a wide variety of tools, (3) extensive evaluation, and (4) deployment insights.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑