arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.04576cs.CL
收藏

从数据集成中获得的用于增强语言模型的经验

Learnings from Data Integration for Augmented Language Models

Meta AI

Alon Halevy, Jane Dwivedi-Yu

AI总结:

本文指出大型语言模型在访问外部数据时与数据集成系统有共同愿景,并表明数据集成研究的经验能为当前增强语言模型的研究路径提供启示。

摘要:

大型语言模型的一个局限是它们无法访问最新的、专有的或个人的数据。因此,目前有诸多努力通过访问外部数据的技术来扩展语言模型。从这个意义上说,LLM与数据集成系统共享着同样的愿景,后者的目标是提供对大量异构数据源的无缝访问。尽管LLM的细节和技术与数据集成大不相同,但本文表明,从数据集成研究中获得的一些经验可以阐明我们今天在语言模型上进行的研究路径。

英文摘要:

One of the limitations of large language models is that they do not have access to up-to-date, proprietary or personal data. As a result, there are multiple efforts to extend language models with techniques for accessing external data. In that sense, LLMs share the vision of data integration systems whose goal is to provide seamless access to a large collection of heterogeneous data sources. While the details and the techniques of LLMs differ greatly from those of data integration, this paper shows that some of the lessons learned from research on data integration can elucidate the research path we are conducting today on language models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑