CAESURA:语言模型作为多模态查询规划器
CAESURA: Language Models as Multi-Modal Query Planners
AI总结:
本文提出语言模型驱动的查询规划范式,并实现基于 GPT-4 的原型 CEASURA,将自然语言查询转换为可处理图像、文本、视频等多模态数据的可执行查询计划,突破了传统 SQL 查询规划器仅支持关系数据的局限。
摘要:
传统查询规划器将 SQL 查询翻译为可在关系数据上执行的查询计划。然而,使用这些查询规划器无法查询存储在现代数据系统(如数据湖)中的其他数据模态,例如图像、文本或视频。在本文中,我们提出了语言模型驱动的查询规划,这是一种新的查询规划范式,利用语言模型将自然语言查询翻译为可执行的查询计划。与关系查询规划器不同,生成的查询计划可以包含能够处理任意模态的复杂算子。作为本文工作的一部分,我们展示了首个基于 GPT-4 的原型系统 CEASURA,并在两个数据集上证明了这一想法的总体可行性。最后,我们讨论了若干改进当今语言模型查询规划能力的思路。
英文摘要:
Traditional query planners translate SQL queries into query plans to be executed over relational data. However, it is impossible to query other data modalities, such as images, text, or video stored in modern data systems such as data lakes using these query planners. In this paper, we propose Language-Model-Driven Query Planning, a new paradigm of query planning that uses Language Models to translate natural language queries into executable query plans. Different from relational query planners, the resulting query plans can contain complex operators that are able to process arbitrary modalities. As part of this paper, we present a first GPT-4 based prototype called CEASURA and show the general feasibility of this idea on two datasets. Finally, we discuss several ideas to improve the query planning capabilities of today's Language Models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。