arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.02444cs.DB
收藏

OmniTQA:一种面向半结构化数据的混合查询处理成本感知系统

From Textual Columns to Query Plans: A Unified Relational-Semantic Execution Framework for Hybrid Query Processing

Megagon Labs(Megagon实验室)

Nima Shahbazi, Seiji Maekawa, Nikita Bhutani, Estevam Hruschka

AI总结:

OmniTQA通过整合LLM语义操作与传统关系运算符,提出了一种成本感知的混合查询处理框架,有效处理结构化与半结构化数据,提升复杂查询和大规模表的准确性和效率。

摘要:

尽管大语言模型的进步显著提升了文本到SQL和表格问答系统,但现有方法通常假设所有查询相关信息都显式表示在结构化模式中。在实践中,许多企业数据库包含混合模式,其中结构化属性与自由文本字段共存,需要系统在两种信息上进行推理。为此,我们引入OmniTQA,一种面向结构化和半结构化数据的混合查询处理框架。OmniTQA将语义推理作为第一类查询运算符,无缝整合基于LLM的语义操作与传统关系运算符,形成可执行的有向无环图。为管理LLM推理的高延迟和成本,它扩展了传统查询优化,结合原子查询分解和运算符重排以最小化语义工作量。该框架还具有双引擎执行架构,动态在关系数据库和LLM模块之间路由任务,利用运算符感知的批处理以高效扩展。在广泛的结构化和半结构化表格问答基准测试中,OmniTQA在准确性和成本效率上均优于现有符号、语义和混合基线。这些收益在复杂查询、大表和多关系模式中尤为明显。

英文摘要:

Real-world table question answering often involves hybrid schemas in which some query-relevant information is explicit in relational columns, while other attributes, predicates, or join conditions are only implicit in free-form text. Existing systems struggle with this setting: Text-to-SQL methods scale to large and multi-table databases but require fully structured schemas, whereas direct LLM-based methods can interpret textual content but are costly and unreliable when applied to large databases. We present OmniTQA, a unified framework for semi-structured table question answering that treats semantic reasoning as a first-class operation within relational query execution. OmniTQA compiles natural-language questions into directed acyclic graphs of relational and LLM-based semantic operators. This enables ambiguity-aware plan diversification, cost-aware optimization, and dual-engine execution over structured and textual data. Across structured and semi-structured benchmarks, OmniTQA consistently improves performance in hybrid settings, outperforming the strongest baselines by 14 accuracy points on average and by 27 points on the most challenging subset, while maintaining competitive accuracy on fully structured datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑