arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.02655cs.DB
收藏

基于整体数据理解的语义数据处理

Semantic Data Processing with Holistic Data Understanding

UC Berkeley(加州大学伯克利分校)

Youran Sun, Sepanta Zeighami, Bhavya Chopra, Shreya Shankar, Aditya G. Parameswaran

AI总结:

本文提出HoldUp方法,通过联合处理数据记录并利用跨记录关系,提升语义数据处理的准确性,在15个真实数据集上表现优于现有方案,分类和聚类任务准确率分别提高33%和30%。

摘要:

语义运算符越来越多地被集成到数据系统中,以利用大语言模型(LLMs)处理数据。尽管近年来在改进这些运算符方面做出了显著努力,但其准确性受限于关键缺陷:缺乏整体数据理解。现有系统中,语义运算符通常独立处理每个数据记录,不考虑数据上下文,仅利用LLM对用户提供的任务的通用解释。然而,自然语言不精确,因此只有在数据上下文中正确解释任务才能准确完成任务。例如,在分类和评分任务中,常规的逐行处理方法在广泛的数据集中会产生不准确的结果。我们提出HoldUp,一种具有整体数据理解的语义数据处理方法。HoldUp联合处理记录,利用跨记录关系正确解释任务。然而,实现整体数据理解具有挑战性,因为所谓的LLM数据理解悖论:虽然需要大量的代表性数据子集来提供上下文,但将长输入馈入LLM会导致质量下降,这是众所周知的长上下文问题。为了解决这个悖论,我们开发了一种新的聚类算法,通过巧妙使用LLM来识别数据集中的潜在结构,受袋外法启发。使用这种方法作为基本操作,我们开发了新的基于聚类的分类和评分方法,以高准确率完成这两个任务。在15个真实数据集上的实验表明,HoldUp在分类和评分和聚类任务中的一致性优于现有解决方案,分类任务的准确率提高高达33%,评分和聚类任务的准确率提高高达30%。

英文摘要:

Semantic operators have increasingly become integrated within data systems to enable processing data using Large Language Models (LLMs). Despite significant recent effort in improving these operators, their accuracy is limited due to a critical flaw in their implementation: lack of holistic data understanding. In existing systems, semantic operators often process each data record independently using an LLM, without considering data context, only leveraging LLM's dataset-agnostic interpretation of the user-provided task. However, natural language is imprecise, so a task can only be accurately performed if it is correctly interpreted in the context of the dataset. For example, for classification and scoring tasks, which are typical semantic map tasks, the standard method of processing each record row by row yields inaccurate results in a wide range of datasets. We propose HoldUp, a new method for semantic data processing with holistic data understanding. HoldUp processes records jointly, leveraging cross-record relationships to correctly interpret the task within the data context. Enabling holistic data understanding, however, is challenging due to what we call LLM data understanding paradox: while large representative data subsets are necessary to provide context, feeding long inputs to LLMs causes quality degradation due to well-known long-context issues. To resolve this paradox, we develop a novel clustering algorithm to identify the latent structure within the dataset through judicious use of LLMs, inspired by bagging. Using this approach as a primitive, we develop novel clustering-based classification and scoring methods to perform these two tasks with high accuracy. Experiments across 15 real-world datasets show that HoldUp consistently outperforms existing solutions, providing up to 33% higher accuracy for classification and 30% higher accuracy for scoring and clustering tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑