arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.11227cs.DBcs.AI
收藏

复合模式注册表

Compound Schema Registry

UC Berkeley(加州大学伯克利分校);System Design Studio(系统设计工作室)

Silvery D. Fu, Xuewei Chen

AI总结:

本文提出基于复合AI系统和大语言模型的广义模式演化方法,通过模式转换语言生成中间表示,以提升模式映射的准确性与效率。

摘要:

模式演化在数据库系统管理中至关重要,以确保不同数据版本之间的兼容性。模式注册表通常通过管理、验证和确保模式兼容性来应对实时数据流中的模式演化挑战。然而,当前的模式注册表难以处理复杂的语法变更,例如字段重命名或类型更改,这些变更通常需要大量人工干预,并可能中断服务。为了增强模式演化的灵活性,我们提出使用由复合AI系统支持的广义模式演化(GSE)。该系统利用大语言模型(LLMs)来解释模式变更的语义,从而在不中断数据流的情况下支持更广泛的语法修改。我们的方法包括开发一种任务特定语言,即模式转换语言(STL),以生成模式映射作为中间表示(IR),简化跨不同数据处理平台的模式变更集成。初步结果表明,该方法能够提高模式映射的准确性和效率,展示了GSE在实际应用中的潜力。

英文摘要:

Schema evolution is critical in managing database systems to ensure compatibility across different data versions. A schema registry typically addresses the challenges of schema evolution in real-time data streaming by managing, validating, and ensuring schema compatibility. However, current schema registries struggle with complex syntactic alterations like field renaming or type changes, which often require significant manual intervention and can disrupt service. To enhance the flexibility of schema evolution, we propose the use of generalized schema evolution (GSE) facilitated by a compound AI system. This system employs Large Language Models (LLMs) to interpret the semantics of schema changes, supporting a broader range of syntactic modifications without interrupting data streams. Our approach includes developing a task-specific language, Schema Transformation Language (STL), to generate schema mappings as an intermediate representation (IR), simplifying the integration of schema changes across different data processing platforms. Initial results indicate that this approach can improve schema mapping accuracy and efficiency, demonstrating the potential of GSE in practical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑