TiInsight:通过大型语言模型实现基于SQL的自动化探索性数据分析系统
TiInsight: A SQL-based Automated Exploratory Data Analysis System through Large Language Models
AI总结:
TiInsight基于SQL构建跨领域探索性数据分析系统,提供自然语言查询界面、跨领域分析流水线及可视化工具,已在PingCAP生产环境部署并验证。
摘要:
基于SQL的探索性数据分析已引起数据分析师社区的广泛关注。大型语言模型(LLMs)的出现促进了从手动到自动化数据探索的范式转变。然而,现有方法通常缺乏跨领域分析的能力,且对LLMs能力的探索仍显不足。本文提出了TiInsight,一个基于SQL的自动化跨领域探索性数据分析系统。首先,TiInsight提供了一个用户友好的图形界面,使用户能够通过自然语言查询来探索数据。其次,TiInsight提供了一个稳健的跨领域探索性数据分析流水线:层次化数据上下文(即HDC)生成、问题澄清与分解、文本到SQL(即TiSQL)以及数据可视化(即TiChart)。第三,我们已在PingCAP的生产环境中实现了并部署了TiInsight,并使用代表性数据集展示了其能力。演示视频可在https://youtu.be/JzYFyYd-emI获取。
英文摘要:
The SQL-based exploratory data analysis has garnered significant attention within the data analysis community. The emergence of large language models (LLMs) has facilitated the paradigm shift from manual to automated data exploration. However, existing methods generally lack the ability for cross-domain analysis, and the exploration of LLMs capabilities remains insufficient. This paper presents TiInsight, an SQL-based automated cross-domain exploratory data analysis system. First, TiInsight offers a user-friendly GUI enabling users to explore data using natural language queries. Second, TiInsight offers a robust cross-domain exploratory data analysis pipeline: hierarchical data context (i.e., HDC) generation, question clarification and decomposition, text-to-SQL (i.e., TiSQL), and data visualization (i.e., TiChart). Third, we have implemented and deployed TiInsight in the production environment of PingCAP and demonstrated its capabilities using representative datasets. The demo video is available at https://youtu.be/JzYFyYd-emI.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。