arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.02205cs.DBcs.AIcs.CL
收藏

DataLab:面向大语言模型驱动商业智能的统一平台

DataLab: A Unified Platform for LLM-Powered Business Intelligence

Zhejiang University(浙江大学);Tencent Inc.(腾讯公司);Southern University of Science and Technology(南方科技大学);Peking University(北京大学)
Luoxuan Weng, Yinghao Tang, Yingchaojie Feng, Zhuo Chang, Ruiqin Chen, Haozhe Feng, Chen Hou, Danqing Huang, Yang Li, Huaming Rao, Haonan Wang, Canshi Wei, Xiao… 展开作者

Luoxuan Weng, Yinghao Tang, Yingchaojie Feng, Zhuo Chang, Ruiqin Chen, Haozhe Feng, Chen Hou, Danqing Huang, Yang Li, Huaming Rao, Haonan Wang, Canshi Wei, Xiaofeng Yang, Yuhui Zhang, Yifeng Zheng, Xiuqi Huang, Minfeng Zhu, Yuxin Ma, Bin Cui, Peng Chen, Wei Chen

AI总结:

DataLab提出统一BI平台,融合LLM智能体框架与计算笔记本,通过领域知识融合、智能体通信和单元格上下文管理,在多种BI任务上实现最优性能并显著提升企业场景准确率、降低成本。

摘要:

商业智能(BI)将现代组织中的海量数据转化为可操作的洞察,以支持明智决策。近年来,基于大语言模型(LLM)的智能体通过根据自然语言(NL)查询在可执行环境中自动执行任务规划、推理和行动,简化了BI工作流。然而,现有方法主要聚焦于单个BI任务,如NL2SQL和NL2VIS。由于BI具有迭代性和协作性,任务在不同数据角色和工具之间的割裂会导致效率低下和潜在错误。在本文中,我们提出了DataLab,一个统一的BI平台,它将一站式基于LLM的智能体框架与增强型计算笔记本界面集成在一起。DataLab通过在同一环境中无缝结合LLM辅助与用户定制,支持数据准备、分析和可视化中面向不同数据角色的各种BI任务。为实现这种统一,我们设计了一个面向企业特定BI任务的领域知识融合模块,一个促进BI工作流中信息共享的智能体间通信机制,以及一种基于单元格的上下文管理策略,以提高BI笔记本中的上下文利用效率。大量实验表明,DataLab在流行研究基准上的各种BI任务中达到了最先进的性能。此外,DataLab在腾讯的真实世界数据集上保持了高效性和有效性,在企业特定BI任务上实现了最高58.58%的准确率提升和61.65%的token成本降低。

英文摘要:

Business intelligence (BI) transforms large volumes of data within modern organizations into actionable insights for informed decision-making. Recently, large language model (LLM)-based agents have streamlined the BI workflow by automatically performing task planning, reasoning, and actions in executable environments based on natural language (NL) queries. However, existing approaches primarily focus on individual BI tasks such as NL2SQL and NL2VIS. The fragmentation of tasks across different data roles and tools lead to inefficiencies and potential errors due to the iterative and collaborative nature of BI. In this paper, we introduce DataLab, a unified BI platform that integrates a one-stop LLM-based agent framework with an augmented computational notebook interface. DataLab supports various BI tasks for different data roles in data preparation, analysis, and visualization by seamlessly combining LLM assistance with user customization within a single environment. To achieve this unification, we design a domain knowledge incorporation module tailored for enterprise-specific BI tasks, an inter-agent communication mechanism to facilitate information sharing across the BI workflow, and a cell-based context management strategy to enhance context utilization efficiency in BI notebooks. Extensive experiments demonstrate that DataLab achieves state-of-the-art performance on various BI tasks across popular research benchmarks. Moreover, DataLab maintains high effectiveness and efficiency on real-world datasets from Tencent, achieving up to a 58.58% increase in accuracy and a 61.65% reduction in token cost on enterprise-specific BI tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑