基于大语言模型的多智能体黑板系统用于数据科学中的信息发现
LLM-Based Multi-Agent Blackboard System for Information Discovery in Data Science
AI总结:
本文提出了一种基于黑板架构的多智能体系统,用于提升数据科学中的信息发现效率,通过去中心化设计实现更高的可扩展性和灵活性。
摘要:
大语言模型(LLMs)的进步为数据科学创造了新的机会,但其部署往往受到在大规模数据湖中找到相关数据的挑战的限制。现有方法在这一方面存在问题:单智能体和多智能体系统都很快被大量异构文件所压倒,而主从多智能体系统依赖于一个刚性的中央控制器,该控制器需要精确了解每个子智能体的能力,这在大规模设置中是不可能的,因为主智能体无法完全观察子智能体的知识和能力。我们提出了一种受传统AI模型黑板架构启发的新型多智能体范式。在我们的框架中,一个中心智能体向共享的黑板提出请求,而自主的从属智能体——无论是负责数据湖的某个分区还是从网络检索信息——会根据其能力自愿响应。这种设计通过消除中央协调器需要了解每个智能体专业知识或内部知识的必要性,提高了可扩展性和灵活性。我们在三个需要数据发现的基准上评估了这种方法:KramaBench和修改版的DSBench和DA-Code。结果表明,黑板架构在很大程度上优于强大的基线方法,实现了端到端成功度的13%-57%的相对提升,并在数据发现F1指标上实现了相对于最佳基线的9%的相对提升。
英文摘要:
Advances in large language models (LLMs) have created new opportunities in data science, but their deployment is often limited by the challenge of finding relevant data in large data lakes. Existing methods struggle with this: both single- and multi-agent systems are quickly overwhelmed by large, heterogeneous files, and master-slave multi-agent systems rely on a rigid central controller that requires precise knowledge of each sub-agent's capabilities, which is not possible in large-scale settings where the main agent lacks full observability over sub-agents' knowledge and competencies. We propose a novel multi-agent paradigm inspired by the blackboard architecture for traditional AI models. In our framework, a central agent posts requests to a shared blackboard, and autonomous subordinate agents - either responsible for a partition of the data lake or retrieval from the web - volunteer to respond based on their capabilities. This design improves scalability and flexibility by removing the need for a central coordinator to know each agent's expertise or internal knowledge. We evaluate the approach on three benchmarks that require data discovery: KramaBench and modified versions of DSBench and DA-Code. Results show that the blackboard architecture substantially outperforms strong baselines, achieving 13%-57% relative improvements in end-to-end success and up to a 9% relative gain in data discovery F1 over the best baseline.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。