arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.09311cs.CL
收藏

基于大语言模型的贝叶斯网络结构提取可扩展性:一种新方法与对比分析

Scalability of Bayesian Network Structure Elicitation with Large Language Models: a Novel Methodology and Comparative Analysis

University of Aberdeen(阿伯丁大学)

Nikolay Babakov, Ehud Reiter, Alberto Bugarin

AI总结:

本研究提出基于多经验LLM独立生成加多数投票的贝叶斯网络结构提取新方法,对比验证了其在部分LLM上的性能优势,同时揭示了BN规模增大导致性能下降、部分BN因污染或节点名难区分不适用于实验的结论。

摘要:

本研究提出了一种贝叶斯网络(Bayesian Networks, BNs)结构提取的新方法:先初始化多个具备不同经验的大语言模型(Large Language Models, LLMs),独立查询各模型生成BN结构,再通过多数投票得到最终结构。我们将该方法与一种现有替代方法,在多个知名度不同、规模各异的BN上展开对比,研究两种方法的可扩展性。我们还提出了一种检测LLM中BN污染情况的方法,结果显示部分广为人知的BN不适用于测试LLM的BN结构提取能力;另有部分BN因节点名称难以区分,也不适用于此类实验。在其余BN上的实验表明,在三种受测LLM中的一种上,我们的方法表现优于现有方法;但两种方法的性能均会随BN规模增大而显著下降。

英文摘要:

In this work, we propose a novel method for Bayesian Networks (BNs) structure elicitation that is based on the initialization of several LLMs with different experiences, independently querying them to create a structure of the BN, and further obtaining the final structure by majority voting. We compare the method with one alternative method on various widely and not widely known BNs of different sizes and study the scalability of both methods on them. We also propose an approach to check the contamination of BNs in LLM, which shows that some widely known BNs are inapplicable for testing the LLM usage for BNs structure elicitation. We also show that some BNs may be inapplicable for such experiments because their node names are indistinguishable. The experiments on the other BNs show that our method performs better than the existing method with one of the three studied LLMs; however, the performance of both methods significantly decreases with the increase in BN size.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑