arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.04339cs.AIcs.LG
收藏

学习更精细的东西:实例化级别的贝叶斯结构学习

Learning the Finer Things: Bayesian Structure Learning at the Instantiation Level

Chase Yakaboski, Eugene Santos

摘要:

成功的机器学习方法需要在记忆和泛化之间进行权衡。太多的记忆和模型不能推广到未观察到的例子。太多的过度概括,我们就有可能对数据拟合不足。虽然我们通常通过交叉验证和准确性指标来衡量它们的性能,但这些算法应该如何应对那些准确性总是不令人满意的极不确定的领域?我们提出了一种新的概率图模型结构学习方法,可以学习,概括和解释在这些难以捉摸的领域通过操作在随机变量实例化水平。使用最小描述长度(MDL)分析,我们提出了一个新的分解的学习问题的所有训练样本,融合在一起的最小熵推理,构建一个最终的知识库。通过利用贝叶斯知识库(BKBs),一个框架,在实例化级别和固有的包容贝叶斯网络(BN),我们开发了一个理论MDL得分和相关的结构学习算法,证明了显着的改进学习BN的40个基准数据集。此外,我们的算法结合了最近现成的DAG学习技术,即使在大问题上也能得到易于处理的结果。然后,我们证明了我们的方法在一个显着欠确定域的效用,通过学习基因调控网络的乳腺癌基因突变数据可从癌症基因组图谱(TCGA)。

英文摘要:

Successful machine learning methods require a trade-off between memorization and generalization. Too much memorization and the model cannot generalize to unobserved examples. Too much over-generalization and we risk under-fitting the data. While we commonly measure their performance through cross validation and accuracy metrics, how should these algorithms cope in domains that are extremely under-determined where accuracy is always unsatisfactory? We present a novel probabilistic graphical model structure learning approach that can learn, generalize and explain in these elusive domains by operating at the random variable instantiation level. Using Minimum Description Length (MDL) analysis, we propose a new decomposition of the learning problem over all training exemplars, fusing together minimal entropy inferences to construct a final knowledge base. By leveraging Bayesian Knowledge Bases (BKBs), a framework that operates at the instantiation level and inherently subsumes Bayesian Networks (BNs), we develop both a theoretical MDL score and associated structure learning algorithm that demonstrates significant improvements over learned BNs on 40 benchmark datasets. Further, our algorithm incorporates recent off-the-shelf DAG learning techniques enabling tractable results even on large problems. We then demonstrate the utility of our approach in a significantly under-determined domain by learning gene regulatory networks on breast cancer gene mutational data available from The Cancer Genome Atlas (TCGA).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑