发表机构
University of Wisconsin–Madison; University of Kansas(威斯康星大学麦迪逊分校; 堪萨斯大学)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
本文基于Breiman的降相关原则,提出狄利克雷重采样的两种随机森林变体DM和DW,通过浓度参数调节样本权重,并给出理论判据指导调参,在公开基准上以极小额外开销取得更优性能。
AI 中文摘要
我们重新审视了Breiman的观察,即在不削弱单棵树的前提下减少树间相关性可以提升随机森林的性能。基于这一原理,我们引入了两种变体:狄利克雷-多项分布装袋随机森林(DM)和狄利克雷加权随机森林(DW)。两者均通过浓度参数$\alpha>0$来调节样本重加权。我们提供了一个简单的理论判据,阐明了这些变体何时与标准随机森林表现无异,并利用该判据指导了一种轻量级调参策略。在公开分类基准上的受控评估中,DM和DW始终具有竞争力,且通常优于其他随机森林(RF)基线,而额外运行时间可忽略不计。
英文摘要
We revisit Breiman's observation that reducing inter-tree correlation without weakening individual trees can improve random forests. Building on this principle, we introduce two variants: Dirichlet-Multinomial Bagging Random Forest (DM) and Dirichlet-Weighted Random Forest (DW). Both modulate sample reweighting via a concentration parameter $α>0$. We provide a simple theoretical criterion that clarifies when these variants behave indistinguishably from standard random forests, and we use it to guide a lightweight tuning strategy. In a controlled evaluation on public classification benchmarks, DM and DW are consistently competitive and often stronger than other random-forest (RF) baselines, with negligible additional runtime.
Comments29 pages (10 main text, 19 pages appendix), 21 tables, 3 algorithms. No figures