MOSS:面向稳定规则集的多目标优化
MOSS: Multi-Objective Optimization for Stable Rule Sets
AI总结:
本研究提出MOSS多目标优化框架,整合稀疏性、准确性与稳定性标准,通过专用割平面算法快速计算帕累托前沿,在预测性能和稳定性上均优于现有规则集成方法。
摘要:
我们提出MOSS,一种用于构建稳定决策规则集的多目标优化框架。MOSS将可解释性的三个重要标准——稀疏性、准确性和稳定性——整合到单个多目标优化框架中。重要的是,MOSS允许从业者快速评估稀疏规则集中准确性与稳定性之间的权衡,以选择合适的模型。我们在框架中开发了一种专用的割平面算法,用于快速计算这两个目标之间的帕累托前沿,且该算法可扩展到商业优化求解器无法处理的问题实例。我们的实验表明,MOSS在预测性能和稳定性方面均优于最先进的规则集成方法。
英文摘要:
We present MOSS, a multi-objective optimization framework for constructing stable sets of decision rules. MOSS incorporates three important criteria for interpretability: sparsity, accuracy, and stability, into a single multi-objective optimization framework. Importantly, MOSS allows a practitioner to rapidly evaluate the trade-off between accuracy and stability in sparse rule sets in order to select an appropriate model. We develop a specialized cutting plane algorithm in our framework to rapidly compute the Pareto frontier between these two objectives, and our algorithm scales to problem instances beyond the capabilities of commercial optimization solvers. Our experiments show that MOSS outperforms state-of-the-art rule ensembles in terms of both predictive performance and stability.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。