可解释线性分类的方法和模型
Methods and Models for Interpretable Linear Classification
摘要:
我们提出了一个整数规划框架,以建立准确和可解释的离散线性分类模型。与现有的方法不同,我们的框架旨在为从业者提供他们所需的控制和灵活性,以便为所选领域定制准确和可解释的模型。为此,我们的框架可以通过最小化0- 1分类损失来生成完全优化准确性的模型,并通过合并一系列离散约束和惩罚函数来解决可解释性的多个方面。我们使用我们的框架来生成难以用现有方法创建的模型,例如评分系统和M-of-N规则表。此外,我们提出了专门设计的优化方法,以提高我们的框架的可扩展性,通过分解和数据减少。我们表明,离散线性分类器可以达到任何其他线性分类器的训练精度,并提供一个奥卡姆剃刀型参数,为什么使用小的离散系数可以提供更好的推广。我们通过数值实验和案例研究证明了我们的框架的性能和灵活性,在该案例研究中,我们构建了一个高度定制的睡眠呼吸暂停诊断的临床工具。
英文摘要:
We present an integer programming framework to build accurate and interpretable discrete linear classification models. Unlike existing approaches, our framework is designed to provide practitioners with the control and flexibility they need to tailor accurate and interpretable models for a domain of choice. To this end, our framework can produce models that are fully optimized for accuracy, by minimizing the 0--1 classification loss, and that address multiple aspects of interpretability, by incorporating a range of discrete constraints and penalty functions. We use our framework to produce models that are difficult to create with existing methods, such as scoring systems and M-of-N rule tables. In addition, we propose specially designed optimization methods to improve the scalability of our framework through decomposition and data reduction. We show that discrete linear classifiers can attain the training accuracy of any other linear classifier, and provide an Occam's Razor type argument as to why the use of small discrete coefficients can provide better generalization. We demonstrate the performance and flexibility of our framework through numerical experiments and a case study in which we construct a highly tailored clinical tool for sleep apnea diagnosis.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。