单调校准内插查找表
Monotonic Calibrated Interpolated Look-Up Tables
摘要:
现实世界的机器学习应用可能需要快速评估和可解释的函数。特别是,学习函数的保证单调性对用户信任至关重要。我们建议满足这些目标的低维机器学习问题的学习灵活,单调的功能,使用校准插值查找表。我们扩展结构风险最小化框架的格回归训练单调查找表,通过解决一个凸问题,适当的线性不等式约束。此外,我们建议联合学习每个特征的可解释校准,以规范化连续特征并处理分类或缺失数据,代价是使目标非凸。我们通过并行化,小型化来解决大规模学习,并提出了添加剂正则化项的随机采样。对具有5到16个特征和数千到数百万个训练样本的实际问题的案例研究表明,所提出的单调函数可以在实际问题上实现最先进的精度,同时为用户提供更大的透明度。
英文摘要:
Real-world machine learning applications may require functions that are fast-to-evaluate and interpretable. In particular, guaranteed monotonicity of the learned function can be critical to user trust. We propose meeting these goals for low-dimensional machine learning problems by learning flexible, monotonic functions using calibrated interpolated look-up tables. We extend the structural risk minimization framework of lattice regression to train monotonic look-up tables by solving a convex problem with appropriate linear inequality constraints. In addition, we propose jointly learning interpretable calibrations of each feature to normalize continuous features and handle categorical or missing data, at the cost of making the objective non-convex. We address large-scale learning through parallelization, mini-batching, and propose random sampling of additive regularizer terms. Case studies with real-world problems with five to sixteen features and thousands to millions of training samples demonstrate the proposed monotonic functions can achieve state-of-the-art accuracy on practical problems while providing greater transparency to users.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。