通过分组学习:一种在不损失准确率的情况下提升分类公平性的多级优化框架
Learning by Grouping: A Multilevel Optimization Framework for Improving Fairness in Classification without Losing Accuracy
AI总结:
受人类分组学习技能启发,提出一种三级优化机器学习框架,通过将问题分组并用特定子模型求解,在不损失准确率的情况下有效提升分类公平性并减少过拟合。
摘要:
由于该领域的最新进展,机器学习模型在各种实际应用中的整合变得越来越普遍,以协助人类完成日常决策任务。然而,人们发现这些决策任务的准确率和公平性之间存在权衡。在某些情况下,这些AI系统可能通过表现出对某些社会群体的偏见或歧视而显得不公平,这在现实生活中可能产生严重后果。受人类最著名的学习技能之一——分组——的启发,我们通过提出一种新颖的机器学习框架来解决这一问题,该框架中ML模型学习将一组多样化的问题分组为不同的子组,并使用其特定的子模型来解决每个子组。我们提出的框架包含三个学习阶段,被表述为一个三级优化问题:(i)学习将问题分组为不同子组;(ii)学习用于解决问题的特定组子模型;(iii)通过最小化验证损失来更新训练样本的组分配。这三个学习阶段使用梯度下降以端到端联合方式执行。为了提高公平性和准确率,我们开发了一种高效的优化算法来解决这个三级优化问题。为了进一步降低小数据集中过拟合的风险,我们在第二阶段训练中引入了领域自适应技术。我们进一步将我们的方法应用于神经架构搜索。在各种数据集上的大量实验证明了我们方法的有效性以及在公平性和准确率上的性能提升。我们提出的Learning by Grouping能够减少过拟合,并在固定的人工设计网络架构和可搜索网络架构下,在各种数据集上实现最先进的性能。
英文摘要:
The integration of machine learning models in various real-world applications is becoming more prevalent to assist humans in their daily decision-making tasks as a result of recent advancements in this field. However, it has been discovered that there is a tradeoff between the accuracy and fairness of these decision-making tasks. In some cases, these AI systems can be unfair by exhibiting bias or discrimination against certain social groups, which can have severe consequences in real life. Inspired by one of the most well-known human learning skills called grouping, we address this issue by proposing a novel machine learning framework where the ML model learns to group a diverse set of problems into distinct subgroups to solve each subgroup using its specific sub-model. Our proposed framework involves three stages of learning, which are formulated as a three-level optimization problem: (i) learning to group problems into different subgroups; (ii) learning group-specific sub-models for problem-solving; and (iii) updating group assignments of training examples by minimizing the validation loss. These three learning stages are performed end-to-end in a joint manner using gradient descent. To improve fairness and accuracy, we develop an efficient optimization algorithm to solve this three-level optimization problem. To further reduce the risk of overfitting in small datasets, we incorporate domain adaptation techniques in the second stage of training. We further apply our method to neural architecture search. Extensive experiments on various datasets demonstrate our method's effectiveness and performance improvements in both fairness and accuracy. Our proposed Learning by Grouping can reduce overfitting and achieve state-of-the-art performances with fixed human-designed network architectures and searchable network architectures on various datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。