测量AI模型中的偏差:引入N-Sigma的统计方法
Measuring Bias in AI Models: An Statistical Approach Introducing N-Sigma
AI总结:
本研究针对AI系统中的偏差测量问题,提出将N-Sigma统计方法应用于机器学习模型,并在人脸识别技术上进行实验,为基于偏差分析的风险评估框架开发提供了新方法。
摘要:
欧盟委员会发布的关于人工智能(AI)的新监管框架提案建立了一种新的基于风险的法律方法。该提案强调需要针对AI的不同用途开发充分的风险评估。该风险评估应解决(除其他外)AI中偏差的检测和缓解问题。在本研究中,我们分析了测量自动决策系统中偏差的统计方法。我们将实验重点放在人脸识别技术上。我们提出了一种使用基于N-Sigma方法的统计方法来测量机器学习模型中偏差的新方法。N-Sigma是一种流行的统计方法,用于验证一般科学(如物理学和社会领域)中的假设,其在机器学习中的应用尚未被探索。在本研究中,我们探讨了如何应用此方法来开发基于偏差分析的新风险评估框架,并讨论了其相对于其他流行统计检验的主要优势和缺点。
英文摘要:
The new regulatory framework proposal on Artificial Intelligence (AI) published by the European Commission establishes a new risk-based legal approach. The proposal highlights the need to develop adequate risk assessments for the different uses of AI. This risk assessment should address, among others, the detection and mitigation of bias in AI. In this work we analyze statistical approaches to measure biases in automatic decision-making systems. We focus our experiments in face recognition technologies. We propose a novel way to measure the biases in machine learning models using a statistical approach based on the N-Sigma method. N-Sigma is a popular statistical approach used to validate hypotheses in general science such as physics and social areas and its application to machine learning is yet unexplored. In this work we study how to apply this methodology to develop new risk assessment frameworks based on bias analysis and we discuss the main advantages and drawbacks with respect to other popular statistical tests.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。