Cross-model Fairness: Empirical Study of Fairness and Ethics Under Model Multiplicity
ARC Centre of Excellence for Automated Decision-Making and Society(自动化决策与社会卓越研究中心);RMIT University(皇家墨尔本理工大学);ETH Zurich(苏黎世联邦理工学院);Institute of Computer Science, University of Tartu(塔尔图大学计算机科学研究所);UNSW Sydney(新南威尔士大学悉尼分校)
Kacper Sokol, Meelis Kull, Jeffrey Chan, Flora Salim
备注:
Published in the *ACM Journal on Responsible Computing*
While data-driven predictive models are a strictly technological construct, they may operate within a social context in which benign engineering choices entail implicit, indirect and unexpected real-life consequences. Fairness of such systems -- pertaining both to individuals and groups -- is one relevant consideration in this space; algorithms can discriminate people across various protected characteristics regardless of whether these properties are included in the data or discernible through proxy variables. To date, this notion has predominantly been studied for a fixed model, often under different classification thresholds, striving to identify and eradicate undesirable, discriminative and possibly unlawful aspects of its operation. Here, we backtrack on this fixed model assumption to propose and explore a novel definition of cross-model fairness where individuals can be harmed when one predictor is chosen ad hoc from a group of equally well performing models, i.e., in view of utility-based model multiplicity. Since a person may be classified differently across models that are otherwise considered equivalent, this individual could argue for a predictor granting them the most favourable outcome, employing which may have adverse effects on other people. We introduce this scenario with a two-dimensional example and linear classification; then, we present a comprehensive empirical study based on real-life predictive models and data sets that are popular with the algorithmic fairness community; finally, we investigate analytical properties of cross-model fairness and its ramifications in a broader context. Our findings suggest that such unfairness can be readily found in real life and it may be difficult to mitigate by technical means alone as doing so is likely to degrade predictive performance.
Operationalizing Fairness: Post-Hoc Threshold Optimization Under Hard Resource Limits
Department of Computer Science and Engineering, DUIET, Dibrugarh University, Assam, India(迪布鲁大学计算机科学与工程系,DUIET,阿萨姆,印度);Department of Computer Science and Engineering, MIT, Manipur University, 795003, India(曼尼普尔大学计算机科学与工程系,MIT,曼尼普尔大学,印度)
Ethical and Explainable AI in Reusable MLOps Pipelines
Washington University of Science and Technology(科学与技术华盛顿大学);University of Maryland, Baltimore County(马里兰大学巴尔的摩县分校);Karlstad University(卡尔斯塔德大学);American University of Bahrain(巴林美国大学)
Algorithmic Fairness in AI Surrogates for End-of-Life Decision-Making
The Department of Computing & Software Systems University of Washington Bothell Harborview Medical Center, UW Medicine(计算与软件系统系华盛顿大学Bothell分校哈佛湾医疗中心,华盛顿大学医学部)
针对临终决策 AI 替代者,本文将主要公平概念映射到现实临终场景并跨道德传统考察,提出公平应包含道德代表性及对患者价值观、关系与世界观的忠实。
Towards Clinical AI Fairness: Filling Gaps in the Puzzle
Duke-NUS Medical School(杜克-新加坡国立大学医学院);University of Birmingham(伯明翰大学);University Hospitals Birmingham NHS Foundation Trust(伯明翰大学医院NHS基金会信托);National Institute for Health and Care Research Birmingham Biomedical Research Centre(国家健康与护理研究所伯明翰生物医学研究中心);University of Antwerp(安特卫普大学);University of Florida(佛罗里达大学);Singapore Eye Research Institute(新加坡眼科研究所);Singapore National Eye Centre(新加坡国家眼科中心);Singapore General Hospital(新加坡中央医院);Weill Cornell Medicine(威尔康奈尔医学院);Massachusetts Institute of Technology(麻省理工学院);Beth Israel Deaconess Medical Center(贝斯以色列女执事医疗中心);Harvard T.H. Chan School of Public Health(哈佛大学陈曾熙公共卫生学院);National University of Singapore(新加坡国立大学)
Be Intentional About Fairness!: Fairness, Size, and Multiplicity in the Rashomon Set
New York University(纽约大学);NYU Courant Institute of Mathematical Sciences(纽约大学柯朗数学科学研究所);Robert F. Wagner Graduate School of Public Service, New York University(纽约大学罗伯特·F·瓦格纳公共服务研究生院);Tandon School of Engineering, New York University(纽约大学坦登工程学院);Center for Urban Science and Progress, Tandon School of Engineering, New York University(纽约大学坦登工程学院城市科学与进步中心);Center for Data Science, New York University(纽约大学数据科学中心)