Machine learning models are often used to inform real world risk assessment tasks: predicting consumer default risk, predicting whether a person suffers from a serious illness, or predicting a person's risk to appear in court. Given multiple models that perform almost equally well for a prediction task, to what extent do predictions vary across these models? If predictions are relatively consistent for similar models, then the standard approach of choosing the model that optimizes a penalized loss suffices. But what if predictions vary significantly for similar models? In machine learning, this is referred to as predictive multiplicity i.e. the prevalence of conflicting predictions assigned by near-optimal competing models. In this paper, we present a framework for measuring predictive multiplicity in probabilistic classification (predicting the probability of a positive outcome). We introduce measures that capture the variation in risk estimates over the set of competing models, and develop optimization-based methods to compute these measures efficiently and reliably for convex empirical risk minimization problems. We demonstrate the incidence and prevalence of predictive multiplicity in real-world tasks. Further, we provide insight into how predictive multiplicity arises by analyzing the relationship between predictive multiplicity and data set characteristics (outliers, separability, and majority-minority structure). Our results emphasize the need to report predictive multiplicity more widely.
Investigating the Impact of Balancing, Filtering, and Complexity on Predictive Multiplicity: A Data-Centric Perspective
Eskisehir Technical University, Department of Statistics(埃斯克谢希大学统计系);Warsaw University of Technology, Faculty of Mathematics and Information Science(华沙技术大学数学与信息科学学院);University of Warsaw, Faculty of Mathematics, Informatics and Mechanics(华沙大学数学、信息学与力学学院)
Using predictive multiplicity to measure individual performance within the AI Act
University of Tübingen and Tübingen AI Center(图宾根大学和图宾根人工智能中心);University of Tübingen and CZS Institute for Artificial Intelligence and Law(图宾根大学和图宾根人工智能与法律研究所);University of Tübingen, Tübingen AI Center and CZS Institute for Artificial Intelligence and Law(图宾根大学、图宾根人工智能中心和图宾根人工智能与法律研究所)
An Experimental Study on the Rashomon Effect of Balancing Methods in Imbalanced Classification
Eskisehir Technical University, Department of Statistics, Turkiye(埃斯基谢普技术大学统计系,土耳其);Warsaw University of Technology, Faculty of Mathematics and Information Science(华沙技术大学数学与信息科学系);University of Warsaw, Faculty of Mathematics, Informatics and Mechanics(华沙大学数学、信息学与力学系)
On Arbitrary Predictions from Equally Valid Models
Hasso Plattner Institute, University of Potsdam, Germany(波茨坦大学霍索普纳研究所,德国);Chair for AI in Healthcare and Medicine, Technical University of Munich, Germany(慕尼黑技术大学医学与健康人工智能教研室,德国);BioMedIA, Imperial College London, United Kingdom(伦敦帝国理工学院BioMedIA,英国);Munich Center for Machine Learning, Germany(慕尼黑机器学习中心,德国);Universitätsklinikum Hamburg-Eppendorf, Germany(汉堡-埃彭多夫大学医院,德国)
Improved probabilistic regression using diffusion models
Ludwig-Maximilians-Universität München(慕尼黑莱布尼茨大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);University of Tromsø(特罗姆斯大学);DLR-German Aerospace Center(德国航空航天中心)
Bridging the Gap between Probabilistic and Deterministic Models: A Simulation Study on a Variational Bayes Predictive Coding Recurrent Neural Network Model
KAIST(韩国科学技术院);Okinawa Institute of Science and Technology(冲绳科学技术大学院大学)
Uncertainty-Aware Predictive Safety Filters for Probabilistic Neural Network Dynamics
Institute for Data Science in Mechanical Engineering (DSME), RWTH Aachen University(机械工程数据科学研究所(DSME),亚琛工业大学);Institute of Climate and Energy Systems (ICE), Energy Systems Engineering (ICE-1), Forschungszentrum Jülich GmbH(气候与能源系统研究所(ICE),能源系统工程(ICE-1),焦耳研究中心有限公司)
Massachusetts Institute of Technology(麻省理工学院);Vector Institute(向量研究所);University of Toronto(多伦多大学);New York University(纽约大学);New York University Grossman School of Medicine(纽约大学格罗斯曼医学院)
Horizon-Constrained Rashomon Sets for Chaotic Forecasting
Dept. of Electrical Engineering, California State University Long Beach, USA;WorkOnward Inc., USA;Dept. of Computer Engineering \& Computer Science, California State University Long Beach, USA
Conformal Convolution and Monte Carlo Meta-learners for Predictive Inference of Individual Treatment Effects
IDLab Department of Electronics and Information Systems Ghent University, Belgium(IDLab电子与信息系统系根特大学,比利时);IDLab Department of Electronics and Information Systems Ghent University - imec, Belgium(IDLab电子与信息系统系根特大学-imec,比利时);Biometrics Research Group Department of Morphology, Imaging, Orthopedics, Rehabilitation and Nutrition Ghent University, Belgium(生物医学研究组形态学、成像、骨科、康复与营养系根特大学,比利时)
Cross-model Fairness: Empirical Study of Fairness and Ethics Under Model Multiplicity
ARC Centre of Excellence for Automated Decision-Making and Society(自动化决策与社会卓越研究中心);RMIT University(皇家墨尔本理工大学);ETH Zurich(苏黎世联邦理工学院);Institute of Computer Science, University of Tartu(塔尔图大学计算机科学研究所);UNSW Sydney(新南威尔士大学悉尼分校)
On the Predictive Skill of Artificial Intelligence-based Weather Models for Extreme Events using Uncertainty Quantification
Applied Machine Learning Group(应用机器学习组);Fraunhofer Heinrich-Hertz Institute(弗劳恩霍夫海因里希-赫兹研究所);Signal Theory and Communications Dept.(信号理论与通信系);Universidad Carlos III de Madrid (UC3M)(马德里卡洛斯三世大学)
Probabilistic Deterministic Finite Automata and Recurrent Networks, Revisited
W. M. Keck Science Department, Claremont McKenna, Scripps, and Pitzer College(克莱蒙特·麦肯纳学院、斯克里普斯学院和皮策学院 W. M. 凯克科学系);University of California, Davis(加州大学戴维斯分校)