Diagnostic testing provides a unique setting for studying and developing tools in classification theory. In such contexts, the concept of prevalence, i.e. the number of individuals with a given condition, is fundamental, both as an inherent quantity of interest and as a parameter that controls classification accuracy. This manuscript is the first in a two-part series that studies deeper connections between classification theory and prevalence, showing how the latter establishes a more complete theory of uncertainty quantification (UQ) for certain types of machine learning (ML). We motivate this analysis via a lemma demonstrating that general classifiers minimizing a prevalence-weighted error contain the same probabilistic information as Bayes-optimal classifiers, which depend on conditional probability densities. This leads us to study relative probability level-sets $B^\star (q)$, which are reinterpreted as both classification boundaries and useful tools for quantifying uncertainty in class labels. To realize this in practice, we also propose a numerical, homotopy algorithm that estimates the $B^\star (q)$ by minimizing a prevalence-weighted empirical error. The successes and shortcomings of this method motivate us to revisit properties of the level sets, and we deduce the corresponding classifiers obey a useful monotonicity property that stabilizes the numerics and points to important extensions to UQ of ML. Throughout, we validate our methods in the context of synthetic data and a research-use-only SARS-CoV-2 enzyme-linked immunosorbent (ELISA) assay.
Autonomous Uncertainty Quantification for Computational Point-of-care Sensors
Electrical & Computer Engineering Department(电气与计算机工程系);Bioengineering Department(生物工程系);California NanoSystems Institute (CNSI)(加州纳米系统研究所);Department of Surgery(外科医学系);University of California, Los Angeles(加州大学洛杉矶分校)
Imputation-free transformer learning enables robust Alzheimer's disease prediction and calibrated uncertainty quantification across heterogeneous clinical cohorts
Platform of Bioinformatics(生物信息平台);Lausanne University Hospital(洛桑大学医院);Faculty of Biology and Medicine(生物学与医学学院);University of Lausanne(洛桑大学);Leenaards Memory Centre(Leenaards记忆中心);Department of Clinical Neurosciences(临床神经科学系)
Quantification using Permutation-Invariant Networks based on Histograms
Artificial Intelligence Center(人工智能中心);University of Oviedo(奥维耶多大学);Istituto di Scienza e Tecnologie dell’Informazione(信息科学与技术研究所);Consiglio Nazionale delle Ricerche(国家研究委员会)
Active operator learning with predictive uncertainty quantification for partial differential equations
Sandia National Laboratories(桑迪亚国家实验室);Department of Statistics(统计学系);Data Science, Yale University(数据科学,耶鲁大学);Environmental Engineering, Yale University(环境工程,耶鲁大学);Department of Mathematics(数学系);Department of Mechanical Engineering(机械工程系)
TAM-Chain: Multi-Scale Thyroid Cytology Classification via Absorbing Markov Chains and Shannon Entropy Uncertainty Quantification for False-Negative Suppression and Domain-Shift Adaptation
Faculty of Mathematics, Mechanics and Informatics, VNU University of Science(越南国立大学理学院数学、力学与信息学系)
Uncertainty Quantification in Cardiac Model Personalisation from Ultrafast Ultrasound
Université Côte d'Azur(蔚蓝海岸大学);Inria(法国国家信息与自动化研究所);Bordeaux University Hospital (CHU de Bordeaux)(波尔多大学医院);IHU Liryc, Electrophysiology and Heart Modeling Institute(Liryc大学医院研究所(电生理与心脏建模研究所))
Trustworthy Predictive Distributions for Tail Events with Semiparametric Diagnostic Transport Maps
Department of Statistics and Data Science, Carnegie Mellon University(统计与数据科学系,卡内基梅隆大学);Department of Statistics, Federal University of Sao Carlos(统计系,圣卡洛斯联邦大学)
Measuring Fairness Under Unawareness of Sensitive Attributes: A Quantification-Based Approach
Max Planck Institute for Security and Privacy(马克斯·普朗克安全与隐私研究所);University of Padova(帕多瓦大学);Istituto di Scienza e Tecnologie dell’Informazione(信息科学与技术研究所);Consiglio Nazionale delle Ricerche(意大利国家研究委员会)
Geometry-Aware Bayesian Quantification via Compositional Data Analysis
Istituto di Scienza e Tecnologie dell’Informazione Consiglio Nazionale delle Ricerche(国家研究委员会信息科学与技术研究所);Artificial Intelligence Center University of Oviedo(奥维耶多大学人工智能中心)
Fine-Grained Uncertainty Quantification via Collisions
Department of Electrical and Computer Engineering, The University of Arizona(电气与计算机工程系,亚利桑那大学);Pacific Northwest National Laboratory(太平洋西北国家实验室);Marvell Technology Inc.(Marvell技术公司)
Automated HER2 scoring with uncertainty quantification using lensfree holography and deep learning
Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA(加州大学洛杉矶分校电气与计算机工程系);Bioengineering Department, University of California, Los Angeles, CA, 90095, USA(加州大学洛杉矶分校生物工程系);California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA(加州大学洛杉矶分校加州纳米系统研究所);Department of Computer Science, University of California, Los Angeles, CA, 90095, USA(加州大学洛杉矶分校计算机科学系)
Decoupling Distance and Networks: Hybrid Graph Attention-Geostatistical Methods for Spatio-temporal Risk Mapping
Federal University of Technology and Environmental Sciences(联邦科技大学与环境科学学院);Federal University of Technology, Akure(阿库雷联邦科技大学);University of Manchester(曼彻斯特大学)
Prediction Markets as Bayesian Inverse Problems: Uncertainty Quantification, Identifiability, and Information Gain from Price-Volume Histories under Latent Types