Detecting Out-of-Distribution (OOD) sensory data and covariate distribution shift aims to identify new test examples with different high-level image statistics to the captured, normal and In-Distribution (ID) set. Existing OOD detection literature largely focuses on semantic shift with little-to-no consensus over covariate shift. Generative models capture the ID data in an unsupervised manner, enabling them to effectively identify samples that deviate significantly from this learned distribution, irrespective of the downstream task. In this work, we elucidate the ability of generative models to detect and quantify domain-specific covariate shift through extensive analyses that involves a variety of models. To this end, we conjecture that it is sufficient to detect most occurring sensory faults (anomalies and deviations in global signals statistics) by solely modeling high-frequency signal-dependent and independent details. We propose a novel method, CovariateFlow, for OOD detection, specifically tailored to covariate heteroscedastic high-frequency image-components using conditional Normalizing Flows (cNFs). Our results on CIFAR10 vs. CIFAR10-C and ImageNet200 vs. ImageNet200-C demonstrate the effectiveness of the method by accurately detecting OOD covariate shift. This work contributes to enhancing the fidelity of imaging systems and aiding machine learning models in OOD detection in the presence of covariate shift.
E-QRGMM: Efficient Generative Metamodeling for Covariate-Dependent Uncertainty Quantification
School of Data Science(数据科学学院);School of Management(管理学院);Department of Decision Analytics and Operations, College of Business, City University of Hong Kong(商业学院决策分析与运营系,香港城市大学);The Laboratory for AI-Powered Financial Technologies(人工智能赋能金融技术实验室)
Diagnosing Low-Confidence Patient Profiles via Localized Harmful Covariate Shift Detection
Université de Sherbrooke(舍布鲁克大学);Montreal Children’s Hospital(蒙特利尔儿童医院);Research Institute of the McGill University Health Centre(麦吉尔大学健康中心研究所);McGill University(麦吉尔大学)
Semantic or Covariate? A Study on the Intractable Case of Out-of-Distribution Detection
Key Laboratory of AI Safety of CAS, Institute of Computing Technology(中国科学院计算技术研究所);Chinese Academy of Sciences (CAS)(中国科学院);University of Chinese Academy of Sciences(中国科学院大学)
TrustLoRA: Low-Rank Adaptation for Failure Detection under Out-of-distribution Data
CAIR-HKISI, Chinese Academy of Sciences(中国科学院CAIR-HKISI);MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所MAIS);School of Artificial Intelligence, UCAS(中国科学院大学人工智能学院)
Feed Two Birds with One Scone: Exploiting Wild Data for Both Out-of-Distribution Generalization and Detection
Institute for Foundations of Data Science, University of Wisconsin, Madison(数据科学基础研究院,威斯康星大学麦迪逊分校);Department of Computer Sciences, University of Wisconsin, Madison(计算机科学系,威斯康星大学麦迪逊分校);Department of Electrical and Computer Engineering, University of Wisconsin, Madison(电气与计算机工程系,威斯康星大学麦迪逊分校)