Identifying covariate shift is crucial for making machine learning systems robust in the real world and for detecting training data biases that are not reflected in test data. However, detecting covariate shift is challenging, especially when the data consists of high-dimensional images, and when multiple types of localized covariate shift affect different subspaces of the data. Although automated techniques can be used to detect the existence of covariate shift, our goal is to help human users characterize the extent of covariate shift in large image datasets with interfaces that seamlessly integrate information obtained from the detection algorithms. In this paper, we design and evaluate a new visual interface that facilitates the comparison of the local distributions of training and test data. We conduct a quantitative user study on multi-attribute facial data to compare two different learned low-dimensional latent representations (pretrained ImageNet CNN vs. density ratio) and two user analytic workflows (nearest-neighbor vs. cluster-to-cluster). Our results indicate that the latent representation of our density ratio model, combined with a nearest-neighbor comparison, is the most effective at helping humans identify covariate shift.
Contrastive Balancing Representation Learning for Heterogeneous Dose-Response Curves Estimation
Zhejiang University(浙江大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Peking University(北京大学);Emory University(埃默里大学);Tsinghua University(清华大学);Didi Chuxing(滴滴出行)
Self-supervised contrastive learning performs non-linear system identification
Institute of Computational Biology, Computational Health Center, Helmholtz Munich and Munich Center for Machine Learning (MCML)(计算生物学研究所、计算健康中心、海德堡慕尼黑和慕尼黑机器学习中心)
Contrastive Masked Autoencoders for Character-Level Open-Set Writer Identification
University of Technology Sydney(悉尼科技大学);Australian AI Institute(澳大利亚人工智能研究所);School of Computer Science, Faculty of Engineering and Information Technology, University of Technology Sydney(悉尼科技大学工程与信息技术学院计算机科学学院)
Acoustic identification of individual animals with hierarchical contrastive learning
Centre for Digital Music, Queen Mary University of London(伦敦大学玛丽皇后学院数字音乐中心);IMT Atlantique(IMT大西洋高等电信学院);CNRS(法国国家科学研究中心);Lab-STICC(信息、信号与智能系统实验室);Tilburg University(蒂尔堡大学)
Identification of morphological fingerprint in perinatal brains using quasi-conformal mapping and contrastive learning
Lanzhou University(兰州大学);Zhejiang University(浙江大学);Hangzhou Normal University(杭州师范大学);Lanzhou Jiaotong University(兰州交通大学);Binjiang Institute of Zhejiang University(浙江大学滨江研究院)
Masked Graph Autoencoders with Contrastive Augmentation for Spatially Resolved Transcriptomics Data
School of Information Science and Engineering, Yunnan University(云南大学信息科学与工程学院);College of Nursing Health Sciences, Yunnan Open University(云南开放大学护理与健康科学学院)
Attenuated in-context identification in time-series foundation models: diagnosis under counterfactual inputs and repair by synthetic forced-system fine-tuning
Korea Institute of Industrial Technology(韩国生产技术研究院);Hanyang University(汉阳大学)