Aggregate outcome variables collected through surveys and administrative records are often subject to systematic measurement error. For instance, in disaster loss databases, county-level losses reported may differ from the true damages due to variations in on-the-ground data collection capacity, reporting practices, and event characteristics. Such miscalibration complicates downstream analysis and decision-making. We study the problem of outcome miscalibration and propose a framework guided by proxy variables for estimating and correcting the systematic errors. We model the data-generating process using a causal graph that separates latent content variables driving the true outcome from the latent bias variables that induce systematic errors. The key insight is that proxy variables that depend on the true outcome but are independent of the bias mechanism provide identifying information for quantifying the bias. Leveraging this structure, we introduce a two-stage approach that utilizes variational autoencoders to disentangle content and bias latents, enabling us to estimate the effect of bias on the outcome of interest. We analyze the assumptions underlying our approach and evaluate it on synthetic data, semi-synthetic datasets derived from randomized trials, and a real-world case study of disaster loss reporting.
Ten Words Only Still Help: Improving Black-Box AI-Generated Text Detection via Proxy-Guided Efficient Re-Sampling
Key Lab of Intelligent Information Processing of Chinese Academy of Sciences(中国科学院智能信息处理重点实验室);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Xi’an Jiaotong University(西安交通大学)
CALIBUDGET: Calibration-Guided Source Allocation for Fixed-Budget Mixed-Reasoning Adaptation
School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);Key Laboratory of Symbolic Computation and Knowledge Engineering, Jilin University(吉林大学符号计算与知识工程重点实验室)
Jishou University(吉首大学);Technical University of Munich(慕尼黑技术大学);Renmin University of China(中国人民大学);Northwestern Polytechnical University(西北工业大学);South China Agricultural University(华南农业大学);University of Science and Technology of China(中国科学技术大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学)
EDUE: Expert Disagreement-Guided One-Pass Uncertainty Estimation for Medical Image Segmentation
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Applied Sciences Western Switzerland (HES-SO)(瑞士西部应用科学大学(HES-SO))
Projection-Domain Sensitivity Analysis of Vertebral DRRs Under Intrinsic Calibration Perturbation
Department of Mathematics, Tulane University(特伦特大学数学系);Department of Computer Science, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校计算机科学系);EOS, EOS Imaging Inc.(EOS公司);Department of Electrical and Computer Engineering, Vanderbilt University(范德比大学电气与计算机工程系);Department of Computer Science, Vanderbilt University(范德比大学计算机科学系)