arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.20342cs.LG
收藏

任务感知插补何时重要?训练-测试不匹配下的鲁棒性分析

When Does Task-Aware Imputation Matter? An Analysis of Robustness Under Train-Test Mismatch

INESC TEC(TEC研究所);University of Porto(波尔图大学)

Maria V. Salvador, Ana F. Sequeira, Jaime S. Cardoso

AI总结:

该研究针对训练-测试不匹配下的缺失数据问题,提出任务感知插补的统一框架,经98个表格数据集实验验证,其在挑战性场景中胜率最高达80%,可提升模型鲁棒性。

摘要:

缺失数据是机器学习中普遍存在的挑战,常降低预测性能并增加模型部署的复杂度。现有多数方法将插补视为独立于下游任务的预处理步骤,当缺失机制或比例存在训练-测试不匹配时,这种分离会产生问题。我们提出统一框架,将缺失条目视为任务条件优化问题中的变量,在两种场景下实例化该框架:适用于训练和测试阶段均存在缺失数据的摊销方法,以及仅训练数据不完整时的潜在优化方法。评估在98个表格数据集上开展,针对36个数据集评估训练-测试不匹配下的鲁棒性。结果显示,重构误差无法有效替代预测效用(斯皮尔曼相关系数rho约为0.16至0.32),且在经典方法无法恢复完整数据性能的场景中,任务感知插补变得至关重要,在具有挑战性的训练-测试不匹配场景中胜率最高达80%。

英文摘要:

Missing data is a pervasive challenge in machine learning, often degrading predictive performance and complicating model deployment. Most existing approaches treat imputation as a preprocessing step independent of the downstream task, a separation that becomes problematic under train-test mismatches in missingness mechanisms or rates. We introduce a unified framework that treats missing entries as variables in a task-conditioned optimization problem. We instantiate this framework in two settings: an amortized approach for scenarios with missing data at both training and test time, and a latent optimization approach for settings where only training data is incomplete. The evaluation is conducted on 98 tabular datasets, and robustness under train-test mismatches is assessed on 36 datasets. Results reveal that reconstruction error constitutes a poor proxy for predictive utility (Spearman rho approximately 0.16 to 0.32), and that task-aware imputation becomes critical in scenarios where classical methods fail to recover complete-data performance, achieving win rates of up to 80% in challenging train-test mismatch scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑