arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.18490cs.LGstat.ML
收藏

降秩多目标策略学习与优化

Reduced-Rank Multi-objective Policy Learning and Optimization

University of California, Berkeley(加利福尼亚大学伯克利分校);University of Southern California(南加利福尼亚大学)

Ezinne Nwankwo, Michael I. Jordan, Angela Zhou

AI总结:

提出基于降秩回归的多目标策略学习降维方法,通过学习低维表示对多结果去噪,降低估计误差并提升最优策略评估与优化性能。

摘要:

评估可能干预措施的因果影响对于决策至关重要,尤其是在改善机会获取方面。然而,如果因果效应是异质的且可从协变量中预测,个性化处理决策可以改善个体结果,并有助于提升效率与公平性。但在实践中,因果研究者事先并没有单一的结果目标,往往收集多个感兴趣的结果,这些结果是真实目标的有噪估计。例如,在政府资助的社会福利项目中,政策制定者收集许多结果以理解贫困的多维性质。最终目标是学习一种最优处理策略,在某种意义上同时最大化多个结果。为解决这些问题,我们提出了一种数据驱动的降维方法,用于多目标最优策略学习中的多结果处理。我们使用降秩回归从观测结果中学习真实结果的低维表示。我们开发了一套使用该模型对观测结果去噪的估计方法,包括常用的指数加权方法。这些方法在策略评估和优化中降低了估计误差,包括在现实世界现金转移支付和社会干预数据的案例研究中。降低有噪社会结果的方差可以改善算法分配的性能。

英文摘要:

Evaluating the causal impacts of possible interventions is crucial for informing decision-making, especially towards improving access to opportunity. However, if causal effects are heterogeneous and predictable from covariates, personalized treatment decisions can improve individual outcomes and contribute to both efficiency and equity. In practice, however, causal researchers do not have a single outcome in mind a priori and often collect multiple outcomes of interest that are noisy estimates of the true target of interest. For example, in government-assisted social benefit programs, policymakers collect many outcomes to understand the multidimensional nature of poverty. The ultimate goal is to learn an optimal treatment policy that in some sense maximizes multiple outcomes simultaneously. To address such issues, we present a data-driven dimensionality-reduction methodology for multiple outcomes in the context of optimal policy learning with multiple objectives. We learn a low-dimensional representation of the true outcome from the observed outcomes using reduced rank regression. We develop a suite of estimates that use the model to denoise observed outcomes, including commonly-used index weightings. These methods improve estimation error in policy evaluation and optimization, including on a case study of real-world cash transfer and social intervention data. Reducing the variance of noisy social outcomes can improve the performance of algorithmic allocations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑