arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2602.24231cs.LG
收藏

自适应组合实验设计:决策与推断的帕累托最优性

Adaptive Combinatorial Experimental Design: Pareto Optimality for Decision-Making and Inference

University of Science and Technology of China(中国科学技术大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校);Arizona State University(亚利桑那州立大学)

Hongrui Xie, Junyu Cao, Kan Xu

AI总结:

本文提出 MixCombKL 和 MixCombUCB 算法,通过帕累托最优性在组合多臂老虎机中实现 regret 最小化与统计功效的平衡。

摘要:

本文首次探讨了自适应组合实验设计,重点在于探索 regret 最小化与统计功效之间的权衡问题,在组合多臂老虎机(CMAB)中。虽然最小化 regret 需要反复利用高收益臂,但准确推断收益差距需要充分探索次优动作。我们通过帕累托最优的概念来形式化这种权衡,并在 CMAB 中建立了帕累托高效学习的等价条件。我们考虑了两种相关情况,即全带反馈和半带反馈,并分别提出了 MixCombKL 和 MixCombUCB 两种算法。我们提供了理论保证,证明这两种算法都是帕累托最优的,实现了对 regret 和臂间隙估计误差的有限时间保证。我们的结果进一步揭示,更丰富的反馈显著收紧了可达到的帕累托前沿,主要收益来自于我们提出方法下的改进估计精度。总的来说,这些发现建立了一个有原则的框架,用于多目标决策中的自适应组合实验。

英文摘要:

In this paper, we provide the first investigation into adaptive combinatorial experimental design, focusing on the trade-off between regret minimization and statistical power in combinatorial multi-armed bandits (CMAB). While minimizing regret requires repeated exploitation of high-reward arms, accurate inference on reward gaps requires sufficient exploration of suboptimal actions. We formalize this trade-off through the concept of Pareto optimality and establish equivalent conditions for Pareto-efficient learning in CMAB. We consider two relevant cases under different information structures, i.e., full-bandit feedback and semi-bandit feedback, and propose two algorithms MixCombKL and MixCombUCB respectively for these two cases. We provide theoretical guarantees showing that both algorithms are Pareto optimal, achieving finite-time guarantees on both regret and estimation error of arm gaps. Our results further reveal that richer feedback significantly tightens the attainable Pareto frontier, with the primary gains arising from improved estimation accuracy under our proposed methods. Taken together, these findings establish a principled framework for adaptive combinatorial experimentation in multi-objective decision-making.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑