arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2003.12427stat.MEstat.ML
收藏

鲁棒Q学习

Robust Q-learning

Ashkan Ertefaie, James R. McKay, David Oslin, Robert L. Strawderman

摘要:

Q学习是一种基于回归的方法,广泛用于形式化最佳动态治疗策略的开发。有限维工作模型通常用于估计某些干扰参数,并且这些工作模型的错误指定可能导致残余混杂和/或效率损失。我们提出了一个强大的Q-学习方法,允许使用数据自适应技术来估计这些讨厌的参数。我们研究了我们的估计量的渐近行为,并提供模拟研究,强调在实践中所提出的方法的必要性和实用性。我们使用的数据从“延长纳洛酮的治疗效果”多阶段随机试验来说明我们提出的方法。

英文摘要:

Q-learning is a regression-based approach that is widely used to formalize the development of an optimal dynamic treatment strategy. Finite dimensional working models are typically used to estimate certain nuisance parameters, and misspecification of these working models can result in residual confounding and/or efficiency loss. We propose a robust Q-learning approach which allows estimating such nuisance parameters using data-adaptive techniques. We study the asymptotic behavior of our estimators and provide simulation studies that highlight the need for and usefulness of the proposed method in practice. We use the data from the "Extending Treatment Effectiveness of Naltrexone" multi-stage randomized trial to illustrate our proposed methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑