arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1108.5338stat.ME
收藏

动态治疗方案的惩罚Q学习

Penalized Q-Learning for Dynamic Treatment Regimes

Rui Song, Weiwei Wang, Donglin Zeng, Michael R. Kosorok

摘要:

动态治疗方案有效地结合了专门设计的临床试验的累积信息和长期治疗效果。随着这些与来自临床研究的纵向数据结合变得越来越流行,最佳动态治疗方案的统计推断的发展是高度优先的。由于处理效应参数中的非线性引起的困难,这是非常具有挑战性的。在本文中,我们提出了一个新的强化学习框架称为惩罚Q学习(PQ学习),在此框架下,可以解决非线性和有效的统计推断建立。我们还提出了一个新的统计过程-个人选择-和相应的方法,将个人选择PQ学习。广泛的数值研究,提出了与现有的方法相比,在各种非常规的情况下,所提出的方法是inconvenient和计算上的优势。所提出的方法证明了抑郁症的临床试验研究的数据。

英文摘要:

A dynamic treatment regime effectively incorporates both accrued information and long-term effects of treatment from specially designed clinical trials. As these become more and more popular in conjunction with longitudinal data from clinical studies, the development of statistical inference for optimal dynamic treatment regimes is a high priority. This is very challenging due to the difficulties arising form non-regularities in the treatment effect parameters. In this paper, we propose a new reinforcement learning framework called penalized Q-learning (PQ-learning), under which the non-regularities can be resolved and valid statistical inference established. We also propose a new statistical procedure---individual selection---and corresponding methods for incorporating individual selection within PQ-learning. Extensive numerical studies are presented which compare the proposed methods with existing methods, under a variety of non-regular scenarios, and demonstrate that the proposed approach is both inferentially and computationally superior. The proposed method is demonstrated with the data from a depression clinical trial study.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑