arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1909.12502stat.APq-bio.QMstat.ME
收藏

Bootstrap交叉验证改进药物计量学中的模型选择

Bootstrap Cross-validation Improves Model Selection in Pharmacometrics

James Stephens Cavenaugh

摘要:

交叉验证评估模型的预测能力,允许对模型进行相应的排名。虽然非参数bootstrap几乎总是用于评估参数的变异性,但如果在给定的bootstrap迭代中跟踪未选择的项目,则可以将其用作交叉验证的基础。选择的项目构成训练数据,省略的项目构成测试数据。这种自助交叉验证(BS-CV)允许通过比较测试数据汇总统计量的集合中位值,根据预测能力进行模型选择。本文使用几种汇总统计量(包括称为预测质量简单度量(SMPQ)的新统计量),并使用Monolix分布中包含的华法林数据(具有13个药代动力学(PK)模型和12个药效学(PD)模型)证明了BS-CV。值得注意的是,AIC的两个最佳PK模型具有最差的预测能力,强调了使用随机变量(如AIC)的单一实现作为模型选择基础的危险。使用这些数据,BS-CV能够区分类似的间接反应模型(输入抑制与输出刺激)。这在作用机制未知的情况下可能很有用(与华法林不同)。

英文摘要:

Cross-validation assesses the predictive ability of a model, allowing one to rank models accordingly. Although the nonparametric bootstrap is almost always used to assess the variability of a parameter, it can be used as the basis for cross-validation if one keeps track of which items were not selected in a given bootstrap iteration. The items which were selected constitute the training data and the omitted items constitute the testing data. This bootstrap cross-validation (BS-CV) allows model selection to be made on the basis of predictive ability by comparing the median values of ensembles of summary statistics of testing data. BS-CV is herein demonstrated using several summary statistics, including a new one termed the simple metric for prediction quality (SMPQ), and using the warfarin data included in the Monolix distribution with 13 pharmacokinetics (PK) models and 12 pharmacodynamics (PD) models. Of note the two best PK models by AIC had the worst predictive ability, underscoring the danger of using single realizations of a random variable (such as AIC) as the basis for model selection. Using these data BS-CV was able to discriminate between similar indirect response models (inhibition of input versus stimulation of output). This could be useful in situations in which the mechanism of action is unknown (unlike warfarin).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑