计算化学方法的概率性能估计:系统改进概率和排序概率矩阵。II。应用
Probabilistic performance estimators for computational chemistry methods: Systematic Improvement Probability and Ranking Probability Matrix. II. Applications
摘要:
在本研究的第一部分(论文I)中,我们引入了系统改进概率(SIP)作为评估两种计算化学方法之间切换时预期的绝对误差改进水平的工具。我们还开发了两个指标的基础上强大的统计,以解决排名的不确定性,在计算化学基准:Pinv,两个值之间的反转概率的统计,和Pr,排名概率矩阵。在这第二部分,这些指标适用于9个数据集提取的最近的基准文献。我们还说明了错误集之间的相关性可能包含有用的信息的基准数据集的质量,特别是当实验数据用作参考。
英文摘要:
In the first part of this study (Paper I), we introduced the systematic improvement probability (SIP) as a tool to assess the level of improvement on absolute errors to be expected when switching between two computational chemistry methods. We developed also two indicators based on robust statistics to address the uncertainty of ranking in computational chemistry benchmarks: Pinv , the inversion probability between two values of a statistic, and Pr , the ranking probability matrix. In this second part, these indicators are applied to nine data sets extracted from the recent benchmarking literature. We illustrate also how the correlation between the error sets might contain useful information on the benchmark dataset quality, notably when experimental data are used as reference.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。