具有两种不精确表现形式的数据模型
Data Models With Two Manifestations of Imprecision
AI总结:
本文提出放宽 i.i.d. 假设、由概率测度集合参数化的数据模型,刻画聚合与局部(不)正则性的相互作用,并探讨其估计、机器学习应用及对评分规则与校准推广的意义。
摘要:
受机器学习和统计学中近期涌现问题的启发,我们提出了放宽常见 i.i.d.(独立同分布)假设的数据模型。本质上,我们试图理解数据来自一组概率测度意味着什么。我们表明,由此类集合参数化的频率派数据模型表现出不精确性的两个方面。我们刻画了这些表现形式——聚合(不)正则性与局部(不)正则性——之间错综复杂的相互作用,其中可能出现比 i.i.d. 模型丰富得多的行为集合。在此过程中,我们揭示了非平稳、局部精确的数据模型与平稳、局部不精确的数据模型之间关系的新认识。我们讨论了这些数据模型在机器学习中的可能应用,以及应如何估计概率集合。对于聚合非正则性的估计,我们给出了一个负面结果,但论证认为这并不值得悲观。理解不精确概率的这些频率派方面,为推导适当评分规则的推广以及不精确情形下的校准铺平了道路,进而有助于解决实际问题。
英文摘要:
Motivated by recently emerging problems in machine learning and statistics, we propose data models which relax the familiar i.i.d. assumption. In essence, we seek to understand what it means for data to come from a set of probability measures. We show that our frequentist data models, parameterized by such sets, manifest two aspects of imprecision. We characterize the intricate interplay of these manifestations, aggregate (ir)regularity and local (ir)regularity, where a much richer set of behaviours compared to an i.i.d. model is possible. In doing so we shed new light on the relationship between non-stationary, locally precise and stationary, locally imprecise data models. We discuss possible applications of these data models in machine learning and how the set of probabilities can be estimated. For the estimation of aggregate irregularity, we provide a negative result but argue that it does not warrant pessimism. Understanding these frequentist aspects of imprecise probabilities paves the way for deriving generalization of proper scoring rules and calibration to the imprecise case, which can then contribute to tackling practical problems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。