arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1803.06336stat.AP
收藏

在度量分析中应用Delta方法:具有新颖想法的实用指南

Applying the Delta method in metric analytics: A practical guide with novel ideas

Alex Deng, Ulf Knoblich, Jiannan Lu

摘要:

在过去的十年中,信息技术行业采用了数据驱动的文化,依靠在线指标来衡量和监控业务绩效。在大数据的背景下,大多数此类指标近似遵循正态分布,这为直接建模提供了潜在的机会,而无需额外的模型假设,并使用分布式算法通过封闭式公式解决大数据问题,而成本仅为基于模拟的程序(如bootstrap)的一小部分。然而,某些属性的指标,如其相应的数据生成过程和聚合水平,构建值得信赖的估计和推理程序带来了许多挑战。受大规模A/B测试的度量开发和分析中的四个现实例子的启发,我们提供了一个实用指南,用于应用Delta方法,经典统计文献中最重要的工具之一,以解决上述挑战。我们强调三角洲方法在度量分析中的核心作用,突出其经典和新颖的应用。

英文摘要:

During the last decade, the information technology industry has adopted a data-driven culture, relying on online metrics to measure and monitor business performance. Under the setting of big data, the majority of such metrics approximately follow normal distributions, opening up potential opportunities to model them directly without extra model assumptions and solve big data problems via closed-form formulas using distributed algorithms at a fraction of the cost of simulation-based procedures like bootstrap. However, certain attributes of the metrics, such as their corresponding data generating processes and aggregation levels, pose numerous challenges for constructing trustworthy estimation and inference procedures. Motivated by four real-life examples in metric development and analytics for large-scale A/B testing, we provide a practical guide to applying the Delta method, one of the most important tools from the classic statistics literature, to address the aforementioned challenges. We emphasize the central role of the Delta method in metric analytics by highlighting both its classic and novel applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑