arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.09887stat.COstat.AP
收藏

动态分组的Split-Apply-Combine

Split-Apply-Combine with Dynamic Grouping

Statistics Netherlands(荷兰统计局);Leiden University(莱顿大学)

Mark P. J. van der Loo

AI总结:

本文提出R包accumulate,实现动态分组的Split-Apply-Combine操作,支持根据用户定义条件自动合并子集以提高汇总计算的稳定性。

摘要:

按数据集的一个或多个属性进行分区,并为每个部分计算汇总值,是数据处理中最常见的操作之一。存在一些用例,其中分区是通过将较小的子集合并到较大的子集来动态确定的,以确保计算汇总值的充分支持。这些用例目前不被实现split-apply-combine类型操作的软件支持。本文提出了R包accumulate,它提供了方便的接口,用于定义分组汇总,其中分组本身是根据用户定义的子集条件动态确定的,并且用户可以定义子集合并方案。正式的底层算法也进行了描述和分析。

英文摘要:

Partitioning a data set by one or more of its attributes and computing an aggregate for each part is one of the most common operations in data analyses. There are use cases where the partitioning is determined dynamically by collapsing smaller subsets into larger ones, to ensure sufficient support for the computed aggregate. These use cases are not supported by software implementing split-apply-combine types of operations. This paper presents the \texttt{R} package \texttt{accumulate} that offers convenient interfaces for defining grouped aggregation where the grouping itself is dynamically determined, based on user-defined conditions on subsets, and a user-defined subset collapsing scheme. The formal underlying algorithm is described and analyzed as well.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑