fplyr:R中大数据的拆分-应用-合并策略
fplyr: the split-apply-combine strategy for big data in R
摘要:
我们提出了一个新的R语言处理大文件的软件包fbur。它允许用户轻松地实现拆分-应用-合并策略,用于太大而无法容纳可用内存的文件,而无需依赖数据库或引入非原生R类。自定义函数可以独立应用于每组观测,结果可以返回或直接打印到一个或多个输出文件。
英文摘要:
We present fplyr, a new package for the R language to deal with big files. It allows users to easily implement the split-apply-combine strategy for files that are too big to fit into the available memory, without relying on data bases nor introducing non-native R classes. A custom function can be applied independently to each group of observations, and the results may be either returned or directly printed to one or more output files.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。