仅压缩一次:用于估计线性模型的最佳数据压缩
You Only Compress Once: Optimal Data Compression for Estimating Linear Models
摘要:
线性模型用于在线决策制定,例如机器学习、策略算法和实验平台。许多使用线性模型的工程系统通过分布式系统和专家配置来实现计算效率。虽然这种方法有其优点,但仍然很难有一个环境,使研究人员能够交互式地分析和探索数据和模型,并利用开源社区的分析解决方案。因此,创新可能会受到阻碍。一致性充分统计量是一种统一的数据压缩和估计策略,可用于模型开发过程以及工程部署过程。该策略从压缩数据中估计线性模型,而不会损失估计的参数及其协方差,即使在观测聚类中误差自相关。此外,压缩几乎保留了与原始数据的所有交互,为研究人员和工程系统带来了更高的生产力。
英文摘要:
Linear models are used in online decision making, such as in machine learning, policy algorithms, and experimentation platforms. Many engineering systems that use linear models achieve computational efficiency through distributed systems and expert configuration. While there are strengths to this approach, it is still difficult to have an environment that enables researchers to interactively iterate and explore data and models, as well as leverage analytics solutions from the open source community. Consequently, innovation can be blocked. Conditionally sufficient statistics is a unified data compression and estimation strategy that is useful for the model development process, as well as the engineering deployment process. The strategy estimates linear models from compressed data without loss on the estimated parameters and their covariances, even when errors are autocorrelated within clusters of observations. Additionally, the compression preserves almost all interactions with the the original data, unlocking better productivity for both researchers and engineering systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。