ASAP：通过应用语义感知处理重构数据生命周期
ASAP: Reimagining the Data Lifecycle using Application Semantic-Aware Processing
浏览论文内容
中文总结 AI 辅助
本文提出ASAP范式，将应用语义感知处理作为数据处理管道核心设计原则，可实现跨生命周期优化、利用跨领域原语，初步显示其能使CSP权衡比提升高达3个数量级。
中文摘要 AI 辅助
在可观测性、网络、安全等众多领域，数据处理管道面临我们所称的CSP问题：在大规模场景下实现低成本，同时保持高性能。针对这一问题，目前已有多项工作在“采集-传输-存储-分析”数据生命周期的不同阶段开展，例如数据库中的近似查询处理（AQP）、网络路由器中的草图（sketches）技术等。本研究基于“见树又见林”的核心洞见：这些解决CSP问题的方案（如AQP、草图、压缩、汇总（rollups））均具备一个共同特性——它们利用了保留语义的机会来满足应用需求。本文提出ASAP范式，将应用语义感知处理（Application Semantic-Aware Processing，ASAP）作为数据处理管道的核心设计原则。我们认为，通过跨不同领域开发的ASAP原语、跨整个数据生命周期的统一视角，可挖掘解决CSP问题的新机会，具体包括：（i）实现跨生命周期的新型优化，例如直接对数据源生成的草图进行分析；（ii）利用其他应用领域开发的原语；（iii）推动这些强大技术的广泛应用。我们探讨了推广ASAP范式优势所面临的研究挑战，并展示了初步证据：在众多应用领域采用ASAP可使CSP权衡比提升高达3个数量级。
英文摘要
Across many domains (e.g., observability, networking, security), data processing pipelines face what we refer to as the CSP problem: achieving low Cost at large Scale, while maintaining high Performance. In response, we see several efforts to tackle CSP in various stages of the Collect-Transmit-Store-Analyze data lifecycle; such as approximate query processing in databases or sketches in network routers. Our work is driven by the simple insight: "seeing the forest for the trees". These proposed solutions (e.g., AQP, sketching, compression, rollups) addressing CSP share a common property - they exploit semantic-preserving opportunities to support application needs. In this paper, we make a case for ASAP, a paradigm that makes Application Semantic-Aware Processing (ASAP) a first-class design principle in data processing pipelines. We argue that by taking a unified view across ASAP primitives developed in different domains, across the entire data lifecycle, we can unlock new opportunities to tackle the CSP problem. In particular, we can: (i) enable novel cross-lifecycle optimizations such as analytics run directly on sketches computed at the source; (ii) leverage primitives developed in other application domains; and (iii) enable widespread adoption of these powerful techniques. We discuss research challenges in socializing the benefits of the ASAP paradigm, and show preliminary evidence that adopting ASAP can yield up to 3 orders of magnitude improvements in the CSP tradeoff for many application domains.
