AI 中文总结
该研究提出名为Oasis的智能网卡，将Parquet解码卸载到网络数据路径，实现与DuckDB端到端集成，可降低解码开销，最优时DuckDB查询吞吐量近翻倍。
AI 中文摘要
云原生数据库系统通过弹性和资源池将计算与存储资源分离，相比传统单体架构提升了成本效率。生产数据仓库工作负载研究显示，扫描操作（包括往返存储的开销）约占总查询运行时间的一半。数据湖和湖仓一体架构因每次查询都需解码Parquet等存储优化的压缩文件格式，进一步加剧了这一瓶颈。随着存储和网络带宽持续超过CPU的性价比，用于解码的CPU周期正逐渐削弱云计算的成本效率优势，这促使整个技术栈出现了一波专业化浪潮，极端情况是云厂商级的定制硬件。我们顺应这一趋势，提出了Oasis，这是一款数据处理智能网卡（SmartNIC），将Parquet解码作为定制硬件加速器卸载到网络数据路径中。Oasis具备硬件解码器架构、软件抽象层，并与DuckDB实现了端到端集成。评估结果表明，Oasis以极小的开销将Parquet解码的成本隐藏在网络数据路径之后，使扫描操作与查询执行的其余部分重叠；在最优情况下，这几乎使DuckDB的查询吞吐量提升了一倍。
英文摘要
Cloud-native database systems disaggregate compute and storage resources to improve cost efficiency over traditional monolithic architectures through elasticity and resource pooling. Studies of production data warehouse workloads show that scans (including round trips to storage) account for roughly half of total query runtime. Data lakes and lakehouses amplify this bottleneck through per-query decoding of storage-optimized, compressed file formats such as Parquet. As storage and network bandwidth continue to outpace CPU cost-performance, the CPU cycles spent on decoding increasingly undermine the cloud's cost-efficiency promise. This has led to a wave of specialization across the stack with custom hardware at cloud-vendor scale at the extreme end. We build on this trend and present Oasis, a data-processing SmartNIC that offloads Parquet decoding into the network datapath as a custom hardware accelerator. Oasis features a hardware decoder architecture, software abstraction layer, and end-to-end integration with DuckDB. Our evaluation shows that Oasis hides the cost of Parquet decoding behind the network datapath with minimal overhead, overlapping the scan with the remainder of the query execution. In the best case, this almost doubles DuckDB query throughput.
