arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.06376cs.PLcs.DBcs.LG
收藏

Functional Collection Programming with Semi-Ring Dictionaries

University of Edinburgh(爱丁堡大学);University of Oxford(牛津大学);University of Zurich(苏黎世大学)

Amir Shaikhha, Mathieu Huot, Jaclyn Smith, Dan Olteanu

英文摘要:

This paper introduces semi-ring dictionaries, a powerful class of compositional and purely functional collections that subsume other collection types such as sets, multisets, arrays, vectors, and matrices. We developed SDQL, a statically typed language that can express relational algebra with aggregations, linear algebra, and functional collections over data such as relations and matrices using semi-ring dictionaries. Furthermore, thanks to the algebraic structure behind these dictionaries, SDQL unifies a wide range of optimizations commonly used in databases (DB) and linear algebra (LA). As a result, SDQL enables efficient processing of hybrid DB and LA workloads, by putting together optimizations that are otherwise confined to either DB systems or LA frameworks. We show experimentally that a handful of DB and LA workloads can take advantage of the SDQL language and optimizations. SDQL can be competitive with or outperforms a host of systems that are state of the art in their own domain: in-memory DB systems Typer and Tectorwise for (flat, not nested) relational data; SciPy for LA workloads; sparse tensor compiler taco; the Trance nested relational engine; and the in-database machine learning engines LMFAO and Morpheus for hybrid DB/LA workloads over relational data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑