MADlib is a free, open source library of in-database analytic methods. It provides an evolving suite of SQL-based algorithms for machine learning, data mining and statistics that run at scale within a database engine, with no need for data import/export to other tools. The goal is for MADlib to eventually serve a role for scalable database systems that is similar to the CRAN library for R: a community repository of statistical methods, this time written with scale and parallelism in mind. In this paper we introduce the MADlib project, including the background that led to its beginnings, and the motivation for its open source nature. We provide an overview of the library's architecture and design patterns, and provide a description of various statistical methods in that context. We include performance and speedup results of a core design pattern from one of those methods over the Greenplum parallel DBMS on a modest-sized test cluster. We then report on two initial efforts at incorporating academic research into MADlib, which is one of the project's goals. MADlib is freely available at http://madlib.net, and the project is open for contributions of both new methods, and ports to additional database platforms.
Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQL
Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算机系);Faculty of Data Science, City University of Macau(澳门城市大学数据科学学院);College of Cyber Security, Jinan University(暨南大学网络安全学院)
Learning a Partitioning Advisor with Deep Reinforcement Learning
Microsoft Azure SQL数据仓库或Amazon Redshift等商业数据分析产品为云中的OLAP式工作负载提供了即用型横向扩展数据库解决方案。虽然云提供商通常会完全自动化数据库集群的配置,但客户通常仍然需要做出重要的设计决策,这些决策通常由数据库管理员做出,例如选择分区方案。在本文中,我们介绍了一种基于深度强化学习(DRL)的分析OLAP风格工作负载的学习分区顾问。其主要思想是DRL代理通过监视不同工作负载和分区方案的奖励来根据经验学习决策。我们评估我们的经验教训分区顾问在不同的数据库模式和工作负载的不同复杂性的实验评估。在评估中,我们表明,我们的顾问不仅能够找到优于现有自动分区设计方法的分区,而且还可以轻松地适应不同的部署。这在云设置中尤其重要,客户可以轻松地将其集群迁移到一组新的(虚拟)机器。
Scalability of Data Binding in ASP.NET Web Applications
ASP.NET Web应用程序通常使用服务器控件来提供动态网页,并使用数据绑定服务器控件来显示和维护数据库数据。大多数开发人员在开发Web应用程序时使用ASP.NET服务器控件的默认属性,这允许快速开发可行的应用程序。但是,创建高性能、多用户和可伸缩的Web应用程序需要使用自定义代码增强服务器控件。在这项实证研究中,我们评估了各种技术方法对数据驱动的ASP.NET Web应用程序中分页和排序功能的影响:Web服务器上的Web服务器控件中的自动数据分页和排序;数据库服务器上的分页和排序;索引和非索引数据库列;集群与非集群索引。当使用基于SQL存储过程和聚集索引的自定义分页时,我们观察到显著的性能改进。