SemPipes -- 可优化的语义数据运算符用于表格机器学习流水线
SemPipes -- Optimizable Semantic Data Operators for Tabular Machine Learning Pipelines
AI总结:
SemPipes通过LLM驱动的语义数据运算符提升表格机器学习流水线的预测性能和效率。
摘要:
现实世界中对表格数据进行机器学习依赖于复杂的数据准备流水线进行预测、数据整合、增强和调试。设计这些流水线需要大量的领域专业知识和工程努力,这促使了关于如何通过代码合成让大型语言模型(LLMs)支持表格ML的问题。我们介绍了SemPipes,一种新的声明式编程模型,它将LLM驱动的语义数据运算符整合到表格ML流水线中。语义运算符用自然语言指定数据转换,同时将执行委托给运行时系统。在训练过程中,SemPipes根据数据特征、运算符指令和流水线上下文合成定制的运算符实现。这种设计通过LLM驱动的代码合成和进化搜索指导,实现了流水线中数据操作的自动优化。我们评估了SemPipes在多样化的表格ML任务中的表现,并展示了语义运算符在专家设计和代理生成的流水线中显著提高了端到端的预测性能,同时减少了流水线的复杂性。我们用Python实现了SemPipes,并在https://github.com/deem-data/sempipes/tree/v1上发布了。
英文摘要:
Real-world machine learning on tabular data relies on complex data preparation pipelines for prediction, data integration, augmentation, and debugging. Designing these pipelines requires substantial domain expertise and engineering effort, motivating the question of how large language models (LLMs) can support tabular ML through code synthesis. We introduce SemPipes, a novel declarative programming model that integrates LLM-powered semantic data operators into tabular ML pipelines. Semantic operators specify data transformations in natural language while delegating execution to a runtime system. During training, SemPipes synthesizes custom operator implementations based on data characteristics, operator instructions, and pipeline context. This design enables the automatic optimization of data operations in a pipeline via LLM-based code synthesis guided by evolutionary search. We evaluate SemPipes across diverse tabular ML tasks and show that semantic operators substantially improve end-to-end predictive performance for both expert-designed and agent-generated pipelines, while reducing pipeline complexity. We implement SemPipes in Python and release it at https://github.com/deem-data/sempipes/tree/v1.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。