arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.05445cs.LG
收藏

用于分类的大语言模型增强机器学习估计器

Large Language Model Enhanced Machine Learning Estimators for Classification

University of California Berkeley(加州大学伯克利分校);University of Washington(华盛顿大学);Amazon(亚马逊)

Yuhang Wu, Yingfei Wang, Chu Wang, Zeyu Zheng

AI总结:

本文研究如何将预训练 LLM 集成到经典监督分类估计器中,提出多种增强方法,并在四个公开数据集的二分类与分布变化迁移学习任务中验证其可显著提升预测性能。

摘要:

预训练大语言模型(LLM)已成为一种强大工具,可用于模拟各种场景,并在给定特定指令和多模态输入时生成输出。在本工作中,我们分析了 LLM 在增强用于分类问题的经典监督机器学习方法方面的具体用途。我们提出了若干将 LLM 集成到经典机器学习估计器中的方法,以进一步提升预测性能。我们通过两类任务检验所提方法的性能:标准监督学习二分类任务,以及测试数据相对于训练数据存在分布变化的迁移学习任务。使用四个公开可用数据集开展的数值实验表明,利用 LLM 增强经典机器学习估计器能够显著改善预测性能。

英文摘要:

Pre-trained large language models (LLM) have emerged as a powerful tool for simulating various scenarios and generating output given specific instructions and multimodal input. In this work, we analyze the specific use of LLM to enhance a classical supervised machine learning method for classification problems. We propose a few approaches to integrate LLM into a classical machine learning estimator to further enhance the prediction performance. We examine the performance of the proposed approaches through both standard supervised learning binary classification tasks, and a transfer learning task where the test data observe distribution changes compared to the training data. Numerical experiments using four publicly available datasets are conducted and suggest that using LLM to enhance classical machine learning estimators can provide significant improvement on prediction performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑