低成本学习:利用最少数据最大化语言模型在社会数据科学中的性能
Cheap Learning: Maximising Performance of Language Models for Social Data Science Using Minimal Data
AI总结:
本文综述弱监督、迁移学习与提示工程三种低标注学习方法,并通过六类社会科学任务验证其低成本、高准确率效果,尤其肯定LLM零样本提示的价值。
摘要:
机器学习领域近年来在降低构建新模型时对标注训练数据的需求方面取得了显著进展。这些“更廉价”的学习技术在社会科学中具有巨大潜力,因为在社会科学中,构建大型标注训练数据集往往是将机器学习用于分析任务的重大实际障碍。本文综述了近年来发展起来的三种“廉价”技术:弱监督、迁移学习和提示工程。对于提示工程,我们还综述了对大型语言模型进行零样本提示这一特殊情形。对于每一种技术,我们都提供了其工作原理指南,并在六个不同的真实社会科学应用中展示其应用(两种不同任务与三种不同数据集构成相配对)。我们展示了所有技术的良好性能,尤其展示了对大型语言模型进行提示如何能够以极低成本实现高准确率。我们的结果附有一个代码仓库,便于他人复现我们的工作并在其自身研究中使用。总体而言,本文旨在推动这些技术在社会科学中的进一步采用。
英文摘要:
The field of machine learning has recently made significant progress in reducing the requirements for labelled training data when building new models. These `cheaper' learning techniques hold significant potential for the social sciences, where development of large labelled training datasets is often a significant practical impediment to the use of machine learning for analytical tasks. In this article we review three `cheap' techniques that have developed in recent years: weak supervision, transfer learning and prompt engineering. For the latter, we also review the particular case of zero-shot prompting of large language models. For each technique we provide a guide of how it works and demonstrate its application across six different realistic social science applications (two different tasks paired with three different dataset makeups). We show good performance for all techniques, and in particular we demonstrate how prompting of large language models can achieve high accuracy at very low cost. Our results are accompanied by a code repository to make it easy for others to duplicate our work and use it in their own research. Overall, our article is intended to stimulate further uptake of these techniques in the social sciences.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。