arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.01022cs.CLcs.AI
收藏

UniGen:基于零样本数据集生成的情感分类通用领域泛化

UniGen: Universal Domain Generalization for Sentiment Classification via Zero-shot Dataset Generation

Chung-Ang University(中央大学)

Juhwan Choi, Yeonghwa Kim, Seunguk Yu, JungMin Yun, YoungBin Kim

AI总结:

本文提出UniGen方法,通过零样本数据集生成实现情感分类的通用领域泛化,使微型任务模型能泛化到任意共享标签空间的领域,在参数规模远小于PLMs的同时实现高效跨领域推理。

摘要:

尽管预训练语言模型在基于提示的少样本学习中展现出了极大的灵活性和通用性,但它们面临着参数规模庞大和推理适用性有限的问题。最近的研究建议将PLMs用作数据集生成器,并训练一个微型任务专用模型以实现高效推理。然而,它们对各种领域的适用性有限,因为它们倾向于生成特定领域的数据集。在这项工作中,我们提出了一种用于通用领域泛化的新方法,该方法生成数据集时不受目标领域限制。这使得微型任务模型能够泛化到任何共享标签空间的领域,从而增强了数据集生成范式的现实适用性。我们的实验表明,所提出的方法在使用比PLMs小数个数量级的参数集的情况下,实现了跨各种领域的泛化能力。

英文摘要:

Although pre-trained language models have exhibited great flexibility and versatility with prompt-based few-shot learning, they suffer from the extensive parameter size and limited applicability for inference. Recent studies have suggested that PLMs be used as dataset generators and a tiny task-specific model be trained to achieve efficient inference. However, their applicability to various domains is limited because they tend to generate domain-specific datasets. In this work, we propose a novel approach to universal domain generalization that generates a dataset regardless of the target domain. This allows for generalization of the tiny task model to any domain that shares the label space, thus enhancing the real-world applicability of the dataset generation paradigm. Our experiments indicate that the proposed method accomplishes generalizability across various domains while using a parameter set that is orders of magnitude smaller than PLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑