arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.03223cs.CL
收藏

在基于自然语言推理的零样本情感分类中,英文提示词比目标语言提示词效果更好

English Prompts are Better for NLI-based Zero-Shot Emotion Classification than Target-Language Prompts

University of Stuttgart(斯图加特大学);University of Bamberg(班贝格大学);University of the Basque Country(巴斯克大学)

Patrick Bareiß, Roman Klinger, Jeremy Barnes

AI总结:

针对非英文文本零样本情感分类的提示语言选择问题,研究通过基于自然语言推理的多语言大模型实验发现,使用英文提示的效果始终优于目标语言提示,填补了相关研究空白。

摘要:

文本情感分类是一项具有挑战性的任务,因为解读潜在情感刺激的文本描述涉及复杂的认知过程。此外,情感类别集合具有高度的领域特异性。例如,文学分析可能需要用到审美情感(比如觉得某事物很美),社交媒体分析则能从细粒度情感集合中获益(比如区分愤怒和恼怒),而非仅采用Paul Ekman提出的基本情感类别(愤怒、厌恶、恐惧、喜悦、惊讶、悲伤)。这使得该任务成为零样本分类的一个有趣研究领域,这类任务的标签集合在模型开发阶段是未知的。遗憾的是,大多数情感分析资源都是英文的,因此大多数情感分析研究都以英文开展,包括那些通过提示语言模型获取文本标签的研究。这就留下了我们在本文中要解决的研究空白:对于非英文文本,我们应该用哪种语言来提示获取情感标签?当我们能使用多语言大语言模型时,这个问题尤其值得关注,因为即使面对非英文数据,我们也可以用英文提示来请求标签。我们基于自然语言推理的语言模型实验表明,即使数据使用的是其他语言,使用英文提示的效果也始终更好。

英文摘要:

Emotion classification in text is a challenging task due to the processes involved when interpreting a textual description of a potential emotion stimulus. In addition, the set of emotion categories is highly domain-specific. For instance, literature analysis might require the use of aesthetic emotions (e.g., finding something beautiful), and social media analysis could benefit from fine-grained sets (e.g., separating anger from annoyance) than only those that represent basic categories as they have been proposed by Paul Ekman (anger, disgust, fear, joy, surprise, sadness). This renders the task an interesting field for zero-shot classifications, in which the label set is not known at model development time. Unfortunately, most resources for emotion analysis are English, and therefore, most studies on emotion analysis have been performed in English, including those that involve prompting language models for text labels. This leaves us with a research gap that we address in this paper: In which language should we prompt for emotion labels on non-English texts? This is particularly of interest when we have access to a multilingual large language model, because we could request labels with English prompts even for non-English data. Our experiments with natural language inference-based language models show that it is consistently better to use English prompts even if the data is in a different language.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑