DEEM:用于立场检测的动态经验专家建模
DEEM: Dynamic Experienced Expert Modeling for Stance Detection
AI总结:
本文提出动态经验专家建模(DEEM)方法,利用生成的经验专家让LLMs以半参数化方式推理,在三个标准基准测试上取得最佳结果,优于自洽性推理方法并减少了模型偏差。
摘要:
近期有工作初步尝试使用大型语言模型(LLMs)来解决立场检测任务,并展现出良好的效果。然而,考虑到立场检测通常需要详细的背景知识,普通的推理方法可能会忽略领域知识,从而无法进行专业且准确的分析。因此,LLMs的推理仍有改进空间,特别是在利用LLMs的生成能力来模拟特定专家(即多智能体)以检测立场方面。在本文中,与现有的需要详细描述并使用固定专家的多智能体工作不同,我们提出了一种动态经验专家建模(DEEM)方法,该方法能够利用生成的经验专家,并让LLMs以半参数化方式进行推理,使专家更具泛化性和可靠性。实验结果表明,DEEM在三个标准基准测试上始终取得最佳结果,优于具有自洽性推理的方法,并减少了LLMs的偏差。
英文摘要:
Recent work has made a preliminary attempt to use large language models (LLMs) to solve the stance detection task, showing promising results. However, considering that stance detection usually requires detailed background knowledge, the vanilla reasoning method may neglect the domain knowledge to make a professional and accurate analysis. Thus, there is still room for improvement of LLMs reasoning, especially in leveraging the generation capability of LLMs to simulate specific experts (i.e., multi-agents) to detect the stance. In this paper, different from existing multi-agent works that require detailed descriptions and use fixed experts, we propose a Dynamic Experienced Expert Modeling (DEEM) method which can leverage the generated experienced experts and let LLMs reason in a semi-parametric way, making the experts more generalizable and reliable. Experimental results demonstrate that DEEM consistently achieves the best results on three standard benchmarks, outperforms methods with self-consistency reasoning, and reduces the bias of LLMs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。