arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.06373cs.CLcs.AI

LLM Discussion:通过讨论框架与角色扮演增强大语言模型的创造力

LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Play

National Taiwan University(台湾大学)

Li-Chun Lu, Shou-Jen Chen, Tsung-Min Pai, Chan-Hung Yu, Hung-yi Lee, Shao-Hua Sun

AI总结:

本文提出LLM Discussion三阶段讨论框架,结合角色扮演技术,通过模拟人类集体讨论过程来增强大语言模型在开放式问题上的创造力,并在多项创造力测试中优于现有方法。

摘要:

大语言模型(LLMs)在自然语言处理方面表现出卓越的能力,但在回答开放式问题时,往往难以生成富有创造性和原创性的回应。为了增强LLM的创造力,我们的核心见解是模拟人类通过让来自不同背景和视角的参与者进行深入讨论来激发集体创造力的过程。为此,我们提出了LLM Discussion,这是一个三阶段讨论框架,能够促进激烈且发散的思想交流,并确保收敛到创造性的答案。此外,我们采用角色扮演技术,为LLM分配不同的角色,以应对LLM的同质化问题。我们通过LLM评估和人类研究,使用替代用途测试、相似性测试、实例测试和科学创造力测试来评估所提出框架的有效性。结果表明,我们提出的框架在各种创造力指标上均优于单LLM方法和现有的多LLM框架。代码可在 https://github.com/lawraa/LLM-Discussion 获取。

英文摘要:

Large language models (LLMs) have shown exceptional proficiency in natural language processing but often fall short of generating creative and original responses to open-ended questions. To enhance LLM creativity, our key insight is to emulate the human process of inducing collective creativity through engaging discussions with participants from diverse backgrounds and perspectives. To this end, we propose LLM Discussion, a three-phase discussion framework that facilitates vigorous and diverging idea exchanges and ensures convergence to creative answers. Moreover, we adopt a role-playing technique by assigning distinct roles to LLMs to combat the homogeneity of LLMs. We evaluate the efficacy of the proposed framework with the Alternative Uses Test, Similarities Test, Instances Test, and Scientific Creativity Test through both LLM evaluation and human study. The results show that our proposed framework outperforms single-LLM approaches and existing multi-LLM frameworks across various creativity metrics. The code is available at https://github.com/lawraa/LLM-Discussion.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑