arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.11433cs.HC
收藏

一个人不能独自制作梗图:评估LLMs与人类在幽默生成中的共同创造力

One Does Not Simply Meme Alone: Evaluating Co-Creativity Between LLMs and Humans in the Generation of Humor

Zhikun Wu, Thomas Weber, Florian Müller

AI总结:

本研究通过用户实验评估LLM在梗图创作中的协作效果,发现AI辅助提升创意数量但未改善质量,纯AI梗图平均表现最佳,但人类在顶级幽默上占优,人机协作在创造力和可分享性上突出。

摘要:

已有研究表明,协作能增强创造力,带来更具创新性和有效性的成果。尽管先前的研究探索了大语言模型(LLMs)在诗歌写作或叙事创作等任务中作为共同创造伙伴的能力,但LLMs在充满幽默和文化细微差别的领域中的协作潜力仍是一个开放性问题。为弥补这一空白,我们进行了一项用户研究,以探索LLMs在共同创作梗图(一种幽默驱动且具有文化特定性的创意表达形式)中的潜力。我们开展了一项用户研究,分为三组,每组50名参与者:仅由人类组成的组在无AI辅助下创作梗图;人机协作组与最先进的LLM模型互动创作梗图;以及仅由AI组成的组,其中LLM自主生成梗图。我们通过众包方式评估生成梗图的质量,每个梗图在创造力、幽默感和可分享性方面进行评分。结果显示,LLM辅助增加了生成想法的数量,并减少了参与者感受到的努力。然而,当人类与LLM协作时,并未提高梗图的质量。有趣的是,完全由AI创作的梗图在所有方面的平均表现均优于仅由人类创作和人机协作的梗图。然而,在观察表现最佳的梗图时,人类创作的梗图在幽默感方面更胜一筹,而人机协作的梗图在创造力和可分享性方面脱颖而出。这些发现凸显了人机协作在创意任务中的复杂性。虽然AI能提升生产力并创作出吸引广泛受众的内容,但人类的创造力对于创作能更深层次连接受众的内容仍然至关重要。

英文摘要:

Collaboration has been shown to enhance creativity, leading to more innovative and effective outcomes. While previous research has explored the abilities of Large Language Models (LLMs) to serve as co-creative partners in tasks like writing poetry or creating narratives, the collaborative potential of LLMs in humor-rich and culturally nuanced domains remains an open question. To address this gap, we conducted a user study to explore the potential of LLMs in co-creating memes - a humor-driven and culturally specific form of creative expression. We conducted a user study with three groups of 50 participants each: a human-only group creating memes without AI assistance, a human-AI collaboration group interacting with a state-of-the-art LLM model, and an AI-only group where the LLM autonomously generated memes. We assessed the quality of the generated memes through crowdsourcing, with each meme rated on creativity, humor, and shareability. Our results showed that LLM assistance increased the number of ideas generated and reduced the effort participants felt. However, it did not improve the quality of the memes when humans collaborated with LLM. Interestingly, memes created entirely by AI performed better than both human-only and human-AI collaborative memes in all areas on average. However, when looking at the top-performing memes, human-created ones were better in humor, while human-AI collaborations stood out in creativity and shareability. These findings highlight the complexities of human-AI collaboration in creative tasks. While AI can boost productivity and create content that appeals to a broad audience, human creativity remains crucial for content that connects on a deeper level.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑