一个机器人走进酒吧：语言模型能否作为喜剧的创意支持工具？对LLMs与喜剧演员幽默对齐的评估
A Robot Walks into a Bar: Can Language Models Serve as Creativity Support Tools for Comedy? An Evaluation of LLMs' Humour Alignment with Comedians
AI总结：
研究通过采访20位专业喜剧演员，评估了LLMs作为喜剧创意支持工具的表现，发现现有安全审核策略强化了霸权视角且生成的喜剧内容平淡且带有偏见，强调了基于社区的价值对齐和数据所有权的重要性。
摘要：
2023年8月在爱丁堡边缘艺术节及线上举办的关于“AI x 喜剧”的3小时研讨会中，我们采访了20位在观众面前进行现场表演并在其艺术创作过程中使用人工智能的专业喜剧演员。研讨会包括使用大型语言模型（LLMs）进行喜剧写作环节，通过人机交互问卷评估AI作为写作工具的创造力支持指数，以及焦点小组讨论，探讨喜剧演员使用AI的动机和过程，及其对偏见、审查和版权等伦理问题的担忧。参与者指出，现有用于安全过滤和指令微调LLMs的审核策略通过抹除少数群体及其观点强化了霸权视角，并将其定性为一种审查形式。同时，大多数参与者认为LLMs未能成功作为创意支持工具，因其生成的喜剧老梗平淡且带有偏见，类似于“20世纪50年代的游轮喜剧素材，但种族主义色彩稍弱”。本研究扩展了关于有害言论与作为反抗、讽刺和“向上出击”实践的“冒犯性”语言之间细微差别的学术研究。我们还审视了此类语言模型背后的全球价值对齐，并讨论了基于社区的价值对齐和数据所有权对于构建更契合艺术家需求的AI工具的重要性。
英文摘要：
We interviewed twenty professional comedians who perform live shows in front of audiences and who use artificial intelligence in their artistic process as part of 3-hour workshops on ``AI x Comedy'' conducted at the Edinburgh Festival Fringe in August 2023 and online. The workshop consisted of a comedy writing session with large language models (LLMs), a human-computer interaction questionnaire to assess the Creativity Support Index of AI as a writing tool, and a focus group interrogating the comedians' motivations for and processes of using AI, as well as their ethical concerns about bias, censorship and copyright. Participants noted that existing moderation strategies used in safety filtering and instruction-tuned LLMs reinforced hegemonic viewpoints by erasing minority groups and their perspectives, and qualified this as a form of censorship. At the same time, most participants felt the LLMs did not succeed as a creativity support tool, by producing bland and biased comedy tropes, akin to ``cruise ship comedy material from the 1950s, but a bit less racist''. Our work extends scholarship about the subtle difference between, one the one hand, harmful speech, and on the other hand, ``offensive'' language as a practice of resistance, satire and ``punching up''. We also interrogate the global value alignment behind such language models, and discuss the importance of community-based value alignment and data ownership to build AI tools that better suit artists' needs.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
