arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.03483cs.CLcs.AI
收藏

SWAG: Storytelling With Action Guidance(带动作引导的故事生成)

SWAG: Storytelling With Action Guidance

UC Berkeley(加州大学伯克利分校)

Zeeshan Patel, Karim El-Refai, Jonathan Pei, Tianle Li

AI总结:

针对长上下文大语言模型一次性生成的长故事连贯性有余但吸引力不足的问题,提出SWAG双模型反馈循环方法,将故事写作转化为搜索问题,用辅助LLM选动作引导内容生成,仅用小型开源模型就超越GPT-3.5-Turbo,表现优于现有端到端方法。

摘要:

自动化长故事生成通常采用长上下文大语言模型(LLM)进行一次性创作,生成的内容虽具连贯性但未必引人入胜。我们提出Storytelling With Action Guidance(SWAG),一种基于LLM的新型故事生成方法。该方法将故事写作构建为搜索问题,通过双模型反馈循环实现:一个LLM生成故事内容,另一个辅助LLM选择下一个最优“动作”以引导故事的未来走向。实验结果显示,经GPT-4评估和人工评估,SWAG的表现大幅优于此前的端到端故事生成技术;仅使用小型开源模型的SWAG流水线性能超越了GPT-3.5-Turbo。

英文摘要:

Automated long-form story generation typically employs long-context large language models (LLMs) for one-shot creation, which can produce cohesive but not necessarily engaging content. We introduce Storytelling With Action Guidance (SWAG), a novel approach to storytelling with LLMs. Our approach frames story writing as a search problem through a two-model feedback loop: one LLM generates story content, and another auxiliary LLM is used to choose the next best "action" to steer the story's future direction. Our results show that SWAG can substantially outperform previous end-to-end story generation techniques when evaluated by GPT-4 and through human evaluation. Our SWAG pipeline using only small open-source models surpasses GPT-3.5-Turbo.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑