迈向人类水平的书籍写作能力
Towards Human-Level Book-Writing Capability
AI总结:
本文提出了一种用于大规模创意写作的 dataset 构建和训练框架,通过将监督微调重新定义为提示到书籍生成任务,以人类创作的虚构作品为基础,旨在提升生成文本的文学性。
摘要:
优化用于指令跟随和代理任务的大型语言模型仍然难以满足高质量创意写作的要求。小说经常依赖于助手训练模型明确避免的行为,特别是欺骗、道德模糊和不可靠的叙述。因此,生成的故事往往在结构上正确,但风格上却过于通用、解释性过强或在人类文学行为上缺乏依据。我们提出了一种用于书籍规模创意写作的 dataset 构建和训练框架,将监督微调重新定义为基于人类创作小说的提示到书籍生成任务。从公共领域小说开始,我们通过逐步细化的层次总结来推导多分辨率规划框架,从高层次的前提到章节和场景层面的结构。然后在训练过程中反转这一层次结构:模型学习将提示扩展成越来越详细的计划,最终生成原始的人类创作书籍文本。这种 formulation 保留了人类散文作为最终的监督目标,同时利用中间摘要使书籍规模的生成变得可学习。我们在这些提示到书籍轨迹上训练了一个长上下文语言模型,并研究这种目标是否能使生成文本从助手风格的散文转向人类文学写作。
英文摘要:
Large language models are optimized for instruction following and agentic tasks remain poorly aligned with the requirements of high-quality creative writing. We show that a purpose-built creative writing model can outperform both GPT-5.5 and Claude Opus 4.8 on writing quality evaluation. Fiction frequently depends on behaviors that assistant-tuned models are explicitly trained to avoid, particularly deception, moral ambiguity, and unreliable narration. As a result, generated stories often appear structurally correct while remaining stylistically generic, overly explanatory, or weakly grounded in human literary behavior. We present a dataset construction and training framework for book-scale creative writing that reframes supervised fine-tuning as a prompt-to-book generation task grounded in human-authored fiction. Starting from public-domain novels, we derive a multi-resolution Planning Scaffold by summarizing each book at progressively finer levels, from a high-level premise to chapter- and scene-level structure. We then invert this hierarchy during training: the model learns to expand a prompt into increasingly detailed plans and finally into the original human-authored book text. This formulation preserves human prose as the final supervised target while using intermediate summaries to make book-scale generation learnable. We train a long-context language model on these prompt-to-book trajectories and show that this objective shifts generation away from assistant-style prose and toward human literary writing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。