arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.14433cs.CYcs.AIcs.CLcs.HC
收藏

合成读者面板:基于比赛的创意生成与LLM角色用于自主出版

Synthetic Reader Panels: Tournament-Based Ideation with LLM Personas for Autonomous Publishing

Nimble Books LLC(Nimble Books公司);Big Five Killer LLC(Big Five Killer公司)

Fred Zimmerman

AI总结:

该研究提出利用合成读者面板进行自主出版,通过LLM角色模拟多样化读者进行比赛评估,有效识别内容问题并提升高质量概念比例。

摘要:

我们提出了一种用于自主书籍创意生成的系统,该系统用合成读者面板替代了人类焦点小组——由LLM实例化的读者角色组成的多样化集合,这些角色通过结构化的比赛竞赛评估书籍概念。每个角色由人口统计数据(年龄组、性别、收入、教育水平、阅读水平)、行为模式(每年购书数量、偏好的类型、发现方法、价格敏感性)以及一致性参数定义。面板根据印制目标来组成,以反映目标人口统计数据,多样性约束确保在年龄、阅读水平和类型偏好方面具有代表性。书籍概念在单淘汰、双淘汰、循环赛或瑞士系统比赛中竞争,根据市场吸引力、原创性和执行潜力等加权标准进行评判。为了拒绝低质量的LLM评估,我们实施了五个自动化反滑坡检查(重复用语、通用框架、循环推理、分数聚类、受众不匹配)。我们报告了在管理6个活跃印制和609个发行标题的多印制出版运营中部署的结果。三个案例研究——一个有270名评估者的儿童文学小说面板,以及两个5人专家面板(军事回忆录和海军战略专著)——表明合成面板能够产生可操作的人口统计数据细分,识别出同质评审员无法发现的结构性内容问题,并通过比赛过滤消除低质量概念,同时将高质量幸存者从15%提高到62%的评估池。

英文摘要:

We present a system for autonomous book ideation that replaces human focus groups with synthetic reader panels -- diverse collections of LLM-instantiated reader personas that evaluate book concepts through structured tournament competitions. Each persona is defined by demographic attributes (age group, gender, income, education, reading level), behavioral patterns (books per year, genre preferences, discovery methods, price sensitivity), and consistency parameters. Panels are composed per imprint to reflect target demographics, with diversity constraints ensuring representation across age, reading level, and genre affinity. Book concepts compete in single-elimination, double-elimination, round-robin, or Swiss-system tournaments, judged against weighted criteria including market appeal, originality, and execution potential. To reject low-quality LLM evaluations, we implement five automated anti-slop checks (repetitive phrasing, generic framing, circular reasoning, score clustering, audience mismatch). We report results from deployment within a multi-imprint publishing operation managing 6 active imprints and 609 titles in distribution. Three case studies -- a 270-evaluator panel for a children's literacy novel, and two 5-person expert panels for a military memoir and a naval strategy monograph -- demonstrate that synthetic panels produce actionable demographic segmentation, identify structural content issues invisible to homogeneous reviewers, and enable tournament filtering that eliminates low-quality concepts while enriching high-quality survivors from 15% to 62% of the evaluated pool.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑