DECKBench：用于学术幻灯片生成和编辑的多智能体框架基准测试
DECKBench: Benchmarking Multi-Agent Frameworks for Academic Slide Generation and Editing
AI总结：
本文提出DECKBench，一个用于评估多智能体生成和编辑学术幻灯片的框架，通过定制数据集和模拟编辑指令，系统评估幻灯片和整个演示文稿的忠实度、连贯性、布局质量和多轮指令遵循能力。
摘要：
本文提出DECKBench，一个用于评估多智能体生成和编辑学术幻灯片的框架，通过定制数据集和模拟编辑指令，系统评估幻灯片和整个演示文稿的忠实度、连贯性、布局质量和多轮指令遵循能力。
英文摘要：
Automatically generating and iteratively editing academic slide decks requires more than document summarization. It demands faithful content selection, coherent slide organization, layout-aware rendering, and robust multi-turn instruction following. However, existing benchmarks and evaluation protocols do not adequately measure these challenges. To address this gap, we introduce the Deck Edits and Compliance Kit Benchmark (DECKBench), an evaluation framework for multi-agent slide generation and editing. DECKBench is built on a curated dataset of paper to slide pairs augmented with realistic, simulated editing instructions. Our evaluation protocol systematically assesses slide-level and deck-level fidelity, coherence, layout quality, and multi-turn instruction following. We further implement a modular multi-agent baseline system that decomposes the slide generation and editing task into paper parsing and summarization, slide planning, HTML creation, and iterative editing. Experimental results demonstrate that the proposed benchmark highlights strengths, exposes failure modes, and provides actionable insights for improving multi-agent slide generation and editing systems. Overall, this work establishes a standardized foundation for reproducible and comparable evaluation of academic presentation generation and editing. Code and data are publicly available at https://github.com/morgan-heisler/DeckBench .
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
