SmartBook：面向情报分析师的AI辅助态势报告生成
SmartBook: AI-Assisted Situation Report Generation for Intelligence Analysts
AI总结：
SmartBook是一个自动化框架，通过发现战略问题并从新闻数据生成结构化、可溯源的态势报告，经用户研究和编辑研究验证，其准确性和相关性高，优于大语言模型，且信息删除极少。
摘要：
及时且全面地理解新兴事件对于有效决策至关重要；自动化态势报告生成可以显著减少情报分析师的时间、精力和成本。在本工作中，我们识别了情报分析师在态势报告生成中对AI辅助的实践和偏好，以指导设计策略，构建一个有效且建立信任的界面，使其与分析师的思想过程和需求保持一致。接下来，我们介绍了SmartBook，一个自动化框架，旨在从大量新闻数据中生成态势报告，通过自动发现与事件相关的战略问题来创建结构化报告。这些报告包含多个假设（声明），这些假设被总结并基于事实证据溯源到来源，以促进对态势的深入理解。我们对SmartBook的综合评估，包括一项用户研究以及一项带有编辑研究的内容审查，揭示了SmartBook在生成准确且相关的态势报告方面的有效性。定性评估表明，超过80%的问题探究战略信息，超过90%的摘要产生具有战术价值的内容，并且始终优于与网络搜索集成的的大语言模型生成的摘要。编辑研究显示，从生成的文本中删除的信息极少（低于2.5%），这表明SmartBook为分析师提供了态势报告的宝贵基础。
英文摘要：
Timely and comprehensive understanding of emerging events is crucial for effective decision-making; automating situation report generation can significantly reduce the time, effort, and cost for intelligence analysts. In this work, we identify intelligence analysts' practices and preferences for AI assistance in situation report generation to guide the design strategies for an effective, trust-building interface that aligns with their thought processes and needs. Next, we introduce SmartBook, an automated framework designed to generate situation reports from large volumes of news data, creating structured reports by automatically discovering event-related strategic questions. These reports include multiple hypotheses (claims), summarized and grounded to sources with factual evidence, to promote in-depth situation understanding. Our comprehensive evaluation of SmartBook, encompassing a user study alongside a content review with an editing study, reveals SmartBook's effectiveness in generating accurate and relevant situation reports. Qualitative evaluations indicate over 80% of questions probe for strategic information, and over 90% of summaries produce tactically useful content, being consistently favored over summaries from a large language model integrated with web search. The editing study reveals that minimal information is removed from the generated text (under 2.5%), suggesting that SmartBook provides analysts with a valuable foundation for situation reports
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
