Data Playwright:利用带注释的叙述创作数据视频
Data Playwright: Authoring Data Videos with Annotated Narration
AI总结:
本文提出带注释的叙述这一新范式,并开发Data Playwright系统,让用户通过叙述文本中的内联自然语言命令自动生成并微调数据视频,实现叙事与设计意图的无缝整合。
摘要:
创建能够通过动画视觉有效讲述故事的数据视频需要大量的努力和专业知识。一个有前景的研究趋势是利用易于使用的自然语言(NL)交互,从叙事内容(如文本叙述)或指定用户所需设计的NL命令中自动合成数据视频组件。然而,以往的研究忽视了叙事内容与具体设计创作命令的整合,导致生成结果缺乏定制化,或无法无缝融入叙事语境。为了解决这些问题,我们引入了一种创建数据视频的新范式,该范式将用户的创作意图和叙事意图无缝整合为一种统一格式,称为带注释的叙述,允许用户将用于设计创作的NL命令作为叙述文本中的内联注释加以融入。基于一项关于用户对带注释叙述偏好的形成性研究,我们开发了一个名为Data Playwright的原型系统,该系统体现了这一范式,用于有效创建数据视频。在Data Playwright中,用户可以基于上传的可视化内容编写带注释的叙述。该系统的解释器能够自动理解用户输入,并在大语言模型的支持下,合成具有叙述-动画交互效果的数据视频。最后,用户可以预览并微调视频。一项用户研究表明,参与者能够通过带注释的叙述轻松表达其期望结果,从而有效地使用Data Playwright创建数据视频。
英文摘要:
Creating data videos that effectively narrate stories with animated visuals requires substantial effort and expertise. A promising research trend is leveraging the easy-to-use natural language (NL) interaction to automatically synthesize data video components from narrative content like text narrations, or NL commands that specify user-required designs. Nevertheless, previous research has overlooked the integration of narrative content and specific design authoring commands, leading to generated results that lack customization or fail to seamlessly fit into the narrative context. To address these issues, we introduce a novel paradigm for creating data videos, which seamlessly integrates users' authoring and narrative intents in a unified format called annotated narration, allowing users to incorporate NL commands for design authoring as inline annotations within the narration text. Informed by a formative study on users' preference for annotated narration, we develop a prototype system named Data Playwright that embodies this paradigm for effective creation of data videos. Within Data Playwright, users can write annotated narration based on uploaded visualizations. The system's interpreter automatically understands users' inputs and synthesizes data videos with narration-animation interplay, powered by large language models. Finally, users can preview and fine-tune the video. A user study demonstrated that participants can effectively create data videos with Data Playwright by effortlessly articulating their desired outcomes through annotated narration.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。