arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.06452cs.HCcs.AI
收藏

基于图的叙事可视化的混合多模型语义交互

Mixed Multi-Model Semantic Interaction for Graph-based Narrative Visualizations

Virginia Tech(弗吉尼亚理工大学);Universidad Católica del Norte(北天主教大学);University of Washington(华盛顿大学)

Brian Keith Norambuena, Tanushree Mitra, Chris North

摘要:

叙事意义构建是理解顺序数据的重要组成部分。叙事图是一种视觉表示模型,可以帮助分析人员理解叙事。在这项工作中,我们提出了一个语义交互(SI)框架的叙事地图,可以支持分析师通过他们的意义构建过程。与传统的SI系统依赖于降维和投影空间的工作,我们的方法有一个额外的抽象层-结构空间-建立在投影空间和编码的叙事在一个离散的结构。这个额外的层引入了在将SI与叙事提取管道集成时必须解决的额外挑战。我们通过提出混合多模型语义交互(3 MSI)的一般概念来解决这些挑战-SI管道,其中最高级别的模型对应于抽象的离散结构,较低级别的模型是连续的。为了评估我们的3 MSI模型的叙事地图的性能,我们提出了一个定量的基于模拟的评估和定性评估的案例研究和专家反馈。我们发现,我们的SI系统可以模拟分析师的意图,并支持叙事地图的增量形式主义。

英文摘要:

Narrative sensemaking is an essential part of understanding sequential data. Narrative maps are a visual representation model that can assist analysts to understand narratives. In this work, we present a semantic interaction (SI) framework for narrative maps that can support analysts through their sensemaking process. In contrast to traditional SI systems which rely on dimensionality reduction and work on a projection space, our approach has an additional abstraction layer -- the structure space -- that builds upon the projection space and encodes the narrative in a discrete structure. This extra layer introduces additional challenges that must be addressed when integrating SI with the narrative extraction pipeline. We address these challenges by presenting the general concept of Mixed Multi-Model Semantic Interaction (3MSI) -- an SI pipeline, where the highest-level model corresponds to an abstract discrete structure and the lower-level models are continuous. To evaluate the performance of our 3MSI models for narrative maps, we present a quantitative simulation-based evaluation and a qualitative evaluation with case studies and expert feedback. We find that our SI system can model the analysts' intent and support incremental formalism for narrative maps.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑