arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.16558cs.HCcs.GRcs.SDeess.AS
收藏

张开双耳并看一看:关于可听化与可视化整合的最新进展报告

Open Your Ears and Take a Look: A State-of-the-Art Report on the Integration of Sonification and Visualization

St. Pölten University of Applied Sciences(圣珀尔滕应用科学大学);University of Music and Performing Arts Graz(格拉茨音乐与表演艺术大学);Linköping University(林雪平大学);City University of Hong Kong(香港城市大学);Universidad de Deusto(德乌斯托大学);University of Utah(犹他大学)

Kajetan Enge, Elias Elmquist, Valentina Caiola, Niklas Rönnberg, Alexander Rind, Michael Iber, Sara Lenzi, Fangfei Lan, Robert Höldrich, Wolfgang Aigner

AI总结:

本文系统梳理了2011至2023年间57篇将可视化与可听化整合为视听展示的研究,提出分类体系并进行元分析与合著网络分析,揭示领域设计多样但团队间联系薄弱,同时探讨了视听监控、可访问性与数据艺术三个相邻主题。

摘要:

研究用于数据展示与分析的可视化和可听化的学术共同体有着极为相似的目标,本质上都是让任何类型的数据能够被人类理解。一个共同体通过使用数据的视觉表征来实现这一目标,另一个共同体则采用数据的听觉(非语音)表征。尽管这两个共同体有许多共同之处,但在过去几十年里,它们大多是并行发展的。通过这篇STAR报告,我们讨论了一批跨越两个共同体边界的工作,即一批旨在将这两种技术整合为一种视听展示形式的工作,我们认为这种形式“超越了二者之和”。我们引入并论证了一个适用于此类视听展示的分类系统,并将2011年至2023年间出现的57篇学术出版物组成的语料库按阅读层级、数据集类型或评估系统等类别进行了分类。该语料库还支持对该领域的元分析,包括反复出现的设计模式,如可视化和可听化技术的类型,或视觉与听觉通道的使用,展示了一个整体上多样化且设计各异的领域。对该领域合著者网络的分析显示,各团队之间缺乏许多相互联系。本STAR报告所涵盖的工作主体还涉及三个相邻主题:视听监控、可访问性和视听数据艺术。除了系统开展的研究部分之外,这三个主题也分别进行了讨论。本报告的发现可供两个领域的研究人员用于理解此类整合设计的潜力与挑战,同时有望激励他们与来自相应另一领域的专家开展合作。

英文摘要:

The research communities studying visualization and sonification for data display and analysis share exceptionally similar goals, essentially making data of any kind interpretable to humans. One community does so by using visual representations of data, and the other community employs auditory (non-speech) representations of data. While the two communities have a lot in common, they developed mostly in parallel over the course of the last few decades. With this STAR, we discuss a collection of work that bridges the borders of the two communities, hence a collection of work that aims to integrate the two techniques into one form of audiovisual display, which we argue to be "more than the sum of the two." We introduce and motivate a classification system applicable to such audiovisual displays and categorize a corpus of 57 academic publications that appeared between 2011 and 2023 in categories such as reading level, dataset type, or evaluation system, to mention a few. The corpus also enables a meta-analysis of the field, including regularly occurring design patterns such as type of visualization and sonification techniques, or the use of visual and auditory channels, showing an overall diverse field with different designs. An analysis of a co-author network of the field shows individual teams without many interconnections. The body of work covered in this STAR also relates to three adjacent topics: audiovisual monitoring, accessibility, and audiovisual data art. These three topics are discussed individually in addition to the systematically conducted part of this research. The findings of this report may be used by researchers from both fields to understand the potentials and challenges of such integrated designs while hopefully inspiring them to collaborate with experts from the respective other field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑