基于增长变换动力系统的时空数据声化
Using growth transform dynamical systems for spatio-temporal data sonification
摘要:
声音化或将信息编码为有意义的音频签名,在增强或取代传统的可视化方法以进行人工决策方面具有几个优势。文献中报道的标准发音方法涉及(i)仅使用变量的子集,或者(ii)首先解决数据上的学习任务,然后将输出映射到音频波形,最终用户利用该音频波形来做出决定。本文提出了一种新的框架声化高维数据使用复杂的增长变换动力系统模型的学习(或更一般地说,优化)和声化过程集成在一起。我们的算法将学习或预测任务所需的数据和优化参数作为输入,并将其与用户定义的心理声学参数相结合。因此,所提出的框架输出双耳音频签名,不仅编码高维数据的一些统计特性,而且还揭示了优化/学习过程的潜在复杂性。除了使用合成数据集进行广泛的实验外,我们还展示了声化脑电图(EEG)数据的框架,这些数据具有检测儿科患者癫痫发作的潜力。
英文摘要:
Sonification, or encoding information in meaningful audio signatures, has several advantages in augmenting or replacing traditional visualization methods for human-in-the-loop decision-making. Standard sonification methods reported in the literature involve either (i) using only a subset of the variables, or (ii) first solving a learning task on the data and then mapping the output to an audio waveform, which is utilized by the end-user to make a decision. This paper presents a novel framework for sonifying high-dimensional data using a complex growth transform dynamical system model where both the learning (or, more generally, optimization) and the sonification processes are integrated together. Our algorithm takes as input the data and optimization parameters underlying the learning or prediction task and combines it with the psychoacoustic parameters defined by the user. As a result, the proposed framework outputs binaural audio signatures that not only encode some statistical properties of the high-dimensional data but also reveal the underlying complexity of the optimization/learning process. Along with extensive experiments using synthetic datasets, we demonstrate the framework on sonifying Electro-encephalogram (EEG) data with the potential for detecting epileptic seizures in pediatric patients.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。