速写声音:音形联想的探索性研究
Sketching sounds: an exploratory study on sound-shape associations
摘要:
声音合成器控制通常对应于信号处理算法的技术参数,而不是与人类对声音的感知相关的直观声音描述符。这使得很难以直接的方式实现合理的想法。跨模态映射,例如手势和声音之间的映射,已经被建议作为更直观的控制机制。大量的研究表明,人类在声音和形状之间的联系是一致的。然而,使用绘图来驱动声音合成还没有被充分地探索。本文提出了一个探索性的研究,要求参与者素描视觉图像的声音与单色数字绘图界面,目的是确定不同的代表性方法,并确定是否可以通过视觉草图可靠地传达音色的声音特征。结果表明,开发一个利用声音形状协会的合成器是可行的,但在后续研究中需要一个更大,更集中的数据集。
英文摘要:
Sound synthesiser controls typically correspond to technical parameters of signal processing algorithms rather than intuitive sound descriptors that relate to human perception of sound. This makes it difficult to realise sound ideas in a straightforward way. Cross-modal mappings, for example between gestures and sound, have been suggested as a more intuitive control mechanism. A large body of research shows consistency in human associations between sounds and shapes. However, the use of drawings to drive sound synthesis has not been explored to its full extent. This paper presents an exploratory study that asked participants to sketch visual imagery of sounds with a monochromatic digital drawing interface, with the aim to identify different representational approaches and determine whether timbral sound characteristics can be communicated reliably through visual sketches. Results imply that the development of a synthesiser exploiting sound-shape associations is feasible, but a larger and more focused dataset is needed in followup studies.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。