Ghostfinger:一种新型的全计算指尖控制器平台
Ghostfinger: a novel platform for fully computational fingertip controllers
摘要:
我们提出了Ghostfinger,一种用于高度动态上下指尖触觉和控制的技术。该技术提供的整体用户体验可以被描述为与小全息图进行有形和可听交互的体验。更具体地,Ghostfinger实现了算法原语的动态实例化/参数化的自动可视化,这些算法原语一起确定指尖动作的当前触觉条件。这种可视化的某些方面是视觉空间的:当用户移动指垫传感器时,浮动透视光标提供指垫传感器的实时、按比例显示。同时,每个触觉基元实例由浮动块形状表示,类型着色,透明,并且可能与其他这样的块形状重叠。可视化的其他方面是符号化的:每个实例也由一个类型符号表示,如果实例向用户提供输出,则在网格中点亮。我们讨论了系统的用户界面,编程接口,和潜在的应用。这是从一个一般的角度,阐明和强调独特的使能作用的计算原则,在实施新形式的乐器控制的音乐声音。除了目前提出的技术之外,这也更广泛地反映了数字乐器(DMI)在NIME中的作用。
英文摘要:
We present Ghostfinger, a technology for highly dynamic up/down fingertip haptics and control. The overall user experience offered by the technology can be described as that of tangibly and audibly interacting with a small hologram. More specifically, Ghostfinger implements automatic visualization of the dynamic instantiation/parametrization of algorithmic primitives that together determine the current haptic conditions for fingertip action. Some aspects of this visualization are visuospatial: A floating see-through cursor provides real-time, to-scale display of the fingerpad transducer, as it is being moved by the user. Simultaneously, each haptic primitive instance is represented by a floating block shape, type-colored, variably transparent, and possibly overlapping with other such block shapes. Further aspects of visualization are symbolic: Each instance is also represented by a type symbol, lighting up within a grid if the instance is providing output to the user. We discuss the system's user interface, programming interface, and potential applications. This is done from a general perspective that articulates and emphasizes the uniquely enabling role of the principle of computation in the implementation of new forms of instrumental control of musical sound. Beyond the currently presented technology, this also reflects more broadly on the role of Digital Musical Instruments (DMIs) in NIME.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。