发表机构
Shishido & Associates; SeemeData Labs, Inc.; Ootaki & Architects; Naru Science Software(志氏联合机构; SeemeData实验室公司; 大泷联合建筑事务所; 鸣科技学软件公司)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
本研究提出免足部钢琴踏板交互系统bFaaaP,通过头部姿态追踪定量复现演奏者踏板意图,经测试其效果与脚操作无显著差异,已用于公开音乐会并开源软硬件。
AI 中文摘要
富有表现力的钢琴演奏依赖延音(制音器)踏板,该踏板通常由脚操作,这排除了无法便捷使用脚的演奏者:轮椅使用者及其他下肢障碍者、儿童、部分老年人或残障演奏者。我们提出bFaaaP(无障碍辅助踏板,barrier-Free assist as a Pedal),这是一种从演奏者头部角度操作踏板的包容性免足部交互系统:智能手机通过设备端增强现实(AR)面部跟踪技术追踪头部姿态,并通过蓝牙低功耗(BLE)向踏板设备传输精简指令。在专利审查支持下,我们的核心主张并非头-踏板架构(现有技术已预见),而是一种可定量、用户可调的控制律——这是获得专利的“关键”,可实现自然且富有表现力的效果:演奏者预设一个小角度死区(偏移量为3-10度)和一个乘数(10-50),二者共同确定一个可二次预调的响应速度,该速度可复现钢琴家的踏板意图。一项工程技巧将快速AR采样与较慢的BLE速率解耦。两个同等实现方式共享一个控制器:用于原声钢琴的非破坏性机械执行器(Pro),由气动“气袋”(我们新造术语,指充气式支撑锚)固定,该气袋可吸收反作用力而无需改动乐器;以及用于数码钢琴的电子延音开关(Switch)。在一项包含15名参与者的人类受试者辅助踏板效果评估(APEE)中,bFaaaP显著提升了延音能量(p<0.01),且与演奏者自身脚部操作的效果无统计学差异(p>0.05),不同类别参与者间无显著差异;一名伴有腿部残疾和气管切开术的参与者成功完成了演奏。因无需在面部佩戴任何设备且设置快速,bFaaaP已在2018-2025年的正式公开音乐会中投入使用。我们将完整的硬件与软件作为开源资源发布。
英文摘要
Expressive piano performance depends on the sustain (damper) pedal, operated by foot, excluding players who cannot readily use their feet: wheelchair users and others with lower-limb impairments, small children, and some elderly or disabled players. We present bFaaaP (barrier-Free assist as a Pedal), an inclusive, foot-free interaction that operates the pedal from the angle of the player's head: a smartphone tracks head pose with on-device augmented-reality (AR) face tracking and streams a compact command over Bluetooth Low Energy (BLE) to a pedal device. Supported by patent examination, our central claim is not the head-to-pedal architecture (anticipated by prior art) but a quantitative, user-tunable control law -- the patentable "key" to a natural, expressive result: the player presets a small angular dead-zone (offset 3-10 degrees) and a multiplier (10-50), which together fix a secondary, pre-adjustable response speed that reproduces the pianist's intended pedalling. An engineering trick decouples the fast AR sampling from the slower BLE rate. Two co-equal realizations share one controller: a non-destructive robotic actuator for acoustic pianos (Pro), anchored by a pneumatic "airback" (our coined term for an inflatable air-braced anchor) that absorbs the reaction force without modifying the instrument; and an electronic sustain switch for digital pianos (Switch). In a human-subject Auxiliary Pedal Effect Evaluation (APEE) with 15 participants, bFaaaP significantly increased sustained-tone energy (p<0.01) and was statistically indistinguishable from a player's own foot (p>0.05), with no significant difference across classes; one participant with a leg disability and a tracheostomy performed successfully. With nothing worn on the face and fast setup, bFaaaP has run in formal public concerts (2018-2025). We release the full hardware and software as open source.
Comments28 pages, 10 figures, 9 tables. Open hardware/software release. Preprint