Tipiano:通过指尖先验知识实现钢琴手部运动的级联合成
Tipiano: Cascaded Piano Hand Motion Synthesis via Fingertip Priors
AI总结:
本文提出Tipiano框架,利用钢琴运动的自然层级结构,通过指尖定位、轨迹细化、手腕估计和姿态合成四个阶段,实现高精度自然的钢琴手部运动合成,实验表明其性能优于扩散模型。
摘要:
本文提出Tipiano框架,利用钢琴运动的自然层级结构,通过指尖定位、轨迹细化、手腕估计和姿态合成四个阶段,实现高精度自然的钢琴手部运动合成,实验表明其性能优于扩散模型。
英文摘要:
Synthesizing realistic piano hand motions requires both precision and naturalness. Physics-based methods achieve precision but produce stiff motions; data-driven models learn natural dynamics but struggle with positional accuracy. Piano motion exhibits a natural hierarchy: fingertip positions are nearly deterministic given piano geometry and fingering, while wrist and intermediate joints offer stylistic freedom. We present [OURS], a four-stage framework exploiting this hierarchy: (1) statistics-based fingertip positioning, (2) FiLM-conditioned trajectory refinement, (3) wrist estimation, and (4) STGCN-based pose synthesis. We contribute expert-annotated fingerings for the FürElise dataset (153 pieces, ~10 hours). Experiments demonstrate F1 = 0.910, substantially outperforming diffusion baselines (F1 = 0.121), with user study (N=41) confirming quality approaching motion capture. Expert evaluation by professional pianists (N=5) identified anticipatory motion as the key remaining gap, providing concrete directions for future improvement.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。