arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.09692cs.AIcs.CV
收藏

Tipiano:通过指尖先验知识实现钢琴手部运动的级联合成

Tipiano: Cascaded Piano Hand Motion Synthesis via Fingertip Priors

Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院(KAIST));Seoul National University(首尔大学)

Joonhyung Bae, Kirak Kim, Hyeyoon Cho, Sein Lee, Yoon-Seok Choi, Hyeon Hur, Gyubin Lee, Akira Maezawa, Satoshi Obata, Jonghwa Park, Jaebum Park, Juhan Nam

AI总结:

本文提出Tipiano框架,利用钢琴运动的自然层级结构,通过指尖定位、轨迹细化、手腕估计和姿态合成四个阶段,实现高精度自然的钢琴手部运动合成,实验表明其性能优于扩散模型。

摘要:

本文提出Tipiano框架,利用钢琴运动的自然层级结构,通过指尖定位、轨迹细化、手腕估计和姿态合成四个阶段,实现高精度自然的钢琴手部运动合成,实验表明其性能优于扩散模型。

英文摘要:

Synthesizing realistic piano hand motions requires both precision and naturalness. Physics-based methods achieve precision but produce stiff motions; data-driven models learn natural dynamics but struggle with positional accuracy. Piano motion exhibits a natural hierarchy: fingertip positions are nearly deterministic given piano geometry and fingering, while wrist and intermediate joints offer stylistic freedom. We present [OURS], a four-stage framework exploiting this hierarchy: (1) statistics-based fingertip positioning, (2) FiLM-conditioned trajectory refinement, (3) wrist estimation, and (4) STGCN-based pose synthesis. We contribute expert-annotated fingerings for the FürElise dataset (153 pieces, ~10 hours). Experiments demonstrate F1 = 0.910, substantially outperforming diffusion baselines (F1 = 0.121), with user study (N=41) confirming quality approaching motion capture. Expert evaluation by professional pianists (N=5) identified anticipatory motion as the key remaining gap, providing concrete directions for future improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑