InteractGesture：用于连续流协同语音手势控制的渐进式分块引导
InteractGesture: Progressive Chunk Guidance for Continuous Streaming Co-Speech Gesture Control
- Meta
- University of North Carolina at Charlotte（北卡罗来纳大学夏洛特分校）
机构由 AI 辅助整理，请以论文原文为准。
AI总结：
针对现有协同语音手势生成模型缺乏单关节细粒度空间可控性的问题，提出模型无关的推理时方法InteractGesture，通过渐进式分块引导解决分块依赖问题，在BEAT2数据集上实现多关节空间控制提升。
AI中文摘要：
协同语音手势生成已在从说话人音频生成逼真全身动作方面取得显著进展，但现有模型缺乏对单个关节的细粒度空间可控性。为解决这一问题，我们提出InteractGesture，一种模型无关的推理时空间可控手势生成方法。InteractGesture通过可微RVQ-VAE解码器引导扩散采样器的目标潜估计，反向传播空间控制梯度以在采样过程中调整运动潜变量。流式协同语音生成的核心挑战是分块依赖：标准顺序推理会冻结先前分块，导致未来分块的空间约束无法调整前序轨迹，引发边界不一致。为克服这一局限，我们提出渐进式分块引导，一种分块窗口策略，该策略维护一组具有交错延迟的可编辑分块潜变量，使空间约束能在流式生成期间跨分块边界反向传播梯度。在BEAT2数据集上的实验表明，InteractGesture在保留整体手势质量的同时提升了多关节空间控制能力。此外，我们的方法支持多种应用，包括稀疏关节定位、密集关节轨迹控制和定向指向。我们的项目页面可在此URL获取。
英文摘要：
Co-speech gesture generation has made significant progress toward realistic full-body motion from speaker audio, yet existing models lack fine-grained spatial controllability of individual joints. To address this, we introduce \emph{InteractGesture}, a model-agnostic, inference-time method for spatially controllable gesture generation. \emph{InteractGesture} guides target latent estimates of a diffusion sampler through a differentiable RVQ-VAE decoder, backpropagating spatial control gradients to adjust motion latents during sampling. A primary challenge in streaming co-speech generation is chunk-wise dependency: standard sequential inference freezes prior chunks, preventing spatial constraints in future chunks from adjusting preceding trajectories and causing boundary inconsistencies. To overcome this limitation, we propose \emph{Progressive Chunk Guidance}, a chunk-window strategy that maintains an active set of editable chunk latents with staggered delays, enabling spatial constraints to propagate gradients backward across chunk boundaries during streaming generation. Experiments on the BEAT2 dataset show that \emph{InteractGesture} improves multi-joint spatial control while preserving overall gesture quality. Furthermore, our approach supports diverse applications, including sparse joint positioning, dense joint trajectory control, and directional pointing. Our project page is available at https://exitudio.github.io/interactgesture-page .
