DLow:用于不同人体运动预测的多样化潜在流
DLow: Diversifying Latent Flows for Diverse Human Motion Prediction
摘要:
深度生成模型通常用于人体运动预测,因为它们能够对多模态数据分布进行建模并表征各种人类行为。虽然在设计和学习深度生成模型时已经非常小心,但如何在训练后从深度生成模型中有效地生成不同的样本仍然是一个未被探索的问题。为了从预训练的生成模型中获取样本,大多数现有的生成式人体运动预测方法都会提取一组独立的高斯潜码并将其转换为运动样本。显然,这种随机抽样策略不能保证产生多样化的样本,原因有二:(1)独立抽样不能强制样本多样化;(2)抽样仅基于可能性,可能只产生与数据分布的主要模式相对应的样本。为了解决这些问题,我们提出了一种新的采样方法,多样化的潜在流(DLow),从预训练的深度生成模型中生成一组多样化的样本。与随机(独立)采样不同,所提出的DLow采样方法对单个随机变量进行采样,然后用一组可学习的映射函数将其映射到一组相关的潜在代码。相关的潜在代码然后被解码成一组相关的样本。在训练过程中,DLow使用样本上的多样性促进先验作为目标来优化潜在映射以提高样本多样性。现有技术的设计是高度灵活的,并且可以定制以产生具有共同特征的不同运动(例如,相似的腿部运动但不同的上身运动)。我们的实验表明,DLow在样本多样性和准确性方面优于最先进的基线方法。我们的代码发布在项目页面:https://www.ye-yuan.com/dlow。
英文摘要:
Deep generative models are often used for human motion prediction as they are able to model multi-modal data distributions and characterize diverse human behavior. While much care has been taken into designing and learning deep generative models, how to efficiently produce diverse samples from a deep generative model after it has been trained is still an under-explored problem. To obtain samples from a pretrained generative model, most existing generative human motion prediction methods draw a set of independent Gaussian latent codes and convert them to motion samples. Clearly, this random sampling strategy is not guaranteed to produce diverse samples for two reasons: (1) The independent sampling cannot force the samples to be diverse; (2) The sampling is based solely on likelihood which may only produce samples that correspond to the major modes of the data distribution. To address these problems, we propose a novel sampling method, Diversifying Latent Flows (DLow), to produce a diverse set of samples from a pretrained deep generative model. Unlike random (independent) sampling, the proposed DLow sampling method samples a single random variable and then maps it with a set of learnable mapping functions to a set of correlated latent codes. The correlated latent codes are then decoded into a set of correlated samples. During training, DLow uses a diversity-promoting prior over samples as an objective to optimize the latent mappings to improve sample diversity. The design of the prior is highly flexible and can be customized to generate diverse motions with common features (e.g., similar leg motion but diverse upper-body motion). Our experiments demonstrate that DLow outperforms state-of-the-art baseline methods in terms of sample diversity and accuracy. Our code is released on the project page: https://www.ye-yuan.com/dlow.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。