$CrowdDiff$:使用扩散模型的多假设人群密度估计
$CrowdDiff$: Multi-hypothesis Crowd Density Estimation using Diffusion Models
AI总结:
针对宽高斯核真值密度图导致的噪声累积与密度损失问题,提出条件扩散框架 $CrowdDiff$,通过反向扩散生成密度图、训练期回归分支辅助学习并输出多假设密度图,在多个基准上显著超越现有方法。
摘要:
人群计数是人群分析中的一个基础问题,通常通过估计人群密度图并对密度值求和来完成。然而,由于使用宽高斯核来创建真值密度图,这种方法会受到背景噪声累积和密度损失的影响。该问题可以通过缩窄高斯核来克服。但是,当使用宽核真值密度图进行训练时,现有方法表现不佳。为了解决这一局限,我们提出使用条件扩散模型来预测密度图,因为扩散模型在生成过程中对训练数据表现出很高的保真度。基于此,我们提出了 $CrowdDiff$,它将人群密度图生成为一个反向扩散过程。此外,由于扩散过程的中间时间步存在噪声,我们仅在训练期间加入一个用于直接人群估计的回归分支,以改善特征学习。另外,由于扩散模型具有随机性,我们引入生成多张密度图的方法,以改进计数性能,这与现有的人群计数流程不同。我们在公开可用的数据集上进行了大量实验,以验证该方法的有效性。$CrowdDiff$ 在多个公共人群分析基准上优于现有的最先进人群计数方法,并取得了显著提升。
英文摘要:
Crowd counting is a fundamental problem in crowd analysis which is typically accomplished by estimating a crowd density map and summing over the density values. However, this approach suffers from background noise accumulation and loss of density due to the use of broad Gaussian kernels to create the ground truth density maps. This issue can be overcome by narrowing the Gaussian kernel. However, existing approaches perform poorly when trained with ground truth density maps with broad kernels. To deal with this limitation, we propose using conditional diffusion models to predict density maps, as diffusion models show high fidelity to training data during generation. With that, we present $CrowdDiff$ that generates the crowd density map as a reverse diffusion process. Furthermore, as the intermediate time steps of the diffusion process are noisy, we incorporate a regression branch for direct crowd estimation only during training to improve the feature learning. In addition, owing to the stochastic nature of the diffusion model, we introduce producing multiple density maps to improve the counting performance contrary to the existing crowd counting pipelines. We conduct extensive experiments on publicly available datasets to validate the effectiveness of our method. $CrowdDiff$ outperforms existing state-of-the-art crowd counting methods on several public crowd analysis benchmarks with significant improvements.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。