ANTHROPOS-V:面向人群体积估计新任务的基准评测
ANTHROPOS-V: benchmarking the novel task of Crowd Volume Estimation
AI总结:
本文提出人群体积估计新任务及首个基准ANTHROPOS-V,构建合成真实感视频数据集,并设计专用方法超越基于人体网格恢复与人群计数的基线模型。
摘要:
我们引入了人群体积估计(Crowd Volume Estimation,CVE)这一新任务,其定义为仅使用RGB图像来估计人群的集体身体体积的过程。除了事件管理和公共安全之外,CVE还可用于近似体重,从而解锁对重量敏感的应用,例如基础设施应力评估以及确保重量平衡。我们提出了首个CVE基准,其中包括ANTHROPOS-V,这是一个合成照片级真实感视频数据集,呈现了多样化城市场景中的人群。其标注包括每个人的体积、SMPL形状参数和关键点。此外,我们探索了与CVE相关的评估指标,定义了从人体网格恢复(Human Mesh Recovery)和人群计数(Crowd Counting)领域改编而来的基线模型,并提出了一种超越基线的CVE专用方法。尽管是合成的,但个体的体重和身高与跨性别的真实世界人口分布保持一致,并且它们能够迁移到来自真实图像的CVE下游任务。基准和代码可在github.com/colloroneluca/Crowd-Volume-Estimation获取。
英文摘要:
We introduce the novel task of Crowd Volume Estimation (CVE), defined as the process of estimating the collective body volume of crowds using only RGB images. Besides event management and public safety, CVE can be instrumental in approximating body weight, unlocking weight sensitive applications such as infrastructure stress assessment, and assuring even weight balance. We propose the first benchmark for CVE, comprising ANTHROPOS-V, a synthetic photorealistic video dataset featuring crowds in diverse urban environments. Its annotations include each person's volume, SMPL shape parameters, and keypoints. Also, we explore metrics pertinent to CVE, define baseline models adapted from Human Mesh Recovery and Crowd Counting domains, and propose a CVE specific methodology that surpasses baselines. Although synthetic, the weights and heights of individuals are aligned with the real-world population distribution across genders, and they transfer to the downstream task of CVE from real images. Benchmark and code are available at github.com/colloroneluca/Crowd-Volume-Estimation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。