SwimXYZ:一个包含合成游泳动作与视频的大规模数据集
SwimXYZ: A large-scale dataset of synthetic swimming motions and videos
AI总结:
针对游泳领域缺乏标注视频数据集导致视觉方法效果受限的问题,研究团队推出包含340万帧标注帧与240段SMPL格式动作序列的合成数据集SwimXYZ,并展示其在泳姿聚类、2D姿态估计中的应用。
摘要:
技术在体育运动中发挥着日益重要的作用,也为受益于它的运动员带来了切实的竞争优势。其中,动作捕捉技术正逐步应用于各类体育运动,以优化运动姿态。遗憾的是,传统动作捕捉系统成本高昂且限制较多。近期开发的基于计算机视觉的方法,在游泳等部分体育运动中也会因水环境的存在而效果不佳。性能存在差距的原因之一,是缺少带有标注的游泳视频数据集。为解决这一问题,我们推出了SwimXYZ,一个包含合成游泳动作与视频的数据集。SwimXYZ包含340万帧标注有真实2D和3D关节点的帧,以及240段SMPL参数格式的游泳动作序列。除公开该数据集外,我们还展示了SwimXYZ在泳姿聚类和2D姿态估计中的应用场景。
英文摘要:
Technologies play an increasingly important role in sports and become a real competitive advantage for the athletes who benefit from it. Among them, the use of motion capture is developing in various sports to optimize sporting gestures. Unfortunately, traditional motion capture systems are expensive and constraining. Recently developed computer vision-based approaches also struggle in certain sports, like swimming, due to the aquatic environment. One of the reasons for the gap in performance is the lack of labeled datasets with swimming videos. In an attempt to address this issue, we introduce SwimXYZ, a synthetic dataset of swimming motions and videos. SwimXYZ contains 3.4 million frames annotated with ground truth 2D and 3D joints, as well as 240 sequences of swimming motions in the SMPL parameters format. In addition to making this dataset publicly available, we present use cases for SwimXYZ in swimming stroke clustering and 2D pose estimation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。