arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2208.01100cs.CVcs.LGcs.MM
收藏

隐私保护条件下的二进运动同步估计

Dyadic Movement Synchrony Estimation Under Privacy-preserving Conditions

University of Delaware(特拉华大学)

Jicheng Li, Anjana Bhat, Roghayeh Barmaki

摘要:

运动同步是指相互作用的人的运动之间的动态时间连接。运动同步性的应用是广泛的。例如,作为队友之间协调的衡量标准,同步得分经常在体育运动中报告。自闭症社区还将运动同步性确定为儿童社会和发展成就的关键指标。通常,原始视频记录通常用于运动同步估计,其缺点是它们可能会泄露人的身份。此外,这种隐私问题也阻碍了数据共享,这是自闭症研究中不同方法之间公平比较的一个主要障碍。为了解决这个问题,本文提出了一种用于运动同步估计的集成方法,这是在隐私保护条件下进行自动运动同步评估的第一种基于深度学习的方法之一。我们的方法完全依赖于公开共享的,身份不可知的辅助数据,如骨架数据和光流。我们在两个数据集上验证了我们的方法:(1)从自闭症治疗干预中收集的PT 13数据集和(2)从双人跳水比赛中收集的TASD-2数据集。在这种情况下,我们的方法优于其对应的方法,无论是深度神经网络还是替代方法。

英文摘要:

Movement synchrony refers to the dynamic temporal connection between the motions of interacting people. The applications of movement synchrony are wide and broad. For example, as a measure of coordination between teammates, synchrony scores are often reported in sports. The autism community also identifies movement synchrony as a key indicator of children's social and developmental achievements. In general, raw video recordings are often used for movement synchrony estimation, with the drawback that they may reveal people's identities. Furthermore, such privacy concern also hinders data sharing, one major roadblock to a fair comparison between different approaches in autism research. To address the issue, this paper proposes an ensemble method for movement synchrony estimation, one of the first deep-learning-based methods for automatic movement synchrony assessment under privacy-preserving conditions. Our method relies entirely on publicly shareable, identity-agnostic secondary data, such as skeleton data and optical flow. We validate our method on two datasets: (1) PT13 dataset collected from autism therapy interventions and (2) TASD-2 dataset collected from synchronized diving competitions. In this context, our method outperforms its counterpart approaches, both deep neural networks and alternatives.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑