arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2110.07070cs.CV
收藏

协作学习环境中的快速手检测

Fast Hand Detection in Collaborative Learning Environments

The University of New Mexico(新墨西哥大学);Department of Language, Literacy, and Sociocultural Studies(语言、读写与社会文化研究系)

Sravani Teeparthi, Venkatesh Jatla, Marios S. Pattichis, Sylvia Celedon Pattichis, Carlos LopezLeiva

摘要:

长期目标检测需要在几秒钟内对基于帧的结果进行积分。对于不可变形对象,长期检测通常使用目标检测,然后是视频跟踪来解决。不幸的是,跟踪不适用于在帧与帧之间经历外观的戏剧性变化的对象。作为一个相关的例子,我们研究了在协作学习环境中长视频记录的手部检测。更具体地说,我们开发了长期的手检测方法,可以处理部分遮挡和外观的巨大变化。我们的方法集成了对象检测,然后是时间预测,聚类和小区域去除,以提供有效的长视频手部检测。手检测器在0.5交叉联合(IoU)时实现了72%的平均精度(AP)。通过使用我们的优化方法进行数据增强,检测结果提高到81%。该方法以4.7倍实时运行,在并集上的0.5个交点处AP为81%。我们的方法通过将IoU比率从0.2提高到0.5,将假阳性手检测的数量减少了80%。整个手部检测系统以4倍实时运行。

英文摘要:

Long-term object detection requires the integration of frame-based results over several seconds. For non-deformable objects, long-term detection is often addressed using object detection followed by video tracking. Unfortunately, tracking is inapplicable to objects that undergo dramatic changes in appearance from frame to frame. As a related example, we study hand detection over long video recordings in collaborative learning environments. More specifically, we develop long-term hand detection methods that can deal with partial occlusions and dramatic changes in appearance. Our approach integrates object-detection, followed by time projections, clustering, and small region removal to provide effective hand detection over long videos. The hand detector achieved average precision (AP) of 72% at 0.5 intersection over union (IoU). The detection results were improved to 81% by using our optimized approach for data augmentation. The method runs at 4.7x the real-time with AP of 81% at 0.5 intersection over the union. Our method reduced the number of false-positive hand detections by 80% by improving IoU ratios from 0.2 to 0.5. The overall hand detection system runs at 4x real-time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑