arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.11264cs.CVcs.AIcs.LG

Temporally-Weighted Hierarchical Clustering for Unsupervised Action Segmentation

Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);Daimler TSS(戴姆勒TSS公司);Facebook AI Research(脸书人工智能研究实验室);MIT(麻省理工学院);Harvard Medical School(哈佛医学院);KU Leuven(鲁汶大学);ETH Zurich(苏黎世联邦理工学院)

M. Saquib Sarfraz, Naila Murray, Vivek Sharma, Ali Diba, Luc Van Gool, Rainer Stiefelhagen

英文摘要:

Action segmentation refers to inferring boundaries of semantically consistent visual concepts in videos and is an important requirement for many video understanding tasks. For this and other video understanding tasks, supervised approaches have achieved encouraging performance but require a high volume of detailed frame-level annotations. We present a fully automatic and unsupervised approach for segmenting actions in a video that does not require any training. Our proposal is an effective temporally-weighted hierarchical clustering algorithm that can group semantically consistent frames of the video. Our main finding is that representing a video with a 1-nearest neighbor graph by taking into account the time progression is sufficient to form semantically and temporally consistent clusters of frames where each cluster may represent some action in the video. Additionally, we establish strong unsupervised baselines for action segmentation and show significant performance improvements over published unsupervised methods on five challenging action segmentation datasets. Our code is available at https://github.com/ssarfraz/FINCH-Clustering/tree/master/TW-FINCH

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑