arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.04889cs.CV
收藏

使用令牌丢弃的Turbo训练

Turbo Training with Token Dropout

University of Oxford(牛津大学);Shanghai Jiao Tong University(上海交通大学)

Tengda Han, Weidi Xie, Andrew Zisserman

摘要:

本文的目标是为视频任务提供一种有效的训练方法。我们做了三个贡献:(1)我们提出了涡轮训练,一个简单而通用的训练范式Transformers在多个视频任务。(2)我们展示了Turbo训练在动作分类、视频语言表示学习和长视频活动分类方面的优势,表明Turbo训练可以在很大程度上保持竞争力,同时实现近4倍的速度提升和显著降低的内存消耗。(3)Turbo训练能够实现长时间的视频语言训练和端到端的长视频训练,提供比以前的作品有竞争力或更好的性能,以前的作品在有限的资源下无法进行训练。

英文摘要:

The objective of this paper is an efficient training method for video tasks. We make three contributions: (1) We propose Turbo training, a simple and versatile training paradigm for Transformers on multiple video tasks. (2) We illustrate the advantages of Turbo training on action classification, video-language representation learning, and long-video activity classification, showing that Turbo training can largely maintain competitive performance while achieving almost 4X speed-up and significantly less memory consumption. (3) Turbo training enables long-schedule video-language training and end-to-end long-video training, delivering competitive or superior performance than previous works, which were infeasible to train under limited resources.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑