使用令牌丢弃的Turbo训练
Turbo Training with Token Dropout
摘要:
本文的目标是为视频任务提供一种有效的训练方法。我们做了三个贡献:(1)我们提出了涡轮训练,一个简单而通用的训练范式Transformers在多个视频任务。(2)我们展示了Turbo训练在动作分类、视频语言表示学习和长视频活动分类方面的优势,表明Turbo训练可以在很大程度上保持竞争力,同时实现近4倍的速度提升和显著降低的内存消耗。(3)Turbo训练能够实现长时间的视频语言训练和端到端的长视频训练,提供比以前的作品有竞争力或更好的性能,以前的作品在有限的资源下无法进行训练。
英文摘要:
The objective of this paper is an efficient training method for video tasks. We make three contributions: (1) We propose Turbo training, a simple and versatile training paradigm for Transformers on multiple video tasks. (2) We illustrate the advantages of Turbo training on action classification, video-language representation learning, and long-video activity classification, showing that Turbo training can largely maintain competitive performance while achieving almost 4X speed-up and significantly less memory consumption. (3) Turbo training enables long-schedule video-language training and end-to-end long-video training, delivering competitive or superior performance than previous works, which were infeasible to train under limited resources.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。