Fast Inference of Visual Autoregressive Model with Adjacency-Adaptive Dynamical Draft Trees
视觉自回归模型快速推断的邻接自适应动态草案树
机构 * School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院) ; Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(东南大学新一代人工智能技术及交叉应用重点实验室(教育部)) ; New Laboratory of Pattern Recognition (NLPR), State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences (CASIA)(模式识别新实验室(NLPR),多模态人工智能系统国家重点实验室(MAIS),中国科学院自动化研究所(CASIA)) ; School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院) ; School of Computing and Information Systems, Singapore Management University(新加坡国立大学计算机与信息学院)
AI总结 ADT-Tree通过邻接自适应动态草案树提升视觉自回归模型的推断速度,实现3.13倍和3.05倍的加速。