arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

GPTQ-2D:三次时间复杂度的双侧自适应舍入

GPTQ-2D: Cubic-Time Two-Sided Adaptive Rounding

Jiale Chen, Torsten Hoefler, Dan Alistarh

arXiv 2607.27042首次发表:更新:

发表机构

Institute of Science and Technology Austria (ISTA); ETH Zürich; Red Hat AI(奥地利科学技术研究所(ISTA); 苏黎世联邦理工学院; 红帽人工智能部门)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

本文提出GPTQ-2D算法,将原四次时间复杂度的双侧自适应舍入问题优化为三次时间,按反对角线并行舍入,保留与原算法相同的舍入结果。

AI 中文摘要

GPTQ等自适应舍入方法(等价于Babai最近平面算法)在二次度量下将实矩阵舍入为整数,按固定顺序逐个处理元素,通过三角反馈矩阵将每个舍入误差传播到未处理元素。本文研究该任务的双侧版本,其中固定非奇异基矩阵作用于残差的左右两侧,常见的单侧情况是右侧基为单位矩阵的特例。将矩阵向量化后,双侧目标变为Gram矩阵为克罗内克积的二次度量,一维算法可直接应用,但时间复杂度为矩阵维度的四次方。本文提出GPTQ-2D,可在三次时间内生成相同的舍入矩阵,按反对角线逐个处理元素,同一反对角线上的元素相互独立,可并行舍入。

英文摘要

Adaptive rounding methods such as GPTQ, or equivalently Babai's nearest plane algorithm, round a real matrix to integers under a quadratic metric. They process the entries in a fixed order, one at a time, propagating each rounding error to the entries not yet processed through a triangular feedback matrix. We study the two-sided version of this task, in which fixed nonsingular basis matrices act on both the left and the right of the residual; the familiar one-sided case is the special case of an identity right basis. Vectorizing the matrix turns the two-sided objective into a quadratic metric whose Gram matrix is a Kronecker product, so the one-dimensional algorithm applies verbatim, but takes quartic time in the matrix dimension. We present GPTQ-2D, which produces the identical rounded matrix in cubic time. It rounds the entries anti-diagonal by anti-diagonal; entries on the same anti-diagonal are independent and are rounded in parallel.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑