SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization
机构 * Dept. of Comp. Sci. and Tech., Institute for AI, BNRist Center, THBI Lab, Tsinghua-Bosch Joint ML Center, Tsinghua University(计算机科学与技术系,人工智能研究院,BNRist中心,THBI实验室,清华-博世联合机器学习中心,清华大学) ; Institute for Interdisciplinary Information Sciences, Tsinghua University(交叉信息学院,清华大学)
Comments @inproceedings{zhang2024sageattention2, title={Sageattention2: Efficient attention with thorough outlier smoothing and per-thread int4 quantization}, author={Zhang, Jintao and Huang, Haofeng and Zhang, Pengle and Wei, Jia and Zhu, Jun and Chen, Jianfei}, booktitle={International Conference on Machine Learning (ICML)}, year={2025} }
Journal ref Proceedings of the 42nd International Conference on Machine Learning, PMLR 267, 2025 (ICML 2025)