SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models
机构 * MIT(麻省理工学院) ; NVIDIA(NVIDIA公司) ; CMU(卡内基梅隆大学) ; Princeton(普林斯顿大学) ; UC Berkeley(加州大学伯克利分校) ; SJTU(上海交通大学) ; Pika Labs(Pika实验室)
Comments ICLR 2025 Spotlight Quantization Library: https://github.com/mit-han-lab/deepcompressor Inference Engine: https://github.com/mit-han-lab/nunchaku Website: https://hanlab.mit.edu/projects/svdquant Demo: https://demo.nunchaku.tech/ Blog: https://hanlab.mit.edu/blog/svdquant