Sliced-Wasserstein Distribution Alignment Loss Improves the Ultra-Low-Bit Quantization of Large Language Models
切片瓦瑟斯坦分布对齐损失提高了大语言模型的超低比特量化
机构 * Department of Information and Communication Engineering, The University of Tokyo(信息与通信工程系,东京大学) ; Department of Computer Science, University of Toronto(计算机科学系,多伦多大学) ; Department of Mechanical and Industrial Engineering, University of Toronto(机械与工业工程系,多伦多大学)
专题命中 幻觉与事实性 :alignment(title,abstract);分类 cs.CL、cs.AI、cs.LG
AI总结 切片瓦瑟斯坦分布对齐损失通过提升超低比特量化性能,有效恢复模型准确性。
Comments Post-peer-review accepted manuscript, 17 pages including the supplementary information