NeurIPS

RotaryQuant: Fitting 120B MoE Models on Consumer Hardware via Fused Compressed-Space Attention

RotaryQuant：通过融合压缩空间注意力在消费级硬件上运行1200亿参数的混合专家模型

Anthony. Lui, Mohamed. Elsaied, N. P. Savani

AI总结 RotaryQuant通过三轴压缩系统及IsoQuant等技术，在消费级硬件上实现1200亿参数MoE模型的高效运行，内存占用低且性能损失极小。

Comments 9 Pages, 9 Tables, Initial submission into NeurIPS 2026