RotaryQuant: Fitting 120B MoE Models on Consumer Hardware via Fused Compressed-Space Attention
RotaryQuant:通过融合压缩空间注意力在消费级硬件上运行1200亿参数的混合专家模型
AI总结 RotaryQuant通过三轴压缩系统及IsoQuant等技术,在消费级硬件上实现1200亿参数MoE模型的高效运行,内存占用低且性能损失极小。
Comments 9 Pages, 9 Tables, Initial submission into NeurIPS 2026