Scaling Muon for Diffusion Transformers
针对扩散Transformer的Muon优化器的缩放研究
机构 * University of Southern California(南加州大学) ; Meta
AI总结 该研究针对大型扩散Transformer的Muon优化器,提出周期性行级Muon,在保留其生成质量优势的同时,大幅降低训练的计算、通信开销与时间。
Comments This version has to be withdrawn due to the incomplete publication privacy review required by the company. After completing the privacy review, the newer version will be updated