Uniform Discrete Diffusion Model (UDM) has recently emerged as a promising paradigm for discrete generative modeling; however, its integration with reinforcement learning remains largely unexplored. We observe that naively applying GRPO to UDM leads to training instability and marginal performance gains. To address this, we propose UDM-GRPO, the first framework to integrate UDM with RL. Our method is guided by two key insights: (i) treating the final clean sample as the action provides more accurate and stable optimization signals; and (ii) reconstructing trajectories via the diffusion forward process better aligns probability paths with the pretraining distribution. Additionally, we introduce two strategies, Reduced-Step and CFG-Free, to further improve training efficiency. UDM-GRPO significantly improves base model performance across multiple T2I tasks. Notably, GenEval accuracy improves from $69\%$ to $96\%$ and PickScore increases from $20.46$ to $23.81$, achieving state-of-the-art performance in both continuous and discrete settings. On the OCR benchmark, accuracy rises from $8\%$ to $57\%$, further validating the generalization ability of our method. Code is available at https://github.com/Yovecent/UDM-GRPO.
AdaGRPO: A Capability-Aware Adaptive Enhancement for Flow-based GRPO
Shanghai Jiao Tong University(上海交通大学);S-Lab, Nanyang Technological University(南洋理工大学S实验室);Shanghai AI Laboratory(上海人工智能实验室);University of Science and Technology of China(中国科学技术大学);Stanford University(斯坦福大学);Shanghai Innovation Institute(上海创新研究院);The Chinese University of Hong Kong(香港中文大学);Fudan University(复旦大学);CPII under InnoHK(InnoHK下的CPII);Adobe Research(Adobe研究)
Rethinking Reward Signals in Video GRPO: When Scores Become Targets
University of Science and Technology of China(中国科学技术大学);Southeast University(东南大学);Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究院(TeleAI),中国电信)
GRPO-RM: Fine-Tuning Representation Models via GRPO-Driven Reinforcement Learning
Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究院(TeleAI),中国电信);School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University(人工智能学院(iOPEN),西北工业大学);HuaWei Technologies Co., Ltd.(华为技术有限公司);The University of Hong Kong(香港大学)
Seeing What Matters: Visual Preference Policy Optimization for Visual Generation
Southeast University(东南大学);Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究院(TeleAI),中国电信);University of Science and Technology of China(中国科学技术大学)
VerIPO: Cultivating Long Reasoning in Video-LLMs via Verifier-Gudied Iterative Policy Optimization
Harbin Institute of Technology, Shenzhen, China(哈尔滨工业大学(深圳));Alibaba International Group(阿里巴巴国际集团);Division of AMC and Department of ECE, HKUST(HKUST电子工程系与AMC division)
Pave-GRPO: Beyond Instantaneous Guidance through Principled Average Velocity Decomposition
University of Science and Technology of China(中国科学技术大学);Shanghai Jiao Tong University(上海交通大学);Fudan University(复旦大学);Harbin Institute of Technology(哈尔滨工业大学);Beihang University(北京航空航天大学);Shanghai AI Laboratory(上海人工智能实验室)