Variance-Reduction Guidance: Sampling Trajectory Optimization for Diffusion Models
College of Computing;Data Science, Nanyang Technological University Singapore;Institute for Infocomm Research (I2R) \& Centre for Frontier AI Research, A STAR Singapore liu\
Diffusion models have become emerging generative models. Their sampling process involves multiple steps, and in each step the models predict the noise from a noisy sample. When the models make prediction, the output deviates from the ground truth, and we call such a deviation as \textit{prediction error}. The prediction error accumulates over the sampling process and deteriorates generation quality. This paper introduces a novel technique for statistically measuring the prediction error and proposes the Variance-Reduction Guidance (VRG) method to mitigate this error. VRG does not require model fine-tuning or modification. Given a predefined sampling trajectory, it searches for a new trajectory which has the same number of sampling steps but produces higher quality results. VRG is applicable to both conditional and unconditional generation. Experiments on various datasets and baselines demonstrate that VRG can significantly improve the generation quality of diffusion models. Source code is available at https://github.com/shifengxu/VRG.
Video Reconstruction using Diffusion-based Image-to-Video Generation with Trajectory Guidance
Department of Electrical and Computer Engineering, National Technical University of Athens, Greece(电气与计算机工程系,希腊国家技术大学雅典分校);Department of Product and Systems Design Engineering, University of the Aegean, Syros, Greece(产品与系统设计工程系,爱琴海大学锡罗斯分校)
Variance-aware Reward Modeling with Anchor Guidance
Department of Data Science and Artificial Intelligence, Hong Kong Polytechnic University(香港理工大学数据科学与人工智能系);School of Statistics and Data Science, Shanghai University of Finance and Economics(上海财经大学统计与数据科学学院)
Reducing Bias and Variance: Generative Semantic Guidance and Bi-Layer Ensemble for Image Clustering
Institute of Big Data Science and Industry(大数据科学与产业研究院);Key Laboratory of Evolutionary Science Intelligence of Shanxi Province(山西省进化智能科学重点实验室);School of Artificial Intelligence, Shanxi University(山西大学人工智能学院)
MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidance
Shanghai Key Lab of Intell. Info. Processing, School of CS, Fudan University(上海智能信息处理关键实验室,复旦大学计算机学院);Shanghai Collaborative Innovation Center of Intelligent Visual Computing(上海智能视觉计算协同创新中心);Microsoft Research Asia(微软亚洲研究院)
Look Ahead Before You Distill: Future Trajectory Validation of Teacher Guidance for Agentic On-Policy Distillation
Meituan LongCat Interaction(美团龙猫交互);Shanghai Jiao Tong University(上海交通大学);Fudan University(复旦大学);Peking University(北京大学);Nanjing University(南京大学);University of Chinese Academy of Sciences(中国科学院大学);Jilin University(吉林大学);University of Science and Technology of China(中国科学技术大学);The Hong Kong Polytechnic University(香港理工大学)
Policy Optimization with Smooth Guidance Learned from State-Only Demonstrations
School of Mathematical Sciences, Beihang University(北京航空航天大学数学科学学院);Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能研究院);Zhongguancun Laboratory(中关村实验室);Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing(未来区块链与隐私计算北京高精尖创新中心)
JointDiff: Bridging Continuous and Discrete in Multi-Agent Trajectory Generation
Kognia Sports Intelligence(Kognia体育智能);Visual Intelligence for Transportation, EPFL(交通视觉智能,EPFL);Institut de Robòtica i Informàtica Industrial, CSIC-UPC(机器人与信息工业研究所,CSIC-UPC)