Efficient text-to-image generation remains a challenging task due to the high computational costs associated with the multi-step sampling in diffusion models. Although distillation of pre-trained diffusion models has been successful in reducing sampling steps, low-step image generation often falls short in terms of quality. In this study, we propose a novel sampling design to achieve high-quality one-step image generation aligning with human preferences, particularly focusing on exploring the impact of the prior noise distribution. Our approach, Prompt Adaptive Human Preference Inversion (PAHI), optimizes the noise distributions for each prompt based on human preferences without the need for fine-tuning diffusion models. Our experiments showcase that the tailored noise distributions significantly improve image quality with only a marginal increase in computational cost. Our findings underscore the importance of noise optimization and pave the way for efficient and high-quality text-to-image synthesis.
UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Models
The University of British Columbia(不列颠哥伦比亚大学);Tsinghua University(清华大学);Snap Inc.(Snap公司);Vector Institute(向量研究所);Canada CIFAR AI Chair(加拿大CIFAR人工智能主席)
Model Agnostic Preference Optimization for Medical Image Segmentation
DGIST, School of Undergrad Studies(DGIST研究生院);DGIST, Department of Robotics and Mechatronics Engineering(DGIST机器人与机电工程系);DGIST, Division of Intelligent Robot(DGIST智能机器人系)
Diffusion-SDPO: Safeguarded Direct Preference Optimization for Diffusion Models
School of Artificial Intelligence, Nanjing University(人工智能学院,南京大学);National Key Laboratory for Novel Software Technology, Nanjing University(新型软件技术国家实验室,南京大学);Alibaba International Digital Commerce Group(阿里巴巴国际数字商业集团)
Seeing What Matters: Visual Preference Policy Optimization for Visual Generation
Southeast University(东南大学);Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究院(TeleAI),中国电信);University of Science and Technology of China(中国科学技术大学)
DPOison-VL: Clean Preference Poisoning in Vision-Language Direct Preference Optimization
School of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院);Shenzhen Loop Area Institute(深圳河套学院);Shanghai Research Institute for Intelligent Autonomous Systems(上海智能自主系统研究院)
Random Direct Preference Optimization for Radiography Report Generation
Artificial Intelligence Research Institute (AIRI)(人工智能研究院);Skolkovo Institute of Science and Technology(斯克罗夫学院);Institute for Information Transmission Problems(信息传输问题研究所)