Recent advances in AIGC (Artificial Intelligence Generated Content) models have enabled significant progress in image and video generation. However, users still struggle to obtain content that aligns with their preferences due to the difficulty of crafting detailed prompts and the lack of mechanisms to retain their preferences. To address these challenges, we construct \textbf{UniPrefer-100K}, a large-scale dataset comprising images, videos, and associated text that describes the styles users tend to prefer. Based on UniPrefer-100K, we propose \textbf{MagicWand}, a universal generation and evaluation agent that enhances prompts based on user preferences, leverages advanced generation models for high-quality content, and applies preference-aligned evaluation and refinement. In addition, we introduce \textbf{UniPreferBench}, the first large-scale benchmark with over 120K annotations for assessing user preference alignment across diverse AIGC tasks. Experiments on UniPreferBench demonstrate that MagicWand consistently generates content and evaluations that are well aligned with user preferences across a wide range of scenarios.
AVC-DPO: Aligned Video Captioning via Direct Preference Optimization
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);College of Artificial Intelligence, Nankai University(南开大学人工智能学院);School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院)
Zhejiang University(浙江大学);Westlake University(西lake大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Hunan University(湖南大学);Zhejiang University Shanghai Innovation Institute(浙江大学上海创新研究院);The University of Texas at Austin(德克萨斯大学奥斯汀分校)
RefReward-SR: LR-Conditioned Reward Modeling for Preference-Aligned Super-Resolution
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);OPPO AI Center, OPPO Inc.(OPPO人工智能中心)
FairGen: Preference-Aligned Diffusion for Demographically Equitable Medical Image Synthesis
University of Pittsburgh, Swanson School of Engineering(匹兹堡大学斯旺森工程学院);The University of North Carolina at Chapel Hill, Department of Computer Science(北卡罗来纳大学教堂山分校计算机科学系);Arizona State University, School of Computing and Augmented Intelligence(亚利桑那州立大学计算与增强智能学院);University of Pittsburgh, Department of Psychiatry(匹兹堡大学精神病学系)
GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation
Nanyang Technological University(南洋理工大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);Stanford University(斯坦福大学);Adobe Research(Adobe研究院)
Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Preference Understanding
Xiamen University(厦门大学);University of Electronic Science and Technology of China(电子科技大学);University of Minnesota—Twin Cities(明尼苏达大学—双城分校);Emory University(埃默里大学);Tsinghua University(清华大学);University of Warwick(沃里克大学);University of the Chinese Academy of Sciences(中国科学院大学);George Washington University(乔治华盛顿大学);University of Toronto(多伦多大学);Peking University(北京大学)
Instant Preference Alignment for Text-to-Image Diffusion Models
New Laboratory of Pattern Recognition, CASIA(模式识别新实验室,中国科学院自动化研究所);The Hong Kong University of Science and Technology(香港科技大学);Nanjing university(南京大学);Academy of Broadcasting Science, NRTA(广播科学研究院,国家广播电视总局)
CHATS: Combining Human-Aligned Optimization and Test-Time Sampling for Text-to-Image Generation
National Key Laboratory for Novel Software Technology, Nanjing University(新型软件技术国家实验室,南京大学);School of Artificial Intelligence, Nanjing University(人工智能学院,南京大学);Alibaba Group(阿里巴巴集团)