Personalized content systems depend on available UGC and struggle when suitable content is absent, delayed, or costly to create. Although multimodal generators can synthesize content on demand, how to translate behavioral traces into generation-ready preferences remains underexplored. We study personalized multimodal content generation: creating user-tailored multimodal content without existing item pools or waiting for matching UGC. We propose TailorMind, linking collaborative preference modeling with controllable multimodal generation. TailorMind enriches sparse user histories via hypergraph collaborative filtering and optimizes textual profiles with ranking-error feedback and textual gradient descent. Retrieval-augmented style control grounds outputs in authentic UGC patterns, while cross-modal cohesion reflection reduces semantic drift. We construct TailorBench, a benchmark from three mainstream platforms evaluated along five dimensions: coherence, novelty, aesthetic, hallucination, profiling. Experiments show that TailorMind achieves competitive or stronger coherence, improves novelty and aesthetic quality over representative generation baselines and ground-truth UGC, demonstrating advantages over retrieving available content or comparable UGC, while achieving up to 29% Recall gains in reranking. Our code is released at: https://github.com/iLearn-Lab/TailorMind.
Capturing Nuanced Preferences: Preference-Aligned Distillation for Small Language Models
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Soochow University(苏州大学);University of Technology Sydney(悉尼科技大学);The Hong Kong University of Science and Technology(香港科技大学)
针对成对偏好蒸馏忽视回复差异程度的问题,本文提出 PAD 框架,将师生内在偏好建模为分布并进行对齐,在多个基准上显著提升 SLM 的人类偏好对齐效果。
StoryLens: Preference-Aligned Story Rewriting via Context-Aware Narrative Enrichment
Beijing University of Posts and Telecommunications(北京邮电大学);AIM3 Lab, Renmin University of China(中国人民大学AIM3实验室);Nanyang Technological University(南洋理工大学)
From Volume to Value: Preference-Aligned Memory Construction for On-Device RAG
Department of Computer Science and Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan, Republic of Korea(计算机科学与工程系,全州国立科学与技术研究所(UNIST),全州,韩国)
Efficient Preference-based Reinforcement Learning via Aligned Experience Estimation
Shanghai Jiao Tong University(上海交通大学);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院);BIGAI(北京智源人工智能研究院);Tencent Robotics X(腾讯Robotics X实验室);University of Alberta(阿尔伯塔大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Instant Preference Alignment for Text-to-Image Diffusion Models
New Laboratory of Pattern Recognition, CASIA(模式识别新实验室,中国科学院自动化研究所);The Hong Kong University of Science and Technology(香港科技大学);Nanjing university(南京大学);Academy of Broadcasting Science, NRTA(广播科学研究院,国家广播电视总局)
Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generation
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院)
Rejected Dialects: Biases Against African American Language in Reward Models
Carnegie Mellon University(卡内基梅隆大学);Columbia University(哥伦比亚大学);Instituto Superior Técnico, University of Lisbon(里斯本大学高等技术学院);Instituto de Telecomunicações(电信研究所)