arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2507.13541cs.AI
收藏

PrefPalette:基于潜在属性的个性化偏好建模

PrefPalette: Personalized Preference Modeling with Latent Attributes

Meta FAIR;University of Washington(华盛顿大学);Meta GenAI

Shuyue Stella Li, Melanie Sclar, Hunter Lang, Ansong Ni, Jacqueline He, Puxin Xu, Andrew Cohen, Chan Young Park, Yulia Tsvetkov, Asli Celikyilmaz

AI总结:

PrefPalette框架通过反事实属性合成与基于注意力的偏好建模,将偏好分解为可解释的属性维度并针对不同社会群体动态加权,在Reddit 45个群体上比GPT-4o准确率提升46.6%,实现了更透明、价值感知的个性化偏好建模。

摘要:

个性化AI系统不仅需要理解用户偏好什么,还需要理解这些偏好背后的原因——然而当前的偏好模型通常将人类判断视为一个黑箱。我们提出PrefPalette,一个将偏好分解为属性维度,并以人类可解释的方式针对不同社会群体价值观定制其偏好预测的框架。PrefPalette以两种方式实现了认知科学中称为多属性决策的原理:(1)一个可扩展的反事实属性合成步骤,涉及生成合成训练数据以隔离单个属性效应(例如正式程度、幽默感、文化价值观),以及(2)基于注意力的偏好建模,学习不同社会群体如何动态加权这些属性。该方法超越了聚合偏好建模,能够捕捉驱动人类判断的多样化评估框架。在来自在线平台Reddit的45个社会群体上进行评估时,PrefPalette的平均预测准确率比GPT-4o高出46.6%。除了原始预测性能的提升外,PrefPalette还揭示了直观的、群体特定的特征画像:学术型群体重视详尽性和刺激性,冲突导向型群体重视讽刺和直率,支持型群体强调同理心。通过对人类判断的属性中介结构进行建模,PrefPalette既提供了更优的偏好建模能力,又提供了透明、可解释的洞察,并成为迈向更可信、具有价值感知能力的个性化应用的第一步。

英文摘要:

Personalizing AI systems requires understanding not just what users prefer, but the reasons that underlie those preferences - yet current preference models typically treat human judgment as a black box. We introduce PrefPalette, a framework that decomposes preferences into attribute dimensions and tailors its preference prediction to distinct social community values in a human-interpretable manner. PrefPalette operationalizes a cognitive science principle known as multi-attribute decision making in two ways: (1) a scalable counterfactual attribute synthesis step that involves generating synthetic training data to isolate for individual attribute effects (e.g., formality, humor, cultural values), and (2) attention-based preference modeling that learns how different social communities dynamically weight these attributes. This approach moves beyond aggregate preference modeling to capture the diverse evaluation frameworks that drive human judgment. When evaluated on 45 social communities from the online platform Reddit, PrefPalette outperforms GPT-4o by 46.6% in average prediction accuracy. Beyond raw predictive improvements, PrefPalette also shed light on intuitive, community-specific profiles: scholarly communities prioritize verbosity and stimulation, conflict-oriented communities value sarcasm and directness, and support-based communities emphasize empathy. By modeling the attribute-mediated structure of human judgment, PrefPalette delivers both superior preference modeling and transparent, interpretable insights, and serves as a first step toward more trustworthy, value-aware personalized applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑