注意文化契合差距:面向任务的文化管理用于大语言模型
Mind the Gap in Cultural Alignment: Task-Aware Culture Management for Large Language Models
AI总结:
本文提出CultureManager,一种面向任务的文化管理方法,通过任务感知的文化数据对齐和文化路由器管理,提升大语言模型在文化敏感任务中的表现。
摘要:
大语言模型(LLMs)正越来越多地部署在具有文化敏感性的现实任务中。然而,现有的文化对齐方法未能将LLMs广泛的文化价值观与下游任务的具体目标对齐,并且受到跨文化干扰。我们提出了CultureManager,一种新的用于任务特定文化对齐的管道。CultureManager合成与目标任务格式一致的任务感知文化数据,基于文化相关网络搜索结果。为了防止文化规范之间的冲突,它通过一个文化路由器管理在单独适配器中学习的多文化知识,选择合适的一个进行应用。在十种民族文化和文化敏感任务上的实验表明,与基于提示和微调基线相比,有显著的改进。我们的结果证明了任务适应和模块化文化管理对于有效文化对齐的必要性。
英文摘要:
Large language models (LLMs) are increasingly deployed in culturally sensitive real-world tasks. However, existing cultural alignment approaches fail to align LLMs' broad cultural values with the specific goals of downstream tasks and suffer from cross-culture interference. We propose CultureManager, a novel pipeline for task-specific cultural alignment. CultureManager synthesizes task-aware cultural data in line with target task formats, grounded in culturally relevant web search results. To prevent conflicts between cultural norms, it manages multi-culture knowledge learned in separate adapters with a culture router that selects the appropriate one to apply. Experiments across ten national cultures and culture-sensitive tasks show consistent improvements over prompt-based and fine-tuning baselines. Our results demonstrate the necessity of task adaptation and modular culture management for effective cultural alignment.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。