从国家课程到文化意识:构建开放性文化特定问答数据集
From National Curricula to Cultural Awareness: Constructing Open-Ended Culture-Specific Question Answering Dataset
AI总结:
本文提出CuCu框架,利用国家课程构建文化特定的开放性问答数据集KCaQA,以提升语言模型在文化对齐方面的表现。
摘要:
大型语言模型(LLMs)在许多任务上表现出色,但其在不同语言和文化中的进展不均,往往反映了英语中心化训练数据中隐含的价值观。为实现实际的文化对齐,我们提出了一种可扩展的方法,利用国家社会研究课程作为文化意识监督的基础。我们引入了CuCu,一个自动化多代理LLM框架,将国家教科书课程转化为开放性的、文化特定的问答对。将CuCu应用于韩国国家社会研究课程,我们构建了包含34100个开放性问答对的KCaQA数据集。我们的定量和定性分析表明,KCaQA涵盖了文化特定的主题,并产生了基于本地社会文化背景的响应。
英文摘要:
Large language models (LLMs) achieve strong performance on many tasks, but their progress remains uneven across languages and cultures, often reflecting values latent in English-centric training data. To enable practical cultural alignment, we propose a scalable approach that leverages national social studies curricula as a foundation for culture-aware supervision. We introduce CuCu, an automated multi-agent LLM framework that transforms national textbook curricula into open-ended, culture-specific question-answer pairs for supervised fine-tuning (SFT). Applying CuCu to the Korean national social studies curriculum, we construct KCaQA, comprising 34.1k open-ended QA pairs. Our analyses and training experiments suggest that KCaQA covers culture-specific topics and produces responses grounded in local sociocultural contexts.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。